[2024-11-17 15:49:23.577569] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 24.03.0 initialization... [2024-11-17 15:49:23.577666] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1696869 ] Set seed to 1731854963575119 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 15:49:23.689799] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 15:49:23.798185] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 15:49:23.798229] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1696869' to capture a snapshot of events at runtime. [2024-11-17 15:49:23.798239] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 15:49:23.798250] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 15:49:23.798258] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1696869 for offline analysis/debug. [2024-11-17 15:49:23.799669] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 15:49:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-15:49:34 ... thread 0: (1000000,1000000) ops and (360080.2,360080.2) ops/second in (2.777159,2.777159) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 629.96 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 351.8 2.33 2.08 12 0.194 0 0 0.0 0.0 L1 1/1 63.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 919.57 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 17/0 866.22 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 229.8 229.8 0.54 0.48 1 0.544 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/9 96.94 GB 0.0 0.2 0.2 0.1 1.0 1.0 0.5 1.3 74.3 316.4 3.38 3.05 14 0.242 254K 41 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.0 1.0 0.4 1.3 74.3 316.4 3.38 3.05 14 0.242 254K 41 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 238.4 238.3 1.05 0.97 2 0.527 254K 41 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 351.8 2.33 2.08 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.04 GB write, 358.24 MB/s write, 0.25 GB read, 84.06 MB/s read, 3.4 seconds Interval compaction: 1.04 GB write, 385.09 MB/s write, 0.25 GB read, 90.36 MB/s read, 3.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 120696 Average: 1.9669 StdDev: 14.65 Min: 1 Median: 1.3221 Max: 3081 Percentiles: P50: 1.32 P75: 1.72 P99: 4.51 P99.9: 9.97 P99.99: 136.20 ------------------------------------------------------ [ 0, 1 ] 35871 29.720% 29.720% ###### ( 1, 2 ] 76005 62.972% 92.692% ############# ( 2, 3 ] 5622 4.658% 97.350% # ( 3, 4 ] 1758 1.457% 98.807% ( 4, 6 ] 917 0.760% 99.567% ( 6, 10 ] 408 0.338% 99.905% ( 10, 15 ] 87 0.072% 99.977% ( 15, 22 ] 9 0.007% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 34, 51 ] 3 0.002% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 9 0.007% 99.997% ( 170, 250 ] 2 0.002% 99.998% ( 250, 380 ] 6 0.005% 100.003% ( 870, 1300 ] 3 0.002% 100.006% ( 1300, 1900 ] 1 0.001% 100.007% ( 1900, 2900 ] 2 0.002% 100.008% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 5 Average: 2831.0000 StdDev: 2952.07 Min: 195 Median: 1085.0000 Max: 7508 Percentiles: P50: 1085.00 P75: 6050.00 P99: 7508.00 P99.9: 7508.00 P99.99: 7508.00 ------------------------------------------------------ ( 170, 250 ] 1 20.000% 20.000% #### ( 250, 380 ] 1 20.000% 40.000% #### ( 870, 1300 ] 1 20.000% 60.000% #### ( 4400, 6600 ] 1 20.000% 80.000% #### ( 6600, 9900 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 31758 Average: 1.7645 StdDev: 5.41 Min: 1 Median: 1.2470 Max: 885 Percentiles: P50: 1.25 P75: 1.66 P99: 3.55 P99.9: 9.38 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 11125 35.031% 35.031% ####### ( 1, 2 ] 19250 60.615% 95.645% ############ ( 2, 3 ] 914 2.878% 98.523% # ( 3, 4 ] 275 0.866% 99.389% ( 4, 6 ] 109 0.343% 99.732% ( 6, 10 ] 63 0.198% 99.931% ( 10, 15 ] 19 0.060% 99.991% ( 15, 22 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1554.3875 StdDev: 2458.47 Min: 1 Median: 170.0000 Max: 8643 Percentiles: P50: 170.00 P75: 2185.71 P99: 8643.00 P99.9: 8643.00 P99.99: 8643.00 ------------------------------------------------------ [ 0, 1 ] 23 28.750% 28.750% ###### ( 1, 2 ] 9 11.250% 40.000% ## ( 2, 3 ] 3 3.750% 43.750% # ( 3, 4 ] 1 1.250% 45.000% ( 4, 6 ] 1 1.250% 46.250% ( 6, 10 ] 1 1.250% 47.500% ( 51, 76 ] 1 1.250% 48.750% ( 110, 170 ] 1 1.250% 50.000% ( 170, 250 ] 2 2.500% 52.500% # ( 250, 380 ] 3 3.750% 56.250% # ( 380, 580 ] 3 3.750% 60.000% # ( 580, 870 ] 3 3.750% 63.750% # ( 870, 1300 ] 3 3.750% 67.500% # ( 1300, 1900 ] 4 5.000% 72.500% # ( 1900, 2900 ] 7 8.750% 81.250% ## ( 2900, 4400 ] 3 3.750% 85.000% # ( 4400, 6600 ] 5 6.250% 91.250% # ( 6600, 9900 ] 7 8.750% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 3717.7429 StdDev: 2609.58 Min: 214 Median: 3650.0000 Max: 8246 Percentiles: P50: 3650.00 P75: 5696.43 P99: 8246.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 3 8.571% 20.000% ## ( 870, 1300 ] 2 5.714% 25.714% # ( 1300, 1900 ] 4 11.429% 37.143% ## ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 1 2.857% 51.429% # ( 4400, 6600 ] 14 40.000% 91.429% ######## ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.205 H:M:S, 6.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.205 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-15:49:37 ... thread 0: (1000000,2000000) ops and (330005.2,344387.4) ops/second in (3.030255,5.807414) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 107.0 0.9 0.0 0.9 2.6 1.8 0.0 1.5 103.8 318.6 8.50 7.84 29 0.293 895K 1025 0.0 0.0 L1 1/0 2.39 MB 0.2 0.3 0.2 0.1 0.3 0.2 0.2 1.2 251.6 251.3 1.25 1.22 1 1.252 319K 361 0.0 0.0 L2 2/0 55.57 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.5 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 54/0 986.83 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 192.5 192.4 2.57 2.14 2 1.286 502K 371 0.0 0.0 L4 136/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/4 97.92 GB 0.0 1.8 0.7 1.1 3.6 2.5 0.9 2.0 141.7 283.9 12.83 11.68 33 0.389 1845K 1798 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.1 3.6 2.5 0.8 2.0 141.7 283.9 12.83 11.68 33 0.389 1845K 1798 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.1 1.8 0.7 0.0 0.0 237.1 236.8 7.67 7.12 7 1.096 1845K 1798 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.9 5.16 4.56 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.56 GB write, 605.46 MB/s write, 1.78 GB read, 302.15 MB/s read, 12.8 seconds Interval compaction: 3.56 GB write, 627.17 MB/s write, 1.78 GB read, 312.98 MB/s read, 12.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 377068 Average: 2.1167 StdDev: 12.91 Min: 0 Median: 1.4386 Max: 4096 Percentiles: P50: 1.44 P75: 1.82 P99: 5.42 P99.9: 9.95 P99.99: 20.54 ------------------------------------------------------ [ 0, 1 ] 80296 21.295% 21.295% #### ( 1, 2 ] 246762 65.442% 86.737% ############# ( 2, 3 ] 32613 8.649% 95.386% ## ( 3, 4 ] 9539 2.530% 97.916% # ( 4, 6 ] 5761 1.528% 99.444% ( 6, 10 ] 1744 0.463% 99.906% ( 10, 15 ] 287 0.076% 99.982% ( 15, 22 ] 37 0.010% 99.992% ( 22, 34 ] 8 0.002% 99.994% ( 34, 51 ] 6 0.002% 99.996% ( 51, 76 ] 3 0.001% 99.997% ( 110, 170 ] 15 0.004% 100.001% ( 170, 250 ] 7 0.002% 100.003% ( 250, 380 ] 11 0.003% 100.006% ( 380, 580 ] 5 0.001% 100.007% ( 580, 870 ] 4 0.001% 100.008% ( 870, 1300 ] 9 0.002% 100.010% ( 1300, 1900 ] 2 0.001% 100.011% ( 1900, 2900 ] 4 0.001% 100.012% ( 2900, 4400 ] 2 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 65403 Average: 2.6211 StdDev: 36.41 Min: 1 Median: 1.6530 Max: 7508 Percentiles: P50: 1.65 P75: 2.11 P99: 5.83 P99.9: 12.71 P99.99: 525.97 ------------------------------------------------------ [ 0, 1 ] 4588 7.015% 7.015% # ( 1, 2 ] 43051 65.824% 72.839% ############# ( 2, 3 ] 12762 19.513% 92.352% #### ( 3, 4 ] 2616 4.000% 96.352% # ( 4, 6 ] 1897 2.900% 99.252% # ( 6, 10 ] 370 0.566% 99.818% ( 10, 15 ] 99 0.151% 99.969% ( 15, 22 ] 6 0.009% 99.979% ( 22, 34 ] 3 0.005% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 170, 250 ] 1 0.002% 99.986% ( 250, 380 ] 1 0.002% 99.988% ( 380, 580 ] 2 0.003% 99.991% ( 580, 870 ] 2 0.003% 99.994% ( 870, 1300 ] 2 0.003% 99.997% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31758 Average: 1.7645 StdDev: 5.41 Min: 1 Median: 1.2470 Max: 885 Percentiles: P50: 1.25 P75: 1.66 P99: 3.55 P99.9: 9.38 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 11125 35.031% 35.031% ####### ( 1, 2 ] 19250 60.615% 95.645% ############ ( 2, 3 ] 914 2.878% 98.523% # ( 3, 4 ] 275 0.866% 99.389% ( 4, 6 ] 109 0.343% 99.732% ( 6, 10 ] 63 0.198% 99.931% ( 10, 15 ] 19 0.060% 99.991% ( 15, 22 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28926 Average: 6.7734 StdDev: 152.91 Min: 1 Median: 1.6745 Max: 8643 Percentiles: P50: 1.67 P75: 2.22 P99: 7.30 P99.9: 880.61 P99.99: 8536.35 ------------------------------------------------------ [ 0, 1 ] 2169 7.498% 7.498% # ( 1, 2 ] 18228 63.016% 70.514% ############# ( 2, 3 ] 6006 20.763% 91.278% #### ( 3, 4 ] 1276 4.411% 95.689% # ( 4, 6 ] 892 3.084% 98.773% # ( 6, 10 ] 203 0.702% 99.475% ( 10, 15 ] 77 0.266% 99.741% ( 15, 22 ] 15 0.052% 99.793% ( 22, 34 ] 2 0.007% 99.799% ( 34, 51 ] 8 0.028% 99.827% ( 51, 76 ] 1 0.003% 99.831% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 5 0.017% 99.872% ( 380, 580 ] 5 0.017% 99.889% ( 580, 870 ] 3 0.010% 99.900% ( 870, 1300 ] 3 0.010% 99.910% ( 1300, 1900 ] 4 0.014% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 3 0.010% 99.959% ( 4400, 6600 ] 5 0.017% 99.976% ( 6600, 9900 ] 7 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3717.7429 StdDev: 2609.58 Min: 214 Median: 3650.0000 Max: 8246 Percentiles: P50: 3650.00 P75: 5696.43 P99: 8246.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 3 8.571% 20.000% ## ( 870, 1300 ] 2 5.714% 25.714% # ( 1300, 1900 ] 4 11.429% 37.143% ## ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 1 2.857% 51.429% # ( 4400, 6600 ] 14 40.000% 91.429% ######## ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 327.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.614 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-15:49:40 ... thread 0: (1000000,3000000) ops and (336674.6,341777.5) ops/second in (2.970227,8.777641) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.34 GB 37.8 1.7 0.0 1.7 4.4 2.8 0.0 1.6 118.4 315.5 14.37 13.35 46 0.312 1727K 1894 0.0 0.0 L1 1/1 2.39 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 251.6 251.3 1.25 1.22 1 1.252 319K 361 0.0 0.0 L2 2/0 55.57 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.5 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 54/0 986.83 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 192.5 192.4 2.57 2.14 2 1.286 502K 371 0.0 0.0 L4 136/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/14 98.90 GB 0.0 2.6 0.7 1.9 5.3 3.4 0.9 1.9 141.0 292.4 18.70 17.20 50 0.374 2677K 2667 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 0.7 1.9 5.3 3.4 0.8 1.9 141.0 292.4 18.70 17.20 50 0.374 2677K 2667 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 0.7 1.9 2.6 0.7 0.0 0.0 245.1 244.9 10.76 10.16 10 1.076 2677K 2667 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.8 7.95 7.04 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.34 GB write, 608.53 MB/s write, 2.58 GB read, 293.42 MB/s read, 18.7 seconds Interval compaction: 5.34 GB write, 622.97 MB/s write, 2.58 GB read, 300.38 MB/s read, 18.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 656965 Average: 2.1255 StdDev: 15.88 Min: 0 Median: 1.4483 Max: 7842 Percentiles: P50: 1.45 P75: 1.82 P99: 5.22 P99.9: 9.89 P99.99: 17.33 ------------------------------------------------------ [ 0, 1 ] 131971 20.088% 20.088% #### ( 1, 2 ] 438366 66.726% 86.814% ############# ( 2, 3 ] 58957 8.974% 95.788% ## ( 3, 4 ] 15699 2.390% 98.178% ( 4, 6 ] 8866 1.350% 99.527% ( 6, 10 ] 2520 0.384% 99.911% ( 10, 15 ] 503 0.077% 99.987% ( 15, 22 ] 55 0.008% 99.996% ( 22, 34 ] 15 0.002% 99.998% ( 34, 51 ] 9 0.001% 99.999% ( 51, 76 ] 3 0.000% 100.000% ( 110, 170 ] 19 0.003% 100.003% ( 170, 250 ] 12 0.002% 100.005% ( 250, 380 ] 14 0.002% 100.007% ( 380, 580 ] 11 0.002% 100.008% ( 580, 870 ] 9 0.001% 100.010% ( 870, 1300 ] 12 0.002% 100.012% ( 1300, 1900 ] 4 0.001% 100.012% ( 1900, 2900 ] 8 0.001% 100.013% ( 2900, 4400 ] 3 0.000% 100.014% ( 6600, 9900 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 65404 Average: 2.6211 StdDev: 36.40 Min: 1 Median: 1.6530 Max: 7508 Percentiles: P50: 1.65 P75: 2.11 P99: 5.83 P99.9: 12.71 P99.99: 525.96 ------------------------------------------------------ [ 0, 1 ] 4588 7.015% 7.015% # ( 1, 2 ] 43051 65.823% 72.838% ############# ( 2, 3 ] 12762 19.513% 92.351% #### ( 3, 4 ] 2617 4.001% 96.352% # ( 4, 6 ] 1897 2.900% 99.252% # ( 6, 10 ] 370 0.566% 99.818% ( 10, 15 ] 99 0.151% 99.969% ( 15, 22 ] 6 0.009% 99.979% ( 22, 34 ] 3 0.005% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 170, 250 ] 1 0.002% 99.986% ( 250, 380 ] 1 0.002% 99.988% ( 380, 580 ] 2 0.003% 99.991% ( 580, 870 ] 2 0.003% 99.994% ( 870, 1300 ] 2 0.003% 99.997% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31758 Average: 1.7645 StdDev: 5.41 Min: 1 Median: 1.2470 Max: 885 Percentiles: P50: 1.25 P75: 1.66 P99: 3.55 P99.9: 9.38 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 11125 35.031% 35.031% ####### ( 1, 2 ] 19250 60.615% 95.645% ############ ( 2, 3 ] 914 2.878% 98.523% # ( 3, 4 ] 275 0.866% 99.389% ( 4, 6 ] 109 0.343% 99.732% ( 6, 10 ] 63 0.198% 99.931% ( 10, 15 ] 19 0.060% 99.991% ( 15, 22 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28926 Average: 6.7734 StdDev: 152.91 Min: 1 Median: 1.6745 Max: 8643 Percentiles: P50: 1.67 P75: 2.22 P99: 7.30 P99.9: 880.61 P99.99: 8536.35 ------------------------------------------------------ [ 0, 1 ] 2169 7.498% 7.498% # ( 1, 2 ] 18228 63.016% 70.514% ############# ( 2, 3 ] 6006 20.763% 91.278% #### ( 3, 4 ] 1276 4.411% 95.689% # ( 4, 6 ] 892 3.084% 98.773% # ( 6, 10 ] 203 0.702% 99.475% ( 10, 15 ] 77 0.266% 99.741% ( 15, 22 ] 15 0.052% 99.793% ( 22, 34 ] 2 0.007% 99.799% ( 34, 51 ] 8 0.028% 99.827% ( 51, 76 ] 1 0.003% 99.831% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 5 0.017% 99.872% ( 380, 580 ] 5 0.017% 99.889% ( 580, 870 ] 3 0.010% 99.900% ( 870, 1300 ] 3 0.010% 99.910% ( 1300, 1900 ] 4 0.014% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 3 0.010% 99.959% ( 4400, 6600 ] 5 0.017% 99.976% ( 6600, 9900 ] 7 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3717.7429 StdDev: 2609.58 Min: 214 Median: 3650.0000 Max: 8246 Percentiles: P50: 3650.00 P75: 5696.43 P99: 8246.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 3 8.571% 20.000% ## ( 870, 1300 ] 2 5.714% 25.714% # ( 1300, 1900 ] 4 11.429% 37.143% ## ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 1 2.857% 51.429% # ( 4400, 6600 ] 14 40.000% 91.429% ######## ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.985 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.371 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-15:49:44 ... thread 0: (1000000,4000000) ops and (258461.0,316288.1) ops/second in (3.869055,12.646696) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 3.32 GB 163.7 2.7 0.0 2.7 6.5 3.7 0.0 1.7 130.6 311.5 21.23 19.84 65 0.327 2814K 2999 0.0 0.0 L1 1/1 2.39 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.2 1.2 251.6 251.3 1.25 1.22 1 1.252 319K 361 0.0 0.0 L2 2/0 55.57 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.5 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 54/0 986.83 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 192.5 192.4 2.57 2.14 2 1.286 502K 371 0.0 0.0 L4 136/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/10 99.89 GB 0.0 3.6 0.7 2.9 7.4 4.4 0.9 2.0 145.1 295.3 25.56 23.68 69 0.370 3764K 3772 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 0.7 2.9 7.4 4.4 0.8 2.0 145.1 295.3 25.56 23.68 69 0.370 3764K 3772 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 0.7 2.9 3.6 0.7 0.0 0.0 251.2 251.0 14.76 14.10 14 1.054 3764K 3772 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 355.8 10.80 9.58 55 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.9 total, 12.6 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.37 GB write, 587.01 MB/s write, 3.62 GB read, 288.42 MB/s read, 25.6 seconds Interval compaction: 7.37 GB write, 596.68 MB/s write, 3.62 GB read, 293.17 MB/s read, 25.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 14, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1158059 Average: 2.1824 StdDev: 12.99 Min: 0 Median: 1.4936 Max: 7842 Percentiles: P50: 1.49 P75: 1.86 P99: 5.41 P99.9: 10.06 P99.99: 15.38 ------------------------------------------------------ [ 0, 1 ] 191631 16.548% 16.548% ### ( 1, 2 ] 784817 67.770% 84.318% ############## ( 2, 3 ] 125856 10.868% 95.185% ## ( 3, 4 ] 31449 2.716% 97.901% # ( 4, 6 ] 18003 1.555% 99.456% ( 6, 10 ] 5134 0.443% 99.899% ( 10, 15 ] 1049 0.091% 99.990% ( 15, 22 ] 96 0.008% 99.998% ( 22, 34 ] 21 0.002% 100.000% ( 34, 51 ] 11 0.001% 100.001% ( 51, 76 ] 6 0.001% 100.001% ( 76, 110 ] 6 0.001% 100.002% ( 110, 170 ] 69 0.006% 100.008% ( 170, 250 ] 36 0.003% 100.011% ( 250, 380 ] 24 0.002% 100.013% ( 380, 580 ] 22 0.002% 100.015% ( 580, 870 ] 18 0.002% 100.016% ( 870, 1300 ] 18 0.002% 100.018% ( 1300, 1900 ] 6 0.001% 100.018% ( 1900, 2900 ] 10 0.001% 100.019% ( 2900, 4400 ] 3 0.000% 100.020% ( 6600, 9900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 65404 Average: 2.6211 StdDev: 36.40 Min: 1 Median: 1.6530 Max: 7508 Percentiles: P50: 1.65 P75: 2.11 P99: 5.83 P99.9: 12.71 P99.99: 525.96 ------------------------------------------------------ [ 0, 1 ] 4588 7.015% 7.015% # ( 1, 2 ] 43051 65.823% 72.838% ############# ( 2, 3 ] 12762 19.513% 92.351% #### ( 3, 4 ] 2617 4.001% 96.352% # ( 4, 6 ] 1897 2.900% 99.252% # ( 6, 10 ] 370 0.566% 99.818% ( 10, 15 ] 99 0.151% 99.969% ( 15, 22 ] 6 0.009% 99.979% ( 22, 34 ] 3 0.005% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 170, 250 ] 1 0.002% 99.986% ( 250, 380 ] 1 0.002% 99.988% ( 380, 580 ] 2 0.003% 99.991% ( 580, 870 ] 2 0.003% 99.994% ( 870, 1300 ] 2 0.003% 99.997% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31758 Average: 1.7645 StdDev: 5.41 Min: 1 Median: 1.2470 Max: 885 Percentiles: P50: 1.25 P75: 1.66 P99: 3.55 P99.9: 9.38 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 11125 35.031% 35.031% ####### ( 1, 2 ] 19250 60.615% 95.645% ############ ( 2, 3 ] 914 2.878% 98.523% # ( 3, 4 ] 275 0.866% 99.389% ( 4, 6 ] 109 0.343% 99.732% ( 6, 10 ] 63 0.198% 99.931% ( 10, 15 ] 19 0.060% 99.991% ( 15, 22 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28926 Average: 6.7734 StdDev: 152.91 Min: 1 Median: 1.6745 Max: 8643 Percentiles: P50: 1.67 P75: 2.22 P99: 7.30 P99.9: 880.61 P99.99: 8536.35 ------------------------------------------------------ [ 0, 1 ] 2169 7.498% 7.498% # ( 1, 2 ] 18228 63.016% 70.514% ############# ( 2, 3 ] 6006 20.763% 91.278% #### ( 3, 4 ] 1276 4.411% 95.689% # ( 4, 6 ] 892 3.084% 98.773% # ( 6, 10 ] 203 0.702% 99.475% ( 10, 15 ] 77 0.266% 99.741% ( 15, 22 ] 15 0.052% 99.793% ( 22, 34 ] 2 0.007% 99.799% ( 34, 51 ] 8 0.028% 99.827% ( 51, 76 ] 1 0.003% 99.831% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 5 0.017% 99.872% ( 380, 580 ] 5 0.017% 99.889% ( 580, 870 ] 3 0.010% 99.900% ( 870, 1300 ] 3 0.010% 99.910% ( 1300, 1900 ] 4 0.014% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 3 0.010% 99.959% ( 4400, 6600 ] 5 0.017% 99.976% ( 6600, 9900 ] 7 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3717.7429 StdDev: 2609.58 Min: 214 Median: 3650.0000 Max: 8246 Percentiles: P50: 3650.00 P75: 5696.43 P99: 8246.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 3 8.571% 20.000% ## ( 870, 1300 ] 2 5.714% 25.714% # ( 1300, 1900 ] 4 11.429% 37.143% ## ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 1 2.857% 51.429% # ( 4400, 6600 ] 14 40.000% 91.429% ######## ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 12.9 total, 3.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 306.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.157 H:M:S, 16.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 254.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.172 H:M:S, 30.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-15:49:48 ... thread 0: (1000000,5000000) ops and (257843.2,302571.5) ops/second in (3.878326,16.525022) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 2.52 GB 12.6 3.2 0.0 3.2 7.9 4.7 0.0 1.7 127.0 312.4 25.80 24.09 81 0.319 3326K 3499 0.0 0.0 L1 15/15 1.71 GB 0.0 2.0 2.0 0.1 2.0 2.0 0.2 1.0 235.4 233.7 8.84 8.57 2 4.418 2111K 14K 0.0 0.0 L2 2/0 55.57 MB 0.6 0.1 0.1 0.1 0.1 0.1 0.5 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 54/0 986.83 MB 1.0 0.5 0.4 0.1 0.5 0.4 0.1 1.3 192.5 192.4 2.57 2.14 2 1.286 502K 371 0.0 0.0 L4 136/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/30 100.79 GB 0.0 5.8 2.4 3.4 10.5 7.1 0.9 2.2 158.5 284.9 37.72 35.29 86 0.439 6068K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 2.4 3.4 10.5 7.1 0.8 2.2 158.5 284.9 37.72 35.29 86 0.439 6068K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 2.4 3.4 5.8 2.4 0.0 0.0 246.7 245.9 24.23 23.30 17 1.425 6068K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.8 13.49 11.98 69 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.7 total, 16.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.49 GB write, 642.14 MB/s write, 5.84 GB read, 357.14 MB/s read, 37.7 seconds Interval compaction: 10.49 GB write, 650.23 MB/s write, 5.84 GB read, 361.64 MB/s read, 37.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 16, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1469505 Average: 2.2165 StdDev: 13.11 Min: 0 Median: 1.4870 Max: 7842 Percentiles: P50: 1.49 P75: 1.86 P99: 5.46 P99.9: 11.27 P99.99: 133.11 ------------------------------------------------------ [ 0, 1 ] 249895 17.005% 17.005% ### ( 1, 2 ] 995574 67.749% 84.754% ############## ( 2, 3 ] 154710 10.528% 95.282% ## ( 3, 4 ] 38524 2.622% 97.904% # ( 4, 6 ] 22142 1.507% 99.411% ( 6, 10 ] 6869 0.467% 99.878% ( 10, 15 ] 1273 0.087% 99.965% ( 15, 22 ] 132 0.009% 99.974% ( 22, 34 ] 23 0.002% 99.975% ( 34, 51 ] 12 0.001% 99.976% ( 51, 76 ] 6 0.000% 99.977% ( 76, 110 ] 118 0.008% 99.985% ( 110, 170 ] 213 0.014% 99.999% ( 170, 250 ] 87 0.006% 100.005% ( 250, 380 ] 54 0.004% 100.009% ( 380, 580 ] 60 0.004% 100.013% ( 580, 870 ] 33 0.002% 100.015% ( 870, 1300 ] 23 0.002% 100.017% ( 1300, 1900 ] 11 0.001% 100.017% ( 1900, 2900 ] 11 0.001% 100.018% ( 2900, 4400 ] 4 0.000% 100.018% ( 6600, 9900 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 99362 Average: 3.0417 StdDev: 34.80 Min: 1 Median: 1.5921 Max: 7508 Percentiles: P50: 1.59 P75: 1.97 P99: 7.16 P99.9: 166.94 P99.99: 1103.65 ------------------------------------------------------ [ 0, 1 ] 11034 11.105% 11.105% ## ( 1, 2 ] 65275 65.694% 76.799% ############# ( 2, 3 ] 16075 16.178% 92.977% ### ( 3, 4 ] 3353 3.375% 96.352% # ( 4, 6 ] 2373 2.388% 98.740% ( 6, 10 ] 888 0.894% 99.634% ( 10, 15 ] 118 0.119% 99.752% ( 15, 22 ] 10 0.010% 99.762% ( 22, 34 ] 5 0.005% 99.768% ( 76, 110 ] 69 0.069% 99.837% ( 110, 170 ] 66 0.066% 99.903% ( 170, 250 ] 23 0.023% 99.927% ( 250, 380 ] 18 0.018% 99.945% ( 380, 580 ] 25 0.025% 99.970% ( 580, 870 ] 13 0.013% 99.983% ( 870, 1300 ] 13 0.013% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31758 Average: 1.7645 StdDev: 5.41 Min: 1 Median: 1.2470 Max: 885 Percentiles: P50: 1.25 P75: 1.66 P99: 3.55 P99.9: 9.38 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 11125 35.031% 35.031% ####### ( 1, 2 ] 19250 60.615% 95.645% ############ ( 2, 3 ] 914 2.878% 98.523% # ( 3, 4 ] 275 0.866% 99.389% ( 4, 6 ] 109 0.343% 99.732% ( 6, 10 ] 63 0.198% 99.931% ( 10, 15 ] 19 0.060% 99.991% ( 15, 22 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28926 Average: 6.7734 StdDev: 152.91 Min: 1 Median: 1.6745 Max: 8643 Percentiles: P50: 1.67 P75: 2.22 P99: 7.30 P99.9: 880.61 P99.99: 8536.35 ------------------------------------------------------ [ 0, 1 ] 2169 7.498% 7.498% # ( 1, 2 ] 18228 63.016% 70.514% ############# ( 2, 3 ] 6006 20.763% 91.278% #### ( 3, 4 ] 1276 4.411% 95.689% # ( 4, 6 ] 892 3.084% 98.773% # ( 6, 10 ] 203 0.702% 99.475% ( 10, 15 ] 77 0.266% 99.741% ( 15, 22 ] 15 0.052% 99.793% ( 22, 34 ] 2 0.007% 99.799% ( 34, 51 ] 8 0.028% 99.827% ( 51, 76 ] 1 0.003% 99.831% ( 76, 110 ] 1 0.003% 99.834% ( 110, 170 ] 3 0.010% 99.844% ( 170, 250 ] 3 0.010% 99.855% ( 250, 380 ] 5 0.017% 99.872% ( 380, 580 ] 5 0.017% 99.889% ( 580, 870 ] 3 0.010% 99.900% ( 870, 1300 ] 3 0.010% 99.910% ( 1300, 1900 ] 4 0.014% 99.924% ( 1900, 2900 ] 7 0.024% 99.948% ( 2900, 4400 ] 3 0.010% 99.959% ( 4400, 6600 ] 5 0.017% 99.976% ( 6600, 9900 ] 7 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 3717.7429 StdDev: 2609.58 Min: 214 Median: 3650.0000 Max: 8246 Percentiles: P50: 3650.00 P75: 5696.43 P99: 8246.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 3 8.571% 20.000% ## ( 870, 1300 ] 2 5.714% 25.714% # ( 1300, 1900 ] 4 11.429% 37.143% ## ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 1 2.857% 51.429% # ( 4400, 6600 ] 14 40.000% 91.429% ######## ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 16.7 total, 3.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 294.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.380 H:M:S, 20.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.223 H:M:S, 31.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-15:50:04 ... thread 0: (1000000,6000000) ops and (61568.4,183110.3) ops/second in (16.242110,32.767132) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 1.48 GB 0.0 4.5 0.0 4.5 10.2 5.7 0.0 1.8 135.9 308.8 33.85 31.68 103 0.329 4669K 4818 0.0 0.0 L1 12/11 1.23 GB 0.0 5.8 4.1 1.8 5.8 4.0 0.2 1.4 226.8 224.0 26.32 24.87 3 8.774 6062K 72K 0.0 0.0 L2 13/8 1.44 GB 6.4 0.1 0.1 0.1 0.1 0.1 3.0 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 63/39 2.10 GB 1.3 0.5 0.4 0.1 0.5 0.4 1.2 1.3 192.5 192.4 2.57 2.14 2 1.286 502K 371 0.0 0.0 L4 136/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1276/66 101.78 GB 0.0 10.9 4.5 6.4 16.6 10.1 4.5 2.9 176.9 268.3 63.25 59.18 109 0.580 11M 78K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.9 4.5 6.4 16.6 10.1 4.4 2.9 176.9 268.3 63.25 59.18 109 0.580 11M 78K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.9 4.5 6.4 10.9 4.4 0.0 0.0 239.7 238.0 46.69 44.49 23 2.030 11M 78K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.7 16.57 14.69 86 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.0 total, 32.8 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.57 GB write, 514.62 MB/s write, 10.93 GB read, 339.33 MB/s read, 63.3 seconds Interval compaction: 16.57 GB write, 517.89 MB/s write, 10.93 GB read, 341.49 MB/s read, 63.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 16, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2269452 Average: 2.4587 StdDev: 14.70 Min: 0 Median: 1.4751 Max: 7842 Percentiles: P50: 1.48 P75: 1.85 P99: 5.73 P99.9: 121.64 P99.99: 287.10 ------------------------------------------------------ [ 0, 1 ] 408258 17.989% 17.989% #### ( 1, 2 ] 1529061 67.376% 85.365% ############# ( 2, 3 ] 220617 9.721% 95.086% ## ( 3, 4 ] 57913 2.552% 97.638% # ( 4, 6 ] 35824 1.579% 99.217% ( 6, 10 ] 10912 0.481% 99.697% ( 10, 15 ] 1933 0.085% 99.783% ( 15, 22 ] 317 0.014% 99.797% ( 22, 34 ] 29 0.001% 99.798% ( 34, 51 ] 15 0.001% 99.798% ( 51, 76 ] 7 0.000% 99.799% ( 76, 110 ] 1897 0.084% 99.882% ( 110, 170 ] 2060 0.091% 99.973% ( 170, 250 ] 313 0.014% 99.987% ( 250, 380 ] 242 0.011% 99.998% ( 380, 580 ] 244 0.011% 100.008% ( 580, 870 ] 114 0.005% 100.013% ( 870, 1300 ] 36 0.002% 100.015% ( 1300, 1900 ] 13 0.001% 100.016% ( 1900, 2900 ] 14 0.001% 100.016% ( 2900, 4400 ] 9 0.000% 100.017% ( 6600, 9900 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 512314 Average: 2.6906 StdDev: 22.51 Min: 1 Median: 1.4109 Max: 7508 Percentiles: P50: 1.41 P75: 1.80 P99: 7.39 P99.9: 152.19 P99.99: 1004.56 ------------------------------------------------------ [ 0, 1 ] 122564 23.924% 23.924% ##### ( 1, 2 ] 325155 63.468% 87.392% ############# ( 2, 3 ] 36136 7.053% 94.445% # ( 3, 4 ] 12246 2.390% 96.835% ( 4, 6 ] 9688 1.891% 98.726% ( 6, 10 ] 4041 0.789% 99.515% ( 10, 15 ] 451 0.088% 99.603% ( 15, 22 ] 164 0.032% 99.635% ( 22, 34 ] 8 0.002% 99.637% ( 51, 76 ] 3 0.001% 99.637% ( 76, 110 ] 891 0.174% 99.811% ( 110, 170 ] 648 0.126% 99.938% ( 170, 250 ] 101 0.020% 99.957% ( 250, 380 ] 66 0.013% 99.970% ( 380, 580 ] 56 0.011% 99.981% ( 580, 870 ] 32 0.006% 99.988% ( 870, 1300 ] 44 0.009% 99.996% ( 1300, 1900 ] 13 0.003% 99.999% ( 1900, 2900 ] 5 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31759 Average: 1.7753 StdDev: 5.74 Min: 1 Median: 1.2470 Max: 885 Percentiles: P50: 1.25 P75: 1.66 P99: 3.55 P99.9: 9.44 P99.99: 20.77 ------------------------------------------------------ [ 0, 1 ] 11125 35.029% 35.029% ####### ( 1, 2 ] 19250 60.613% 95.642% ############ ( 2, 3 ] 914 2.878% 98.520% # ( 3, 4 ] 275 0.866% 99.386% ( 4, 6 ] 109 0.343% 99.729% ( 6, 10 ] 63 0.198% 99.928% ( 10, 15 ] 19 0.060% 99.987% ( 15, 22 ] 1 0.003% 99.991% ( 250, 380 ] 2 0.006% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 30402 Average: 11.8858 StdDev: 159.88 Min: 1 Median: 1.7013 Max: 8643 Percentiles: P50: 1.70 P75: 2.32 P99: 262.74 P99.9: 1201.68 P99.99: 5262.31 ------------------------------------------------------ [ 0, 1 ] 2175 7.154% 7.154% # ( 1, 2 ] 18573 61.091% 68.246% ############ ( 2, 3 ] 6457 21.239% 89.484% #### ( 3, 4 ] 1392 4.579% 94.063% # ( 4, 6 ] 1020 3.355% 97.418% # ( 6, 10 ] 251 0.826% 98.244% ( 10, 15 ] 93 0.306% 98.549% ( 15, 22 ] 16 0.053% 98.602% ( 22, 34 ] 3 0.010% 98.612% ( 34, 51 ] 9 0.030% 98.642% ( 51, 76 ] 1 0.003% 98.645% ( 76, 110 ] 1 0.003% 98.648% ( 110, 170 ] 22 0.072% 98.720% ( 170, 250 ] 75 0.247% 98.967% ( 250, 380 ] 112 0.368% 99.336% ( 380, 580 ] 104 0.342% 99.678% ( 580, 870 ] 47 0.155% 99.832% ( 870, 1300 ] 28 0.092% 99.924% ( 1300, 1900 ] 7 0.023% 99.947% ( 1900, 2900 ] 9 0.030% 99.977% ( 2900, 4400 ] 3 0.010% 99.987% ( 4400, 6600 ] 5 0.016% 100.003% ( 6600, 9900 ] 7 0.023% 100.026% ** Level 4 read latency histogram (micros): Count: 35 Average: 3717.7429 StdDev: 2609.58 Min: 214 Median: 3650.0000 Max: 8246 Percentiles: P50: 3650.00 P75: 5696.43 P99: 8246.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 3 8.571% 20.000% ## ( 870, 1300 ] 2 5.714% 25.714% # ( 1300, 1900 ] 4 11.429% 37.143% ## ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 1 2.857% 51.429% # ( 4400, 6600 ] 14 40.000% 91.429% ######## ( 6600, 9900 ] 3 8.571% 100.000% ## ** DB Stats ** Uptime(secs): 33.0 total, 16.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 179.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.349 H:M:S, 49.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 60.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.969 H:M:S, 79.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 0 2024/11/17-15:50:09 ... thread 0: (1000000,7000000) ops and (215744.1,187154.5) ops/second in (4.635120,37.402252) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.34 GB 56.6 4.9 0.0 4.9 11.4 6.6 0.0 1.7 125.3 294.9 39.72 35.51 115 0.345 5053K 5342 0.0 0.0 L1 12/11 1.23 GB 0.0 5.8 4.1 1.8 5.8 4.0 0.2 1.4 226.8 224.0 26.32 24.87 3 8.774 6062K 72K 0.0 0.0 L2 1/1 919.57 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.0 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 25/9 1.69 GB 1.0 2.2 1.8 0.4 2.2 1.8 1.2 1.2 133.7 133.5 17.22 10.61 14 1.230 2208K 1034 0.0 0.0 L4 165/0 9.53 GB 1.0 1.2 1.1 0.1 1.2 1.1 0.8 1.1 131.8 131.5 9.66 6.01 14 0.690 1293K 3388 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1287/33 102.63 GB 0.0 14.3 7.1 7.2 20.8 13.6 7.2 3.2 156.8 228.0 93.43 77.49 147 0.636 14M 82K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.3 7.1 7.2 20.8 13.6 7.1 3.2 156.8 228.0 93.43 77.49 147 0.636 14M 82K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.3 7.1 7.2 14.2 7.0 0.0 0.0 201.6 200.5 72.65 60.46 50 1.453 14M 82K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 324.4 20.78 17.03 97 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.6 total, 37.4 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.80 GB write, 566.41 MB/s write, 14.31 GB read, 389.49 MB/s read, 93.4 seconds Interval compaction: 20.80 GB write, 569.57 MB/s write, 14.31 GB read, 391.66 MB/s read, 93.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 48, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2586328 Average: 2.7843 StdDev: 28.97 Min: 0 Median: 1.5174 Max: 8021 Percentiles: P50: 1.52 P75: 1.90 P99: 5.99 P99.9: 128.38 P99.99: 456.16 ------------------------------------------------------ [ 0, 1 ] 416526 16.105% 16.105% ### ( 1, 2 ] 1694339 65.511% 81.616% ############# ( 2, 3 ] 302189 11.684% 93.300% ## ( 3, 4 ] 84545 3.269% 96.569% # ( 4, 6 ] 63047 2.438% 99.007% ( 6, 10 ] 17072 0.660% 99.667% ( 10, 15 ] 2949 0.114% 99.781% ( 15, 22 ] 435 0.017% 99.798% ( 22, 34 ] 37 0.001% 99.799% ( 34, 51 ] 18 0.001% 99.800% ( 51, 76 ] 9 0.000% 99.800% ( 76, 110 ] 1927 0.075% 99.875% ( 110, 170 ] 2121 0.082% 99.957% ( 170, 250 ] 367 0.014% 99.971% ( 250, 380 ] 342 0.013% 99.984% ( 380, 580 ] 387 0.015% 99.999% ( 580, 870 ] 231 0.009% 100.008% ( 870, 1300 ] 135 0.005% 100.013% ( 1300, 1900 ] 49 0.002% 100.015% ( 1900, 2900 ] 40 0.002% 100.017% ( 2900, 4400 ] 72 0.003% 100.020% ( 4400, 6600 ] 12 0.000% 100.020% ( 6600, 9900 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1002424 Average: 5.2338 StdDev: 86.94 Min: 1 Median: 1.7061 Max: 13340 Percentiles: P50: 1.71 P75: 2.50 P99: 9.00 P99.9: 139.74 P99.99: 551.12 ------------------------------------------------------ [ 0, 1 ] 125562 12.526% 12.526% ### ( 1, 2 ] 532027 53.074% 65.600% ########### ( 2, 3 ] 188916 18.846% 84.446% #### ( 3, 4 ] 65687 6.553% 90.999% # ( 4, 6 ] 68400 6.823% 97.822% # ( 6, 10 ] 15753 1.571% 99.394% ( 10, 15 ] 3280 0.327% 99.721% ( 15, 22 ] 478 0.048% 99.768% ( 22, 34 ] 41 0.004% 99.773% ( 34, 51 ] 13 0.001% 99.774% ( 51, 76 ] 19 0.002% 99.776% ( 76, 110 ] 908 0.091% 99.866% ( 110, 170 ] 683 0.068% 99.934% ( 170, 250 ] 180 0.018% 99.952% ( 250, 380 ] 163 0.016% 99.969% ( 380, 580 ] 251 0.025% 99.994% ( 580, 870 ] 273 0.027% 100.021% ( 870, 1300 ] 218 0.022% 100.043% ( 1300, 1900 ] 154 0.015% 100.058% ( 1900, 2900 ] 172 0.017% 100.075% ( 2900, 4400 ] 212 0.021% 100.096% ( 4400, 6600 ] 62 0.006% 100.103% ( 6600, 9900 ] 19 0.002% 100.104% ( 9900, 14000 ] 2 0.000% 100.105% ** Level 2 read latency histogram (micros): Count: 31978 Average: 4.8352 StdDev: 83.38 Min: 1 Median: 1.2523 Max: 4538 Percentiles: P50: 1.25 P75: 1.67 P99: 3.89 P99.9: 1135.34 P99.99: 4070.33 ------------------------------------------------------ [ 0, 1 ] 11125 34.790% 34.790% ####### ( 1, 2 ] 19279 60.288% 95.078% ############ ( 2, 3 ] 993 3.105% 98.183% # ( 3, 4 ] 292 0.913% 99.096% ( 4, 6 ] 123 0.385% 99.481% ( 6, 10 ] 69 0.216% 99.697% ( 10, 15 ] 19 0.059% 99.756% ( 15, 22 ] 1 0.003% 99.759% ( 110, 170 ] 2 0.006% 99.765% ( 170, 250 ] 7 0.022% 99.787% ( 250, 380 ] 12 0.038% 99.825% ( 380, 580 ] 7 0.022% 99.847% ( 580, 870 ] 9 0.028% 99.875% ( 870, 1300 ] 13 0.041% 99.916% ( 1300, 1900 ] 8 0.025% 99.941% ( 1900, 2900 ] 8 0.025% 99.966% ( 2900, 4400 ] 10 0.031% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 498228 Average: 12.6037 StdDev: 156.37 Min: 1 Median: 2.1200 Max: 8643 Percentiles: P50: 2.12 P75: 2.97 P99: 11.42 P99.9: 1176.84 P99.99: 1886.53 ------------------------------------------------------ [ 0, 1 ] 6521 1.309% 1.309% ( 1, 2 ] 225109 45.182% 46.491% ######### ( 2, 3 ] 145709 29.245% 75.736% ###### ( 3, 4 ] 51668 10.370% 86.107% ## ( 4, 6 ] 53602 10.759% 96.865% ## ( 6, 10 ] 10025 2.012% 98.877% ( 10, 15 ] 2151 0.432% 99.309% ( 15, 22 ] 229 0.046% 99.355% ( 22, 34 ] 18 0.004% 99.359% ( 34, 51 ] 22 0.004% 99.363% ( 51, 76 ] 4 0.001% 99.364% ( 76, 110 ] 24 0.005% 99.369% ( 110, 170 ] 143 0.029% 99.397% ( 170, 250 ] 280 0.056% 99.453% ( 250, 380 ] 463 0.093% 99.546% ( 380, 580 ] 650 0.130% 99.677% ( 580, 870 ] 735 0.148% 99.824% ( 870, 1300 ] 528 0.106% 99.930% ( 1300, 1900 ] 304 0.061% 99.991% ( 1900, 2900 ] 279 0.056% 100.047% ( 2900, 4400 ] 393 0.079% 100.126% ( 4400, 6600 ] 96 0.019% 100.146% ( 6600, 9900 ] 23 0.005% 100.150% ** Level 4 read latency histogram (micros): Count: 230 Average: 739.3348 StdDev: 1745.80 Min: 1 Median: 2.6923 Max: 8246 Percentiles: P50: 2.69 P75: 228.82 P99: 7370.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ [ 0, 1 ] 27 11.739% 11.739% ## ( 1, 2 ] 70 30.435% 42.174% ###### ( 2, 3 ] 26 11.304% 53.478% ## ( 3, 4 ] 7 3.043% 56.522% # ( 4, 6 ] 4 1.739% 58.261% ( 6, 10 ] 11 4.783% 63.043% # ( 10, 15 ] 3 1.304% 64.348% ( 15, 22 ] 1 0.435% 64.783% ( 22, 34 ] 4 1.739% 66.522% ( 34, 51 ] 1 0.435% 66.957% ( 76, 110 ] 2 0.870% 67.826% ( 110, 170 ] 4 1.739% 69.565% ( 170, 250 ] 17 7.391% 76.957% # ( 250, 380 ] 2 0.870% 77.826% ( 380, 580 ] 5 2.174% 80.000% ( 580, 870 ] 5 2.174% 82.174% ( 870, 1300 ] 7 3.043% 85.217% # ( 1300, 1900 ] 5 2.174% 87.391% ( 1900, 2900 ] 6 2.609% 90.000% # ( 2900, 4400 ] 4 1.739% 91.739% ( 4400, 6600 ] 16 6.957% 98.696% # ( 6600, 9900 ] 3 1.304% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1847.6333 StdDev: 1802.69 Min: 101 Median: 1085.0000 Max: 7505 Percentiles: P50: 1085.00 P75: 3320.00 P99: 7505.00 P99.9: 7505.00 P99.99: 7505.00 ------------------------------------------------------ ( 76, 110 ] 1 0.833% 0.833% ( 110, 170 ] 11 9.167% 10.000% ## ( 170, 250 ] 11 9.167% 19.167% ## ( 250, 380 ] 12 10.000% 29.167% ## ( 380, 580 ] 8 6.667% 35.833% # ( 580, 870 ] 13 10.833% 46.667% ## ( 870, 1300 ] 8 6.667% 53.333% # ( 1300, 1900 ] 8 6.667% 60.000% # ( 1900, 2900 ] 11 9.167% 69.167% ## ( 2900, 4400 ] 25 20.833% 90.000% #### ( 4400, 6600 ] 10 8.333% 98.333% ## ( 6600, 9900 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 37.6 total, 4.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 183.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.134 H:M:S, 48.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 212.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.785 H:M:S, 38.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-15:50:13 ... thread 0: (1000000,8000000) ops and (289244.8,195792.8) ops/second in (3.457279,40.859531) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.38 GB 163.6 6.0 0.0 6.0 13.7 7.6 0.0 1.8 130.0 294.3 47.49 42.79 133 0.357 6268K 6651 0.0 0.0 L1 12/11 1.23 GB 0.0 5.8 4.1 1.8 5.8 4.0 0.2 1.4 226.8 224.0 26.32 24.87 3 8.774 6062K 72K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.0 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 15/0 982.46 MB 1.0 3.0 1.8 1.2 3.0 1.8 1.2 1.6 138.6 138.3 21.98 13.68 15 1.465 2962K 1945 0.0 0.0 L4 170/0 9.65 GB 1.0 1.2 1.1 0.1 1.2 1.1 1.6 1.1 131.8 131.5 9.66 6.01 14 0.690 1293K 3388 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/23 103.68 GB 0.0 16.2 7.1 9.1 23.7 14.6 8.6 3.1 156.6 229.4 105.96 87.84 166 0.638 16M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.2 7.1 9.1 23.7 14.6 8.5 3.1 156.6 229.4 105.96 87.84 166 0.638 16M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.2 7.1 9.1 16.1 7.0 0.0 0.0 202.0 201.0 82.11 68.11 55 1.493 16M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 327.5 23.85 19.73 111 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.1 total, 40.9 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.74 GB write, 591.96 MB/s write, 16.20 GB read, 403.92 MB/s read, 106.0 seconds Interval compaction: 23.74 GB write, 594.98 MB/s write, 16.20 GB read, 405.98 MB/s read, 106.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 58, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2978733 Average: 2.7282 StdDev: 27.17 Min: 0 Median: 1.5305 Max: 8021 Percentiles: P50: 1.53 P75: 1.91 P99: 5.98 P99.9: 113.94 P99.99: 370.65 ------------------------------------------------------ [ 0, 1 ] 452272 15.183% 15.183% ### ( 1, 2 ] 1954771 65.624% 80.808% ############# ( 2, 3 ] 369054 12.390% 93.197% ## ( 3, 4 ] 99459 3.339% 96.536% # ( 4, 6 ] 74196 2.491% 99.027% ( 6, 10 ] 20096 0.675% 99.702% ( 10, 15 ] 3292 0.111% 99.812% ( 15, 22 ] 478 0.016% 99.828% ( 22, 34 ] 41 0.001% 99.830% ( 34, 51 ] 19 0.001% 99.830% ( 51, 76 ] 12 0.000% 99.831% ( 76, 110 ] 1927 0.065% 99.895% ( 110, 170 ] 2123 0.071% 99.967% ( 170, 250 ] 376 0.013% 99.979% ( 250, 380 ] 346 0.012% 99.991% ( 380, 580 ] 393 0.013% 100.004% ( 580, 870 ] 237 0.008% 100.012% ( 870, 1300 ] 141 0.005% 100.017% ( 1300, 1900 ] 51 0.002% 100.018% ( 1900, 2900 ] 40 0.001% 100.020% ( 2900, 4400 ] 73 0.002% 100.022% ( 4400, 6600 ] 12 0.000% 100.023% ( 6600, 9900 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1091123 Average: 5.0323 StdDev: 83.38 Min: 1 Median: 1.7002 Max: 13340 Percentiles: P50: 1.70 P75: 2.46 P99: 8.95 P99.9: 140.11 P99.99: 548.46 ------------------------------------------------------ [ 0, 1 ] 131408 12.043% 12.043% ## ( 1, 2 ] 591518 54.212% 66.255% ########### ( 2, 3 ] 205345 18.820% 85.075% #### ( 3, 4 ] 68621 6.289% 91.364% # ( 4, 6 ] 70601 6.470% 97.834% # ( 6, 10 ] 17258 1.582% 99.416% ( 10, 15 ] 3374 0.309% 99.725% ( 15, 22 ] 483 0.044% 99.770% ( 22, 34 ] 42 0.004% 99.773% ( 34, 51 ] 13 0.001% 99.775% ( 51, 76 ] 19 0.002% 99.776% ( 76, 110 ] 970 0.089% 99.865% ( 110, 170 ] 759 0.070% 99.935% ( 170, 250 ] 200 0.018% 99.953% ( 250, 380 ] 179 0.016% 99.969% ( 380, 580 ] 267 0.024% 99.994% ( 580, 870 ] 276 0.025% 100.019% ( 870, 1300 ] 218 0.020% 100.039% ( 1300, 1900 ] 154 0.014% 100.053% ( 1900, 2900 ] 172 0.016% 100.069% ( 2900, 4400 ] 212 0.019% 100.089% ( 4400, 6600 ] 62 0.006% 100.094% ( 6600, 9900 ] 19 0.002% 100.096% ( 9900, 14000 ] 2 0.000% 100.096% ** Level 2 read latency histogram (micros): Count: 31986 Average: 4.8350 StdDev: 83.37 Min: 1 Median: 1.2525 Max: 4538 Percentiles: P50: 1.25 P75: 1.67 P99: 3.90 P99.9: 1135.08 P99.99: 4070.21 ------------------------------------------------------ [ 0, 1 ] 11125 34.781% 34.781% ####### ( 1, 2 ] 19280 60.276% 95.057% ############ ( 2, 3 ] 998 3.120% 98.177% # ( 3, 4 ] 293 0.916% 99.093% ( 4, 6 ] 123 0.385% 99.478% ( 6, 10 ] 69 0.216% 99.694% ( 10, 15 ] 20 0.063% 99.756% ( 15, 22 ] 1 0.003% 99.759% ( 110, 170 ] 2 0.006% 99.766% ( 170, 250 ] 7 0.022% 99.787% ( 250, 380 ] 12 0.038% 99.825% ( 380, 580 ] 7 0.022% 99.847% ( 580, 870 ] 9 0.028% 99.875% ( 870, 1300 ] 13 0.041% 99.916% ( 1300, 1900 ] 8 0.025% 99.941% ( 1900, 2900 ] 8 0.025% 99.966% ( 2900, 4400 ] 10 0.031% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 498288 Average: 12.6362 StdDev: 156.47 Min: 1 Median: 2.1200 Max: 8643 Percentiles: P50: 2.12 P75: 2.97 P99: 11.49 P99.9: 1180.73 P99.99: 1886.70 ------------------------------------------------------ [ 0, 1 ] 6537 1.312% 1.312% ( 1, 2 ] 225122 45.179% 46.491% ######### ( 2, 3 ] 145710 29.242% 75.733% ###### ( 3, 4 ] 51668 10.369% 86.102% ## ( 4, 6 ] 53602 10.757% 96.859% ## ( 6, 10 ] 10025 2.012% 98.871% ( 10, 15 ] 2151 0.432% 99.303% ( 15, 22 ] 229 0.046% 99.349% ( 22, 34 ] 18 0.004% 99.353% ( 34, 51 ] 22 0.004% 99.357% ( 51, 76 ] 4 0.001% 99.358% ( 76, 110 ] 27 0.005% 99.363% ( 110, 170 ] 145 0.029% 99.392% ( 170, 250 ] 291 0.058% 99.451% ( 250, 380 ] 464 0.093% 99.544% ( 380, 580 ] 654 0.131% 99.675% ( 580, 870 ] 737 0.148% 99.823% ( 870, 1300 ] 531 0.107% 99.930% ( 1300, 1900 ] 308 0.062% 99.991% ( 1900, 2900 ] 279 0.056% 100.047% ( 2900, 4400 ] 393 0.079% 100.126% ( 4400, 6600 ] 96 0.019% 100.145% ( 6600, 9900 ] 23 0.005% 100.150% ** Level 4 read latency histogram (micros): Count: 230 Average: 739.3348 StdDev: 1745.80 Min: 1 Median: 2.6923 Max: 8246 Percentiles: P50: 2.69 P75: 228.82 P99: 7370.00 P99.9: 8246.00 P99.99: 8246.00 ------------------------------------------------------ [ 0, 1 ] 27 11.739% 11.739% ## ( 1, 2 ] 70 30.435% 42.174% ###### ( 2, 3 ] 26 11.304% 53.478% ## ( 3, 4 ] 7 3.043% 56.522% # ( 4, 6 ] 4 1.739% 58.261% ( 6, 10 ] 11 4.783% 63.043% # ( 10, 15 ] 3 1.304% 64.348% ( 15, 22 ] 1 0.435% 64.783% ( 22, 34 ] 4 1.739% 66.522% ( 34, 51 ] 1 0.435% 66.957% ( 76, 110 ] 2 0.870% 67.826% ( 110, 170 ] 4 1.739% 69.565% ( 170, 250 ] 17 7.391% 76.957% # ( 250, 380 ] 2 0.870% 77.826% ( 380, 580 ] 5 2.174% 80.000% ( 580, 870 ] 5 2.174% 82.174% ( 870, 1300 ] 7 3.043% 85.217% # ( 1300, 1900 ] 5 2.174% 87.391% ( 1900, 2900 ] 6 2.609% 90.000% # ( 2900, 4400 ] 4 1.739% 91.739% ( 4400, 6600 ] 16 6.957% 98.696% # ( 6600, 9900 ] 3 1.304% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1609.9125 StdDev: 1691.77 Min: 94 Median: 849.2857 Max: 7505 Percentiles: P50: 849.29 P75: 2951.72 P99: 7260.00 P99.9: 7505.00 P99.99: 7505.00 ------------------------------------------------------ ( 76, 110 ] 7 4.375% 4.375% # ( 110, 170 ] 21 13.125% 17.500% ### ( 170, 250 ] 15 9.375% 26.875% ## ( 250, 380 ] 14 8.750% 35.625% ## ( 380, 580 ] 10 6.250% 41.875% # ( 580, 870 ] 14 8.750% 50.625% ## ( 870, 1300 ] 11 6.875% 57.500% # ( 1300, 1900 ] 10 6.250% 63.750% # ( 1900, 2900 ] 17 10.625% 74.375% ## ( 2900, 4400 ] 29 18.125% 92.500% #### ( 4400, 6600 ] 10 6.250% 98.750% # ( 6600, 9900 ] 2 1.250% 100.000% ** DB Stats ** Uptime(secs): 41.1 total, 3.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 191.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.979 H:M:S, 46.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.845 H:M:S, 24.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-15:50:20 ... thread 0: (1000000,9000000) ops and (130188.7,185411.5) ops/second in (7.681156,48.540687) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 2.82 GB 0.0 7.9 0.0 7.9 16.4 8.5 0.0 1.9 139.9 291.7 57.63 52.43 153 0.377 8186K 10K 0.0 0.0 L1 19/19 1.89 GB 0.0 8.5 5.5 3.0 8.4 5.4 0.2 1.5 216.9 214.4 40.27 36.99 4 10.068 7596K 72K 0.0 0.0 L2 2/0 99.52 MB 1.0 0.1 0.1 0.1 0.1 0.1 3.8 2.0 247.6 247.5 0.51 0.49 1 0.509 127K 41 0.0 0.0 L3 24/2 1.13 GB 0.9 3.9 2.1 1.7 3.8 2.1 1.6 1.8 147.2 146.7 26.82 17.83 21 1.277 3878K 11K 0.0 0.0 L4 170/7 9.79 GB 1.0 1.8 1.6 0.2 1.8 1.6 1.6 1.1 139.8 139.4 13.41 8.82 21 0.638 1904K 5770 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/38 104.56 GB 0.0 22.2 9.3 12.9 30.6 17.8 10.1 3.6 164.1 226.3 138.63 116.57 200 0.693 21M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.2 9.3 12.9 30.6 17.8 10.0 3.6 164.1 226.3 138.63 116.57 200 0.693 21M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.2 9.3 12.9 22.1 9.2 0.0 0.0 203.0 201.9 112.03 94.40 74 1.514 21M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 329.2 26.60 22.16 126 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.8 total, 48.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.64 GB write, 643.52 MB/s write, 22.21 GB read, 466.62 MB/s read, 138.6 seconds Interval compaction: 30.64 GB write, 646.28 MB/s write, 22.21 GB read, 468.62 MB/s read, 138.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 21, pending-compaction-bytes-stops: 0, total-delays: 49, total-stops: 58, interval: 107 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3536492 Average: 2.7267 StdDev: 25.75 Min: 0 Median: 1.5418 Max: 8021 Percentiles: P50: 1.54 P75: 1.92 P99: 5.99 P99.9: 114.20 P99.99: 397.27 ------------------------------------------------------ [ 0, 1 ] 512670 14.497% 14.497% ### ( 1, 2 ] 2317606 65.534% 80.031% ############# ( 2, 3 ] 455237 12.873% 92.903% ### ( 3, 4 ] 122975 3.477% 96.380% # ( 4, 6 ] 93288 2.638% 99.018% # ( 6, 10 ] 24309 0.687% 99.706% ( 10, 15 ] 3966 0.112% 99.818% ( 15, 22 ] 546 0.015% 99.833% ( 22, 34 ] 45 0.001% 99.835% ( 34, 51 ] 20 0.001% 99.835% ( 51, 76 ] 23 0.001% 99.836% ( 76, 110 ] 2104 0.059% 99.895% ( 110, 170 ] 2395 0.068% 99.963% ( 170, 250 ] 488 0.014% 99.977% ( 250, 380 ] 424 0.012% 99.989% ( 380, 580 ] 502 0.014% 100.003% ( 580, 870 ] 287 0.008% 100.011% ( 870, 1300 ] 166 0.005% 100.016% ( 1300, 1900 ] 54 0.002% 100.017% ( 1900, 2900 ] 45 0.001% 100.019% ( 2900, 4400 ] 75 0.002% 100.021% ( 4400, 6600 ] 12 0.000% 100.021% ( 6600, 9900 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1575633 Average: 4.8071 StdDev: 74.86 Min: 1 Median: 1.7317 Max: 13340 Percentiles: P50: 1.73 P75: 2.52 P99: 9.04 P99.9: 147.27 P99.99: 488.02 ------------------------------------------------------ [ 0, 1 ] 157662 10.006% 10.006% ## ( 1, 2 ] 861232 54.659% 64.666% ########### ( 2, 3 ] 312805 19.853% 84.518% #### ( 3, 4 ] 102376 6.497% 91.016% # ( 4, 6 ] 104180 6.612% 97.628% # ( 6, 10 ] 28418 1.804% 99.431% ( 10, 15 ] 4777 0.303% 99.735% ( 15, 22 ] 690 0.044% 99.778% ( 22, 34 ] 54 0.003% 99.782% ( 34, 51 ] 14 0.001% 99.783% ( 51, 76 ] 32 0.002% 99.785% ( 76, 110 ] 1163 0.074% 99.858% ( 110, 170 ] 1055 0.067% 99.925% ( 170, 250 ] 393 0.025% 99.950% ( 250, 380 ] 377 0.024% 99.974% ( 380, 580 ] 460 0.029% 100.003% ( 580, 870 ] 467 0.030% 100.033% ( 870, 1300 ] 345 0.022% 100.055% ( 1300, 1900 ] 201 0.013% 100.068% ( 1900, 2900 ] 196 0.012% 100.080% ( 2900, 4400 ] 230 0.015% 100.095% ( 4400, 6600 ] 66 0.004% 100.099% ( 6600, 9900 ] 25 0.002% 100.101% ( 9900, 14000 ] 2 0.000% 100.101% ** Level 2 read latency histogram (micros): Count: 31986 Average: 4.8350 StdDev: 83.37 Min: 1 Median: 1.2525 Max: 4538 Percentiles: P50: 1.25 P75: 1.67 P99: 3.90 P99.9: 1135.08 P99.99: 4070.21 ------------------------------------------------------ [ 0, 1 ] 11125 34.781% 34.781% ####### ( 1, 2 ] 19280 60.276% 95.057% ############ ( 2, 3 ] 998 3.120% 98.177% # ( 3, 4 ] 293 0.916% 99.093% ( 4, 6 ] 123 0.385% 99.478% ( 6, 10 ] 69 0.216% 99.694% ( 10, 15 ] 20 0.063% 99.756% ( 15, 22 ] 1 0.003% 99.759% ( 110, 170 ] 2 0.006% 99.766% ( 170, 250 ] 7 0.022% 99.787% ( 250, 380 ] 12 0.038% 99.825% ( 380, 580 ] 7 0.022% 99.847% ( 580, 870 ] 9 0.028% 99.875% ( 870, 1300 ] 13 0.041% 99.916% ( 1300, 1900 ] 8 0.025% 99.941% ( 1900, 2900 ] 8 0.025% 99.966% ( 2900, 4400 ] 10 0.031% 99.997% ( 4400, 6600 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 668094 Average: 10.8727 StdDev: 138.45 Min: 1 Median: 2.1696 Max: 8643 Percentiles: P50: 2.17 P75: 3.06 P99: 9.99 P99.9: 845.09 P99.99: 1260.24 ------------------------------------------------------ [ 0, 1 ] 7699 1.152% 1.152% ( 1, 2 ] 293191 43.885% 45.037% ######### ( 2, 3 ] 195525 29.266% 74.303% ###### ( 3, 4 ] 73246 10.963% 85.267% ## ( 4, 6 ] 77803 11.646% 96.912% ## ( 6, 10 ] 13998 2.095% 99.007% ( 10, 15 ] 2609 0.391% 99.398% ( 15, 22 ] 325 0.049% 99.446% ( 22, 34 ] 29 0.004% 99.451% ( 34, 51 ] 27 0.004% 99.455% ( 51, 76 ] 7 0.001% 99.456% ( 76, 110 ] 52 0.008% 99.464% ( 110, 170 ] 280 0.042% 99.506% ( 170, 250 ] 427 0.064% 99.570% ( 250, 380 ] 634 0.095% 99.664% ( 380, 580 ] 796 0.119% 99.784% ( 580, 870 ] 851 0.127% 99.911% ( 870, 1300 ] 582 0.087% 99.998% ( 1300, 1900 ] 329 0.049% 100.047% ( 1900, 2900 ] 283 0.042% 100.090% ( 2900, 4400 ] 409 0.061% 100.151% ( 4400, 6600 ] 103 0.015% 100.166% ( 6600, 9900 ] 23 0.003% 100.170% ** Level 4 read latency histogram (micros): Count: 15503 Average: 37.6673 StdDev: 349.57 Min: 0 Median: 2.4964 Max: 8246 Percentiles: P50: 2.50 P75: 3.75 P99: 749.85 P99.9: 5196.32 P99.99: 6254.80 ------------------------------------------------------ [ 0, 1 ] 69 0.445% 0.445% ( 1, 2 ] 5360 34.574% 35.019% ####### ( 2, 3 ] 4679 30.181% 65.200% ###### ( 3, 4 ] 2030 13.094% 78.295% ### ( 4, 6 ] 2386 15.391% 93.685% ### ( 6, 10 ] 471 3.038% 96.723% # ( 10, 15 ] 72 0.464% 97.188% ( 15, 22 ] 8 0.052% 97.239% ( 22, 34 ] 10 0.065% 97.304% ( 34, 51 ] 1 0.006% 97.310% ( 51, 76 ] 9 0.058% 97.368% ( 76, 110 ] 8 0.052% 97.420% ( 110, 170 ] 35 0.226% 97.646% ( 170, 250 ] 61 0.393% 98.039% ( 250, 380 ] 54 0.348% 98.387% ( 380, 580 ] 61 0.393% 98.781% ( 580, 870 ] 58 0.374% 99.155% ( 870, 1300 ] 43 0.277% 99.432% ( 1300, 1900 ] 19 0.123% 99.555% ( 1900, 2900 ] 19 0.123% 99.677% ( 2900, 4400 ] 24 0.155% 99.832% ( 4400, 6600 ] 29 0.187% 100.019% ( 6600, 9900 ] 9 0.058% 100.077% ** Level 5 read latency histogram (micros): Count: 180 Average: 1585.4500 StdDev: 1694.32 Min: 94 Median: 807.8571 Max: 7505 Percentiles: P50: 807.86 P75: 2847.37 P99: 6930.00 P99.9: 7505.00 P99.99: 7505.00 ------------------------------------------------------ ( 76, 110 ] 7 3.889% 3.889% # ( 110, 170 ] 22 12.222% 16.111% ## ( 170, 250 ] 17 9.444% 25.556% ## ( 250, 380 ] 20 11.111% 36.667% ## ( 380, 580 ] 13 7.222% 43.889% # ( 580, 870 ] 14 7.778% 51.667% ## ( 870, 1300 ] 13 7.222% 58.889% # ( 1300, 1900 ] 11 6.111% 65.000% # ( 1900, 2900 ] 19 10.556% 75.556% ## ( 2900, 4400 ] 30 16.667% 92.222% ### ( 4400, 6600 ] 12 6.667% 98.889% # ( 6600, 9900 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 48.8 total, 7.7 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 181.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.002 H:M:S, 49.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 128.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.023 H:M:S, 65.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.328 micros/op 158018 ops/sec 60.025 seconds 9484999 operations; 153.1 MB/s Microseconds per write: Count: 9484999 Average: 6.3284 StdDev: 372.04 Min: 0 Median: 1.7341 Max: 644288 Percentiles: P50: 1.73 P75: 2.74 P99: 9.32 P99.9: 1186.84 P99.99: 2685.13 ------------------------------------------------------ [ 0, 1 ] 1294507 13.648% 13.648% ### ( 1, 2 ] 4696817 49.518% 63.166% ########## ( 2, 3 ] 1509136 15.911% 79.077% ### ( 3, 4 ] 1300275 13.709% 92.786% ### ( 4, 6 ] 499723 5.269% 98.054% # ( 6, 10 ] 108145 1.140% 99.195% ( 10, 15 ] 33016 0.348% 99.543% ( 15, 22 ] 7741 0.082% 99.624% ( 22, 34 ] 1298 0.014% 99.638% ( 34, 51 ] 164 0.002% 99.640% ( 51, 76 ] 20 0.000% 99.640% ( 76, 110 ] 6876 0.072% 99.712% ( 110, 170 ] 2366 0.025% 99.737% ( 170, 250 ] 246 0.003% 99.740% ( 250, 380 ] 142 0.001% 99.741% ( 380, 580 ] 20 0.000% 99.742% ( 580, 870 ] 18 0.000% 99.742% ( 870, 1300 ] 20363 0.215% 99.956% ( 1300, 1900 ] 37 0.000% 99.957% ( 1900, 2900 ] 4000 0.042% 99.999% ( 2900, 4400 ] 57 0.001% 100.000% ( 4400, 6600 ] 8 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 3 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 8 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 179159 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9484999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9788518968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 501 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34038081 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27748216262 rocksdb.compact.write.bytes COUNT : 27574634952 rocksdb.flush.write.bytes COUNT : 9776586540 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 51 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 284 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9697632256 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3657728 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27835901521 rocksdb.non.last.level.read.count COUNT : 6725120 rocksdb.block.checksum.compute.count COUNT : 6724169 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.370358 P95 : 3.907670 P99 : 7.910925 P100 : 644285.000000 COUNT : 9484999 SUM : 55560324 rocksdb.compaction.times.micros P50 : 1051250.000000 P95 : 4520000.000000 P99 : 15760000.000000 P100 : 17487913.000000 COUNT : 78 SUM : 116650131 rocksdb.compaction.times.cpu_micros P50 : 843888.888889 P95 : 3670000.000000 P99 : 15760000.000000 P100 : 16298377.000000 COUNT : 78 SUM : 98333172 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 687.820513 P95 : 1217.071429 P99 : 66500.000000 P100 : 97142.000000 COUNT : 134 SUM : 281221 rocksdb.compaction.outfile.sync.micros P50 : 1021.764706 P95 : 51666.666667 P99 : 120200.000000 P100 : 166943.000000 COUNT : 332 SUM : 3021028 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.500000 P95 : 2258.333333 P99 : 4105.625000 P100 : 10480.000000 COUNT : 257 SUM : 108996 rocksdb.table.open.io.micros P50 : 1363.934426 P95 : 9449.000000 P99 : 20217.777778 P100 : 22540.000000 COUNT : 501 SUM : 1250428 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.644379 P95 : 7.455259 P99 : 10.295414 P100 : 13344.000000 COUNT : 6722854 SUM : 40914622 rocksdb.read.block.get.micros P50 : 470.756303 P95 : 4135.869565 P99 : 7494.000000 P100 : 10426.000000 COUNT : 1002 SUM : 988264 rocksdb.write.raw.block.micros P50 : 0.512345 P95 : 0.973455 P99 : 2.847801 P100 : 21271.000000 COUNT : 9046722 SUM : 18024579 rocksdb.numfiles.in.singlecompaction P50 : 3.135714 P95 : 5.150000 P99 : 25.780000 P100 : 29.000000 COUNT : 137 SUM : 502 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561266 P95 : 1148.892017 P99 : 2352.573363 P100 : 644095.000000 COUNT : 224559 SUM : 34056921 rocksdb.sst.read.micros P50 : 1.605260 P95 : 4.438545 P99 : 8.090881 P100 : 13340.000000 COUNT : 6725456 SUM : 27545384 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9484999 SUM : 9788518968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210404.040404 P95 : 372416.666667 P99 : 665700.000000 P100 : 784163.000000 COUNT : 134 SUM : 28222730 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 315 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0