[2024-11-06 22:37:26.674639] Starting SPDK v25.01-pre git sha1 d1c46ed8e / DPDK 24.03.0 initialization... [2024-11-06 22:37:26.674905] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3597802 ] Set seed to 1730929046667837 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-06 22:37:26.798436] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-06 22:37:26.902462] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-06 22:37:26.902502] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3597802' to capture a snapshot of events at runtime. [2024-11-06 22:37:26.902512] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-06 22:37:26.902522] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-06 22:37:26.902530] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3597802 for offline analysis/debug. [2024-11-06 22:37:26.903911] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 6 22:37:35 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/06-22:37:38 ... thread 0: (1000000,1000000) ops and (357204.5,357204.5) ops/second in (2.799517,2.799517) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.00 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 350.5 2.34 2.08 12 0.195 0 0 0.0 0.0 L2 3/2 251.74 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 257.0 256.8 1.47 1.43 2 0.735 383K 217 0.0 0.0 L3 12/0 993.41 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1176/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.3 314.3 3.81 3.51 14 0.272 383K 217 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 99.3 314.3 3.81 3.51 14 0.272 383K 217 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 257.0 256.8 1.47 1.43 2 0.735 383K 217 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 350.5 2.34 2.08 12 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 398.62 MB/s write, 0.37 GB read, 125.89 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 427.24 MB/s write, 0.37 GB read, 134.93 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104916 Average: 1.9819 StdDev: 20.13 Min: 0 Median: 1.2874 Max: 3453 Percentiles: P50: 1.29 P75: 1.70 P99: 3.96 P99.9: 9.64 P99.99: 480.55 ------------------------------------------------------ [ 0, 1 ] 33997 32.404% 32.404% ###### ( 1, 2 ] 64234 61.224% 93.628% ############ ( 2, 3 ] 4072 3.881% 97.509% # ( 3, 4 ] 1624 1.548% 99.057% ( 4, 6 ] 682 0.650% 99.707% ( 6, 10 ] 223 0.213% 99.920% ( 10, 15 ] 53 0.051% 99.970% ( 15, 22 ] 8 0.008% 99.978% ( 110, 170 ] 7 0.007% 99.985% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 3 0.003% 99.990% ( 380, 580 ] 3 0.003% 99.992% ( 580, 870 ] 3 0.003% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 3 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 49889 Average: 2.2125 StdDev: 30.60 Min: 1 Median: 1.3326 Max: 4851 Percentiles: P50: 1.33 P75: 1.72 P99: 4.92 P99.9: 9.95 P99.99: 1128.95 ------------------------------------------------------ [ 0, 1 ] 14338 28.740% 28.740% ###### ( 1, 2 ] 31893 63.928% 92.668% ############# ( 2, 3 ] 2170 4.350% 97.017% # ( 3, 4 ] 732 1.467% 98.485% ( 4, 6 ] 562 1.127% 99.611% ( 6, 10 ] 147 0.295% 99.906% ( 10, 15 ] 28 0.056% 99.962% ( 15, 22 ] 3 0.006% 99.968% ( 22, 34 ] 1 0.002% 99.970% ( 51, 76 ] 1 0.002% 99.972% ( 170, 250 ] 2 0.004% 99.976% ( 250, 380 ] 2 0.004% 99.980% ( 380, 580 ] 1 0.002% 99.982% ( 580, 870 ] 2 0.004% 99.986% ( 870, 1300 ] 5 0.010% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 50 Average: 3213.5800 StdDev: 2372.97 Min: 212 Median: 2525.0000 Max: 8389 Percentiles: P50: 2525.00 P75: 5087.50 P99: 8389.00 P99.9: 8389.00 P99.99: 8389.00 ------------------------------------------------------ ( 170, 250 ] 1 2.000% 2.000% ( 380, 580 ] 1 2.000% 4.000% ( 580, 870 ] 3 6.000% 10.000% # ( 870, 1300 ] 9 18.000% 28.000% #### ( 1300, 1900 ] 6 12.000% 40.000% ## ( 1900, 2900 ] 8 16.000% 56.000% ### ( 2900, 4400 ] 7 14.000% 70.000% ### ( 4400, 6600 ] 8 16.000% 86.000% ### ( 6600, 9900 ] 7 14.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 20 Average: 3576.5000 StdDev: 2915.78 Min: 178 Median: 2400.0000 Max: 9808 Percentiles: P50: 2400.00 P75: 6600.00 P99: 9768.00 P99.9: 9808.00 P99.99: 9808.00 ------------------------------------------------------ ( 170, 250 ] 1 5.000% 5.000% # ( 380, 580 ] 1 5.000% 10.000% # ( 580, 870 ] 1 5.000% 15.000% # ( 870, 1300 ] 4 20.000% 35.000% #### ( 1300, 1900 ] 1 5.000% 40.000% # ( 1900, 2900 ] 4 20.000% 60.000% #### ( 2900, 4400 ] 1 5.000% 65.000% # ( 4400, 6600 ] 2 10.000% 75.000% ## ( 6600, 9900 ] 5 25.000% 100.000% ##### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.196 H:M:S, 6.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.196 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-22:37:41 ... thread 0: (1000000,2000000) ops and (318520.7,336755.3) ops/second in (3.139513,5.939030) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.17 GB 88.1 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.4 311.3 8.50 7.80 29 0.293 831K 831 0.0 0.0 L1 1/0 3.85 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.8 236.3 1.60 1.55 1 1.597 383K 607 0.0 0.0 L2 2/1 54.04 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 257.0 256.8 1.47 1.43 2 0.735 383K 217 0.0 0.0 L3 18/8 962.77 MB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 229.6 229.6 1.09 1.01 1 1.085 252K 0 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.0 144.0 1.55 1.15 1 1.555 227K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/13 97.92 GB 0.0 2.0 1.0 1.0 3.8 2.8 2.1 2.1 144.2 272.7 14.20 12.95 34 0.418 2079K 1655 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 1.0 1.0 3.8 2.8 2.0 2.1 144.2 272.7 14.20 12.95 34 0.418 2079K 1655 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 1.0 1.0 2.0 1.0 0.0 0.0 228.6 228.4 8.96 8.33 8 1.120 2079K 1655 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.3 5.25 4.62 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 630.64 MB/s write, 2.00 GB read, 333.46 MB/s read, 14.2 seconds Interval compaction: 3.78 GB write, 651.98 MB/s write, 2.00 GB read, 344.74 MB/s read, 14.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386585 Average: 2.3424 StdDev: 14.39 Min: 0 Median: 1.5582 Max: 3732 Percentiles: P50: 1.56 P75: 1.95 P99: 5.84 P99.9: 11.95 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 55971 14.478% 14.478% ### ( 1, 2 ] 246015 63.638% 78.116% ############# ( 2, 3 ] 54271 14.039% 92.155% ### ( 3, 4 ] 14965 3.871% 96.026% # ( 4, 6 ] 12479 3.228% 99.254% # ( 6, 10 ] 2277 0.589% 99.843% ( 10, 15 ] 571 0.148% 99.991% ( 15, 22 ] 51 0.013% 100.004% ( 22, 34 ] 8 0.002% 100.006% ( 34, 51 ] 4 0.001% 100.007% ( 51, 76 ] 3 0.001% 100.008% ( 110, 170 ] 10 0.003% 100.010% ( 170, 250 ] 11 0.003% 100.013% ( 250, 380 ] 8 0.002% 100.015% ( 380, 580 ] 6 0.002% 100.017% ( 580, 870 ] 10 0.003% 100.019% ( 870, 1300 ] 5 0.001% 100.021% ( 1300, 1900 ] 2 0.001% 100.021% ( 1900, 2900 ] 1 0.000% 100.021% ( 2900, 4400 ] 5 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 25 Average: 198.4800 StdDev: 384.62 Min: 1 Median: 1.5000 Max: 1546 Percentiles: P50: 1.50 P75: 230.00 P99: 1546.00 P99.9: 1546.00 P99.99: 1546.00 ------------------------------------------------------ [ 0, 1 ] 9 36.000% 36.000% ####### ( 1, 2 ] 7 28.000% 64.000% ###### ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 2 8.000% 84.000% ## ( 380, 580 ] 1 4.000% 88.000% # ( 870, 1300 ] 2 8.000% 96.000% ## ( 1300, 1900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 95823 Average: 2.2572 StdDev: 22.09 Min: 1 Median: 1.4676 Max: 4851 Percentiles: P50: 1.47 P75: 1.85 P99: 5.62 P99.9: 11.22 P99.99: 640.57 ------------------------------------------------------ [ 0, 1 ] 18552 19.361% 19.361% #### ( 1, 2 ] 62789 65.526% 84.887% ############# ( 2, 3 ] 9178 9.578% 94.465% ## ( 3, 4 ] 2586 2.699% 97.164% # ( 4, 6 ] 2170 2.265% 99.428% ( 6, 10 ] 429 0.448% 99.876% ( 10, 15 ] 95 0.099% 99.975% ( 15, 22 ] 5 0.005% 99.980% ( 22, 34 ] 3 0.003% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 170, 250 ] 2 0.002% 99.986% ( 250, 380 ] 2 0.002% 99.989% ( 380, 580 ] 1 0.001% 99.990% ( 580, 870 ] 2 0.002% 99.992% ( 870, 1300 ] 5 0.005% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 174614 Average: 4.1109 StdDev: 69.33 Min: 1 Median: 1.8019 Max: 8389 Percentiles: P50: 1.80 P75: 2.53 P99: 9.03 P99.9: 159.89 P99.99: 447.87 ------------------------------------------------------ [ 0, 1 ] 6631 3.798% 3.798% # ( 1, 2 ] 100600 57.613% 61.410% ############ ( 2, 3 ] 44488 25.478% 86.888% ##### ( 3, 4 ] 9105 5.214% 92.103% # ( 4, 6 ] 9734 5.575% 97.677% # ( 6, 10 ] 3052 1.748% 99.425% ( 10, 15 ] 534 0.306% 99.731% ( 15, 22 ] 72 0.041% 99.772% ( 22, 34 ] 9 0.005% 99.777% ( 51, 76 ] 1 0.001% 99.778% ( 76, 110 ] 87 0.050% 99.828% ( 110, 170 ] 152 0.087% 99.915% ( 170, 250 ] 71 0.041% 99.955% ( 250, 380 ] 49 0.028% 99.983% ( 380, 580 ] 34 0.019% 100.003% ( 580, 870 ] 17 0.010% 100.013% ( 870, 1300 ] 17 0.010% 100.022% ( 1300, 1900 ] 8 0.005% 100.027% ( 1900, 2900 ] 9 0.005% 100.032% ( 2900, 4400 ] 7 0.004% 100.036% ( 4400, 6600 ] 8 0.005% 100.041% ( 6600, 9900 ] 7 0.004% 100.045% ** Level 4 read latency histogram (micros): Count: 305 Average: 240.8984 StdDev: 1157.08 Min: 0 Median: 1.9000 Max: 9808 Percentiles: P50: 1.90 P75: 5.37 P99: 7887.00 P99.9: 9698.70 P99.99: 9808.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 115 37.705% 53.770% ######## ( 2, 3 ] 37 12.131% 65.902% ## ( 3, 4 ] 10 3.279% 69.180% # ( 4, 6 ] 26 8.525% 77.705% ## ( 6, 10 ] 6 1.967% 79.672% ( 10, 15 ] 23 7.541% 87.213% ## ( 15, 22 ] 12 3.934% 91.148% # ( 22, 34 ] 3 0.984% 92.131% ( 34, 51 ] 1 0.328% 92.459% ( 170, 250 ] 4 1.311% 93.770% ( 380, 580 ] 1 0.328% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 870, 1300 ] 4 1.311% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 4 1.311% 97.377% ( 2900, 4400 ] 1 0.328% 97.705% ( 4400, 6600 ] 2 0.656% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 931.6250 StdDev: 1055.78 Min: 97 Median: 413.3333 Max: 4326 Percentiles: P50: 413.33 P75: 1500.00 P99: 4200.00 P99.9: 4326.00 P99.99: 4326.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 8 20.000% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 5 12.500% 47.500% ### ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 2 5.000% 67.500% # ( 870, 1300 ] 1 2.500% 70.000% # ( 1300, 1900 ] 6 15.000% 85.000% ### ( 1900, 2900 ] 3 7.500% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.614 H:M:S, 10.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.418 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-22:37:44 ... thread 0: (1000000,3000000) ops and (332095.5,335187.6) ops/second in (3.011182,8.950212) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 1.7 0.0 1.7 4.4 2.8 0.0 1.6 116.3 310.0 14.63 13.56 46 0.318 1727K 1823 0.0 0.0 L1 1/0 3.85 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.8 236.3 1.60 1.55 1 1.597 383K 607 0.0 0.0 L2 1/0 51.44 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 257.0 256.8 1.47 1.43 2 0.735 383K 217 0.0 0.0 L3 15/0 963.78 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 225.1 224.7 3.85 3.59 2 1.926 880K 1616 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.0 144.0 1.55 1.15 1 1.555 227K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/4 98.90 GB 0.0 3.5 1.0 2.4 6.2 3.8 2.1 2.2 153.6 276.1 23.10 21.28 52 0.444 3602K 4263 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 1.0 2.4 6.2 3.8 2.0 2.2 153.6 276.1 23.10 21.28 52 0.444 3602K 4263 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 1.0 2.4 3.5 1.0 0.0 0.0 235.6 235.3 15.06 14.19 12 1.255 3602K 4263 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.5 8.04 7.10 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.23 GB write, 696.88 MB/s write, 3.46 GB read, 387.63 MB/s read, 23.1 seconds Interval compaction: 6.23 GB write, 712.53 MB/s write, 3.46 GB read, 396.34 MB/s read, 23.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 635808 Average: 2.2394 StdDev: 13.12 Min: 0 Median: 1.5090 Max: 3732 Percentiles: P50: 1.51 P75: 1.89 P99: 5.70 P99.9: 11.54 P99.99: 15.67 ------------------------------------------------------ [ 0, 1 ] 107671 16.935% 16.935% ### ( 1, 2 ] 413033 64.962% 81.896% ############# ( 2, 3 ] 75266 11.838% 93.734% ## ( 3, 4 ] 20091 3.160% 96.894% # ( 4, 6 ] 15747 2.477% 99.371% ( 6, 10 ] 3113 0.490% 99.860% ( 10, 15 ] 818 0.129% 99.989% ( 15, 22 ] 67 0.011% 100.000% ( 22, 34 ] 10 0.002% 100.001% ( 34, 51 ] 4 0.001% 100.002% ( 51, 76 ] 4 0.001% 100.003% ( 110, 170 ] 16 0.003% 100.005% ( 170, 250 ] 16 0.003% 100.008% ( 250, 380 ] 14 0.002% 100.010% ( 380, 580 ] 10 0.002% 100.011% ( 580, 870 ] 15 0.002% 100.014% ( 870, 1300 ] 7 0.001% 100.015% ( 1300, 1900 ] 6 0.001% 100.016% ( 1900, 2900 ] 2 0.000% 100.016% ( 2900, 4400 ] 6 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 25 Average: 198.4800 StdDev: 384.62 Min: 1 Median: 1.5000 Max: 1546 Percentiles: P50: 1.50 P75: 230.00 P99: 1546.00 P99.9: 1546.00 P99.99: 1546.00 ------------------------------------------------------ [ 0, 1 ] 9 36.000% 36.000% ####### ( 1, 2 ] 7 28.000% 64.000% ###### ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 2 8.000% 84.000% ## ( 380, 580 ] 1 4.000% 88.000% # ( 870, 1300 ] 2 8.000% 96.000% ## ( 1300, 1900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 124230 Average: 2.4772 StdDev: 20.96 Min: 1 Median: 1.5036 Max: 4851 Percentiles: P50: 1.50 P75: 1.88 P99: 5.96 P99.9: 96.59 P99.99: 704.55 ------------------------------------------------------ [ 0, 1 ] 20675 16.643% 16.643% ### ( 1, 2 ] 82280 66.232% 82.875% ############# ( 2, 3 ] 13875 11.169% 94.043% ## ( 3, 4 ] 3397 2.734% 96.778% # ( 4, 6 ] 2815 2.266% 99.044% ( 6, 10 ] 922 0.742% 99.786% ( 10, 15 ] 110 0.089% 99.874% ( 15, 22 ] 9 0.007% 99.882% ( 22, 34 ] 3 0.002% 99.884% ( 51, 76 ] 1 0.001% 99.885% ( 76, 110 ] 31 0.025% 99.910% ( 110, 170 ] 47 0.038% 99.948% ( 170, 250 ] 29 0.023% 99.971% ( 250, 380 ] 10 0.008% 99.979% ( 380, 580 ] 11 0.009% 99.988% ( 580, 870 ] 6 0.005% 99.993% ( 870, 1300 ] 6 0.005% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184804 Average: 4.0498 StdDev: 67.65 Min: 0 Median: 1.7888 Max: 8389 Percentiles: P50: 1.79 P75: 2.51 P99: 8.98 P99.9: 159.81 P99.99: 477.33 ------------------------------------------------------ [ 0, 1 ] 7550 4.085% 4.085% # ( 1, 2 ] 107572 58.209% 62.294% ############ ( 2, 3 ] 46078 24.933% 87.228% ##### ( 3, 4 ] 9397 5.085% 92.312% # ( 4, 6 ] 9957 5.388% 97.700% # ( 6, 10 ] 3222 1.743% 99.444% ( 10, 15 ] 545 0.295% 99.739% ( 15, 22 ] 75 0.041% 99.779% ( 22, 34 ] 9 0.005% 99.784% ( 51, 76 ] 1 0.001% 99.785% ( 76, 110 ] 87 0.047% 99.832% ( 110, 170 ] 152 0.082% 99.914% ( 170, 250 ] 71 0.038% 99.952% ( 250, 380 ] 52 0.028% 99.981% ( 380, 580 ] 36 0.019% 100.000% ( 580, 870 ] 18 0.010% 100.010% ( 870, 1300 ] 21 0.011% 100.021% ( 1300, 1900 ] 8 0.004% 100.025% ( 1900, 2900 ] 9 0.005% 100.030% ( 2900, 4400 ] 7 0.004% 100.034% ( 4400, 6600 ] 8 0.004% 100.038% ( 6600, 9900 ] 7 0.004% 100.042% ** Level 4 read latency histogram (micros): Count: 305 Average: 240.8984 StdDev: 1157.08 Min: 0 Median: 1.9000 Max: 9808 Percentiles: P50: 1.90 P75: 5.37 P99: 7887.00 P99.9: 9698.70 P99.99: 9808.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 115 37.705% 53.770% ######## ( 2, 3 ] 37 12.131% 65.902% ## ( 3, 4 ] 10 3.279% 69.180% # ( 4, 6 ] 26 8.525% 77.705% ## ( 6, 10 ] 6 1.967% 79.672% ( 10, 15 ] 23 7.541% 87.213% ## ( 15, 22 ] 12 3.934% 91.148% # ( 22, 34 ] 3 0.984% 92.131% ( 34, 51 ] 1 0.328% 92.459% ( 170, 250 ] 4 1.311% 93.770% ( 380, 580 ] 1 0.328% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 870, 1300 ] 4 1.311% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 4 1.311% 97.377% ( 2900, 4400 ] 1 0.328% 97.705% ( 4400, 6600 ] 2 0.656% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 931.6250 StdDev: 1055.78 Min: 97 Median: 413.3333 Max: 4326 Percentiles: P50: 413.33 P75: 1500.00 P99: 4200.00 P99.9: 4326.00 P99.99: 4326.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 8 20.000% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 5 12.500% 47.500% ### ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 2 5.000% 67.500% # ( 870, 1300 ] 1 2.500% 70.000% # ( 1300, 1900 ] 6 15.000% 85.000% ### ( 1900, 2900 ] 3 7.500% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.985 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.371 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-22:37:47 ... thread 0: (1000000,4000000) ops and (333113.9,334666.8) ops/second in (3.001976,11.952188) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 3.13 GB 289.5 2.8 0.0 2.8 6.5 3.7 0.0 1.7 130.4 306.9 21.75 20.29 64 0.340 2878K 3058 0.0 0.0 L1 1/0 3.85 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.8 236.3 1.60 1.55 1 1.597 383K 607 0.0 0.0 L2 1/0 51.44 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 257.0 256.8 1.47 1.43 2 0.735 383K 217 0.0 0.0 L3 15/0 963.78 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 225.1 224.7 3.85 3.59 2 1.926 880K 1616 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.0 144.0 1.55 1.15 1 1.555 227K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/4 99.88 GB 0.0 4.6 1.0 3.6 8.3 4.8 2.1 2.2 154.9 281.9 30.22 28.02 70 0.432 4754K 5498 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.0 3.6 8.3 4.8 2.0 2.2 154.9 281.9 30.22 28.02 70 0.432 4754K 5498 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.0 3.6 4.6 1.0 0.0 0.0 241.8 241.5 19.36 18.41 16 1.210 4754K 5498 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 353.9 10.86 9.61 54 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.32 GB write, 700.88 MB/s write, 4.57 GB read, 385.19 MB/s read, 30.2 seconds Interval compaction: 8.32 GB write, 712.67 MB/s write, 4.57 GB read, 391.67 MB/s read, 30.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 892494 Average: 2.1963 StdDev: 14.11 Min: 0 Median: 1.4802 Max: 3901 Percentiles: P50: 1.48 P75: 1.86 P99: 5.61 P99.9: 11.42 P99.99: 16.71 ------------------------------------------------------ [ 0, 1 ] 166991 18.711% 18.711% #### ( 1, 2 ] 581564 65.162% 83.872% ############# ( 2, 3 ] 94559 10.595% 94.467% ## ( 3, 4 ] 25220 2.826% 97.293% # ( 4, 6 ] 18941 2.122% 99.415% ( 6, 10 ] 4018 0.450% 99.865% ( 10, 15 ] 1091 0.122% 99.988% ( 15, 22 ] 89 0.010% 99.998% ( 22, 34 ] 16 0.002% 99.999% ( 34, 51 ] 5 0.001% 100.000% ( 51, 76 ] 7 0.001% 100.001% ( 110, 170 ] 20 0.002% 100.003% ( 170, 250 ] 22 0.002% 100.005% ( 250, 380 ] 19 0.002% 100.008% ( 380, 580 ] 12 0.001% 100.009% ( 580, 870 ] 21 0.002% 100.011% ( 870, 1300 ] 12 0.001% 100.013% ( 1300, 1900 ] 8 0.001% 100.014% ( 1900, 2900 ] 5 0.001% 100.014% ( 2900, 4400 ] 9 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 25 Average: 198.4800 StdDev: 384.62 Min: 1 Median: 1.5000 Max: 1546 Percentiles: P50: 1.50 P75: 230.00 P99: 1546.00 P99.9: 1546.00 P99.99: 1546.00 ------------------------------------------------------ [ 0, 1 ] 9 36.000% 36.000% ####### ( 1, 2 ] 7 28.000% 64.000% ###### ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 2 8.000% 84.000% ## ( 380, 580 ] 1 4.000% 88.000% # ( 870, 1300 ] 2 8.000% 96.000% ## ( 1300, 1900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 124230 Average: 2.4772 StdDev: 20.96 Min: 1 Median: 1.5036 Max: 4851 Percentiles: P50: 1.50 P75: 1.88 P99: 5.96 P99.9: 96.59 P99.99: 704.55 ------------------------------------------------------ [ 0, 1 ] 20675 16.643% 16.643% ### ( 1, 2 ] 82280 66.232% 82.875% ############# ( 2, 3 ] 13875 11.169% 94.043% ## ( 3, 4 ] 3397 2.734% 96.778% # ( 4, 6 ] 2815 2.266% 99.044% ( 6, 10 ] 922 0.742% 99.786% ( 10, 15 ] 110 0.089% 99.874% ( 15, 22 ] 9 0.007% 99.882% ( 22, 34 ] 3 0.002% 99.884% ( 51, 76 ] 1 0.001% 99.885% ( 76, 110 ] 31 0.025% 99.910% ( 110, 170 ] 47 0.038% 99.948% ( 170, 250 ] 29 0.023% 99.971% ( 250, 380 ] 10 0.008% 99.979% ( 380, 580 ] 11 0.009% 99.988% ( 580, 870 ] 6 0.005% 99.993% ( 870, 1300 ] 6 0.005% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184804 Average: 4.0498 StdDev: 67.65 Min: 0 Median: 1.7888 Max: 8389 Percentiles: P50: 1.79 P75: 2.51 P99: 8.98 P99.9: 159.81 P99.99: 477.33 ------------------------------------------------------ [ 0, 1 ] 7550 4.085% 4.085% # ( 1, 2 ] 107572 58.209% 62.294% ############ ( 2, 3 ] 46078 24.933% 87.228% ##### ( 3, 4 ] 9397 5.085% 92.312% # ( 4, 6 ] 9957 5.388% 97.700% # ( 6, 10 ] 3222 1.743% 99.444% ( 10, 15 ] 545 0.295% 99.739% ( 15, 22 ] 75 0.041% 99.779% ( 22, 34 ] 9 0.005% 99.784% ( 51, 76 ] 1 0.001% 99.785% ( 76, 110 ] 87 0.047% 99.832% ( 110, 170 ] 152 0.082% 99.914% ( 170, 250 ] 71 0.038% 99.952% ( 250, 380 ] 52 0.028% 99.981% ( 380, 580 ] 36 0.019% 100.000% ( 580, 870 ] 18 0.010% 100.010% ( 870, 1300 ] 21 0.011% 100.021% ( 1300, 1900 ] 8 0.004% 100.025% ( 1900, 2900 ] 9 0.005% 100.030% ( 2900, 4400 ] 7 0.004% 100.034% ( 4400, 6600 ] 8 0.004% 100.038% ( 6600, 9900 ] 7 0.004% 100.042% ** Level 4 read latency histogram (micros): Count: 305 Average: 240.8984 StdDev: 1157.08 Min: 0 Median: 1.9000 Max: 9808 Percentiles: P50: 1.90 P75: 5.37 P99: 7887.00 P99.9: 9698.70 P99.99: 9808.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 115 37.705% 53.770% ######## ( 2, 3 ] 37 12.131% 65.902% ## ( 3, 4 ] 10 3.279% 69.180% # ( 4, 6 ] 26 8.525% 77.705% ## ( 6, 10 ] 6 1.967% 79.672% ( 10, 15 ] 23 7.541% 87.213% ## ( 15, 22 ] 12 3.934% 91.148% # ( 22, 34 ] 3 0.984% 92.131% ( 34, 51 ] 1 0.328% 92.459% ( 170, 250 ] 4 1.311% 93.770% ( 380, 580 ] 1 0.328% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 870, 1300 ] 4 1.311% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 4 1.311% 97.377% ( 2900, 4400 ] 1 0.328% 97.705% ( 4400, 6600 ] 2 0.656% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 931.6250 StdDev: 1055.78 Min: 97 Median: 413.3333 Max: 4326 Percentiles: P50: 413.33 P75: 1500.00 P99: 4200.00 P99.9: 4326.00 P99.99: 4326.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 8 20.000% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 5 12.500% 47.500% ### ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 2 5.000% 67.500% # ( 870, 1300 ] 1 2.500% 70.000% # ( 1300, 1900 ] 6 15.000% 85.000% ### ( 1900, 2900 ] 3 7.500% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.344 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.359 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-22:37:50 ... thread 0: (1000000,5000000) ops and (298849.3,326832.5) ops/second in (3.346168,15.298356) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 4.12 GB 396.4 3.8 0.0 3.8 8.5 4.7 0.0 1.8 136.7 306.3 28.58 26.74 84 0.340 3965K 4138 0.0 0.0 L1 1/0 3.85 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 236.8 236.3 1.60 1.55 1 1.597 383K 607 0.0 0.0 L2 1/0 51.44 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 257.0 256.8 1.47 1.43 2 0.735 383K 217 0.0 0.0 L3 15/0 963.78 MB 1.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 225.1 224.7 3.85 3.59 2 1.926 880K 1616 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.0 144.0 1.55 1.15 1 1.555 227K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/4 100.87 GB 0.0 5.6 1.0 4.6 10.3 5.7 2.1 2.2 155.3 286.0 37.05 34.47 90 0.412 5841K 6578 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 1.0 4.6 10.3 5.7 2.0 2.2 155.3 286.0 37.05 34.47 90 0.412 5841K 6578 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 1.0 4.6 5.6 1.0 0.0 0.0 245.5 245.2 23.43 22.41 20 1.172 5841K 6578 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.2 13.62 12.06 70 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.35 GB write, 683.63 MB/s write, 5.62 GB read, 371.13 MB/s read, 37.1 seconds Interval compaction: 10.35 GB write, 692.61 MB/s write, 5.62 GB read, 376.01 MB/s read, 37.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 11, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1189284 Average: 2.1587 StdDev: 13.31 Min: 0 Median: 1.4632 Max: 3901 Percentiles: P50: 1.46 P75: 1.85 P99: 5.50 P99.9: 11.12 P99.99: 16.98 ------------------------------------------------------ [ 0, 1 ] 234494 19.717% 19.717% #### ( 1, 2 ] 777465 65.373% 85.090% ############# ( 2, 3 ] 117747 9.901% 94.990% ## ( 3, 4 ] 30968 2.604% 97.594% # ( 4, 6 ] 22227 1.869% 99.463% ( 6, 10 ] 4895 0.412% 99.875% ( 10, 15 ] 1339 0.113% 99.987% ( 15, 22 ] 110 0.009% 99.997% ( 22, 34 ] 20 0.002% 99.998% ( 34, 51 ] 9 0.001% 99.999% ( 51, 76 ] 11 0.001% 100.000% ( 110, 170 ] 25 0.002% 100.002% ( 170, 250 ] 31 0.003% 100.005% ( 250, 380 ] 21 0.002% 100.007% ( 380, 580 ] 18 0.002% 100.008% ( 580, 870 ] 26 0.002% 100.010% ( 870, 1300 ] 16 0.001% 100.012% ( 1300, 1900 ] 15 0.001% 100.013% ( 1900, 2900 ] 7 0.001% 100.013% ( 2900, 4400 ] 9 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 25 Average: 198.4800 StdDev: 384.62 Min: 1 Median: 1.5000 Max: 1546 Percentiles: P50: 1.50 P75: 230.00 P99: 1546.00 P99.9: 1546.00 P99.99: 1546.00 ------------------------------------------------------ [ 0, 1 ] 9 36.000% 36.000% ####### ( 1, 2 ] 7 28.000% 64.000% ###### ( 4, 6 ] 1 4.000% 68.000% # ( 110, 170 ] 1 4.000% 72.000% # ( 170, 250 ] 1 4.000% 76.000% # ( 250, 380 ] 2 8.000% 84.000% ## ( 380, 580 ] 1 4.000% 88.000% # ( 870, 1300 ] 2 8.000% 96.000% ## ( 1300, 1900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 124230 Average: 2.4772 StdDev: 20.96 Min: 1 Median: 1.5036 Max: 4851 Percentiles: P50: 1.50 P75: 1.88 P99: 5.96 P99.9: 96.59 P99.99: 704.55 ------------------------------------------------------ [ 0, 1 ] 20675 16.643% 16.643% ### ( 1, 2 ] 82280 66.232% 82.875% ############# ( 2, 3 ] 13875 11.169% 94.043% ## ( 3, 4 ] 3397 2.734% 96.778% # ( 4, 6 ] 2815 2.266% 99.044% ( 6, 10 ] 922 0.742% 99.786% ( 10, 15 ] 110 0.089% 99.874% ( 15, 22 ] 9 0.007% 99.882% ( 22, 34 ] 3 0.002% 99.884% ( 51, 76 ] 1 0.001% 99.885% ( 76, 110 ] 31 0.025% 99.910% ( 110, 170 ] 47 0.038% 99.948% ( 170, 250 ] 29 0.023% 99.971% ( 250, 380 ] 10 0.008% 99.979% ( 380, 580 ] 11 0.009% 99.988% ( 580, 870 ] 6 0.005% 99.993% ( 870, 1300 ] 6 0.005% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184804 Average: 4.0498 StdDev: 67.65 Min: 0 Median: 1.7888 Max: 8389 Percentiles: P50: 1.79 P75: 2.51 P99: 8.98 P99.9: 159.81 P99.99: 477.33 ------------------------------------------------------ [ 0, 1 ] 7550 4.085% 4.085% # ( 1, 2 ] 107572 58.209% 62.294% ############ ( 2, 3 ] 46078 24.933% 87.228% ##### ( 3, 4 ] 9397 5.085% 92.312% # ( 4, 6 ] 9957 5.388% 97.700% # ( 6, 10 ] 3222 1.743% 99.444% ( 10, 15 ] 545 0.295% 99.739% ( 15, 22 ] 75 0.041% 99.779% ( 22, 34 ] 9 0.005% 99.784% ( 51, 76 ] 1 0.001% 99.785% ( 76, 110 ] 87 0.047% 99.832% ( 110, 170 ] 152 0.082% 99.914% ( 170, 250 ] 71 0.038% 99.952% ( 250, 380 ] 52 0.028% 99.981% ( 380, 580 ] 36 0.019% 100.000% ( 580, 870 ] 18 0.010% 100.010% ( 870, 1300 ] 21 0.011% 100.021% ( 1300, 1900 ] 8 0.004% 100.025% ( 1900, 2900 ] 9 0.005% 100.030% ( 2900, 4400 ] 7 0.004% 100.034% ( 4400, 6600 ] 8 0.004% 100.038% ( 6600, 9900 ] 7 0.004% 100.042% ** Level 4 read latency histogram (micros): Count: 305 Average: 240.8984 StdDev: 1157.08 Min: 0 Median: 1.9000 Max: 9808 Percentiles: P50: 1.90 P75: 5.37 P99: 7887.00 P99.9: 9698.70 P99.99: 9808.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 115 37.705% 53.770% ######## ( 2, 3 ] 37 12.131% 65.902% ## ( 3, 4 ] 10 3.279% 69.180% # ( 4, 6 ] 26 8.525% 77.705% ## ( 6, 10 ] 6 1.967% 79.672% ( 10, 15 ] 23 7.541% 87.213% ## ( 15, 22 ] 12 3.934% 91.148% # ( 22, 34 ] 3 0.984% 92.131% ( 34, 51 ] 1 0.328% 92.459% ( 170, 250 ] 4 1.311% 93.770% ( 380, 580 ] 1 0.328% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 870, 1300 ] 4 1.311% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 4 1.311% 97.377% ( 2900, 4400 ] 1 0.328% 97.705% ( 4400, 6600 ] 2 0.656% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 931.6250 StdDev: 1055.78 Min: 97 Median: 413.3333 Max: 4326 Percentiles: P50: 413.33 P75: 1500.00 P99: 4200.00 P99.9: 4326.00 P99.99: 4326.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 8 20.000% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 5 12.500% 47.500% ### ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 2 5.000% 67.500% # ( 870, 1300 ] 1 2.500% 70.000% # ( 1300, 1900 ] 6 15.000% 85.000% ### ( 1900, 2900 ] 3 7.500% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 15.5 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 317.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.001 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 294.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.657 H:M:S, 19.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-22:38:13 ... thread 0: (1000000,6000000) ops and (43825.3,157413.3) ops/second in (22.817865,38.116221) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 755.71 MB 44.1 4.3 0.0 4.3 9.9 5.6 0.0 1.8 132.2 303.9 33.36 30.86 99 0.337 4477K 4604 0.0 0.0 L1 5/5 603.89 MB 0.0 4.6 4.6 0.0 4.5 4.5 0.2 1.0 215.7 211.5 21.90 19.88 2 10.952 4796K 90K 0.0 0.0 L2 30/21 3.62 GB 11.6 0.4 0.2 0.2 0.4 0.2 4.0 2.0 257.0 256.8 1.47 1.43 2 0.735 383K 217 0.0 0.0 L3 15/9 963.78 MB 0.0 0.8 0.2 0.6 0.8 0.2 0.4 3.4 225.1 224.7 3.85 3.59 2 1.926 880K 1616 0.0 0.0 L4 169/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 144.0 144.0 1.55 1.15 1 1.555 227K 0 0.0 0.0 L5 1044/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/40 101.64 GB 0.0 10.4 5.3 5.1 15.9 10.8 5.7 2.8 170.6 261.3 62.14 56.92 106 0.586 10M 96K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.4 5.3 5.1 15.9 10.8 5.6 2.8 170.6 261.3 62.14 56.92 106 0.586 10M 96K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.4 5.3 5.1 10.3 5.2 0.0 0.0 232.4 230.2 45.63 42.59 23 1.984 10M 96K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 347.2 16.51 14.33 83 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.3 total, 38.1 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.86 GB write, 423.78 MB/s write, 10.35 GB read, 276.70 MB/s read, 62.1 seconds Interval compaction: 15.86 GB write, 426.01 MB/s write, 10.35 GB read, 278.16 MB/s read, 62.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 13, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2458842 Average: 2.8093 StdDev: 18.27 Min: 0 Median: 1.4180 Max: 3901 Percentiles: P50: 1.42 P75: 1.80 P99: 6.86 P99.9: 159.58 P99.99: 464.09 ------------------------------------------------------ [ 0, 1 ] 563097 22.901% 22.901% ##### ( 1, 2 ] 1594140 64.833% 87.734% ############# ( 2, 3 ] 170892 6.950% 94.684% # ( 3, 4 ] 58390 2.375% 97.059% ( 4, 6 ] 45235 1.840% 98.898% ( 6, 10 ] 11606 0.472% 99.370% ( 10, 15 ] 2658 0.108% 99.478% ( 15, 22 ] 308 0.013% 99.491% ( 22, 34 ] 26 0.001% 99.492% ( 34, 51 ] 11 0.000% 99.492% ( 51, 76 ] 25 0.001% 99.494% ( 76, 110 ] 4765 0.194% 99.687% ( 110, 170 ] 6329 0.257% 99.945% ( 170, 250 ] 500 0.020% 99.965% ( 250, 380 ] 435 0.018% 99.983% ( 380, 580 ] 426 0.017% 100.000% ( 580, 870 ] 144 0.006% 100.006% ( 870, 1300 ] 32 0.001% 100.007% ( 1300, 1900 ] 19 0.001% 100.008% ( 1900, 2900 ] 28 0.001% 100.009% ( 2900, 4400 ] 18 0.001% 100.010% ** Level 1 read latency histogram (micros): Count: 388010 Average: 4.3294 StdDev: 36.98 Min: 1 Median: 2.2015 Max: 5137 Percentiles: P50: 2.20 P75: 3.02 P99: 8.92 P99.9: 12.79 P99.99: 13.77 ------------------------------------------------------ [ 0, 1 ] 2560 0.660% 0.660% ( 1, 2 ] 167207 43.093% 43.753% ######### ( 2, 3 ] 120269 30.996% 74.750% ###### ( 3, 4 ] 40376 10.406% 85.156% ## ( 4, 6 ] 47007 12.115% 97.270% ## ( 6, 10 ] 9206 2.373% 99.643% ( 10, 15 ] 1788 0.461% 100.104% ( 15, 22 ] 187 0.048% 100.152% ( 22, 34 ] 8 0.002% 100.154% ( 34, 51 ] 4 0.001% 100.155% ( 76, 110 ] 57 0.015% 100.170% ( 110, 170 ] 111 0.029% 100.198% ( 170, 250 ] 117 0.030% 100.229% ( 250, 380 ] 149 0.038% 100.267% ( 380, 580 ] 156 0.040% 100.307% ( 580, 870 ] 150 0.039% 100.346% ( 870, 1300 ] 79 0.020% 100.366% ( 1300, 1900 ] 36 0.009% 100.376% ( 1900, 2900 ] 22 0.006% 100.381% ( 2900, 4400 ] 5 0.001% 100.382% ( 4400, 6600 ] 2 0.001% 100.383% ** Level 2 read latency histogram (micros): Count: 124230 Average: 2.4772 StdDev: 20.96 Min: 1 Median: 1.5036 Max: 4851 Percentiles: P50: 1.50 P75: 1.88 P99: 5.96 P99.9: 96.59 P99.99: 704.55 ------------------------------------------------------ [ 0, 1 ] 20675 16.643% 16.643% ### ( 1, 2 ] 82280 66.232% 82.875% ############# ( 2, 3 ] 13875 11.169% 94.043% ## ( 3, 4 ] 3397 2.734% 96.778% # ( 4, 6 ] 2815 2.266% 99.044% ( 6, 10 ] 922 0.742% 99.786% ( 10, 15 ] 110 0.089% 99.874% ( 15, 22 ] 9 0.007% 99.882% ( 22, 34 ] 3 0.002% 99.884% ( 51, 76 ] 1 0.001% 99.885% ( 76, 110 ] 31 0.025% 99.910% ( 110, 170 ] 47 0.038% 99.948% ( 170, 250 ] 29 0.023% 99.971% ( 250, 380 ] 10 0.008% 99.979% ( 380, 580 ] 11 0.009% 99.988% ( 580, 870 ] 6 0.005% 99.993% ( 870, 1300 ] 6 0.005% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 269079 Average: 4.5532 StdDev: 65.68 Min: 0 Median: 1.8859 Max: 8389 Percentiles: P50: 1.89 P75: 2.70 P99: 9.41 P99.9: 304.27 P99.99: 1014.16 ------------------------------------------------------ [ 0, 1 ] 7892 2.933% 2.933% # ( 1, 2 ] 142959 53.129% 56.062% ########### ( 2, 3 ] 72585 26.975% 83.037% ##### ( 3, 4 ] 17925 6.662% 89.699% # ( 4, 6 ] 20124 7.479% 97.178% # ( 6, 10 ] 5746 2.135% 99.313% ( 10, 15 ] 999 0.371% 99.684% ( 15, 22 ] 122 0.045% 99.730% ( 22, 34 ] 9 0.003% 99.733% ( 34, 51 ] 1 0.000% 99.734% ( 51, 76 ] 2 0.001% 99.734% ( 76, 110 ] 92 0.034% 99.768% ( 110, 170 ] 185 0.069% 99.837% ( 170, 250 ] 124 0.046% 99.883% ( 250, 380 ] 110 0.041% 99.924% ( 380, 580 ] 96 0.036% 99.960% ( 580, 870 ] 66 0.025% 99.984% ( 870, 1300 ] 48 0.018% 100.002% ( 1300, 1900 ] 18 0.007% 100.009% ( 1900, 2900 ] 22 0.008% 100.017% ( 2900, 4400 ] 17 0.006% 100.023% ( 4400, 6600 ] 9 0.003% 100.027% ( 6600, 9900 ] 7 0.003% 100.029% ** Level 4 read latency histogram (micros): Count: 305 Average: 240.8984 StdDev: 1157.08 Min: 0 Median: 1.9000 Max: 9808 Percentiles: P50: 1.90 P75: 5.37 P99: 7887.00 P99.9: 9698.70 P99.99: 9808.00 ------------------------------------------------------ [ 0, 1 ] 49 16.066% 16.066% ### ( 1, 2 ] 115 37.705% 53.770% ######## ( 2, 3 ] 37 12.131% 65.902% ## ( 3, 4 ] 10 3.279% 69.180% # ( 4, 6 ] 26 8.525% 77.705% ## ( 6, 10 ] 6 1.967% 79.672% ( 10, 15 ] 23 7.541% 87.213% ## ( 15, 22 ] 12 3.934% 91.148% # ( 22, 34 ] 3 0.984% 92.131% ( 34, 51 ] 1 0.328% 92.459% ( 170, 250 ] 4 1.311% 93.770% ( 380, 580 ] 1 0.328% 94.098% ( 580, 870 ] 1 0.328% 94.426% ( 870, 1300 ] 4 1.311% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 4 1.311% 97.377% ( 2900, 4400 ] 1 0.328% 97.705% ( 4400, 6600 ] 2 0.656% 98.361% ( 6600, 9900 ] 5 1.639% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 931.6250 StdDev: 1055.78 Min: 97 Median: 413.3333 Max: 4326 Percentiles: P50: 413.33 P75: 1500.00 P99: 4200.00 P99.9: 4326.00 P99.99: 4326.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 8 20.000% 25.000% #### ( 170, 250 ] 4 10.000% 35.000% ## ( 250, 380 ] 5 12.500% 47.500% ### ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 2 5.000% 67.500% # ( 870, 1300 ] 1 2.500% 70.000% # ( 1300, 1900 ] 6 15.000% 85.000% ### ( 1900, 2900 ] 3 7.500% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 38.3 total, 22.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 154.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.264 H:M:S, 55.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 43.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.262 H:M:S, 84.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/06-22:38:18 ... thread 0: (1000000,7000000) ops and (193471.9,161719.1) ops/second in (5.168709,43.284930) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.78 GB 25.2 5.0 0.0 5.0 11.6 6.6 0.0 1.7 122.5 285.7 41.66 36.59 113 0.369 5181K 5523 0.0 0.0 L1 0/0 0.00 KB 0.0 4.6 4.6 0.0 4.5 4.5 0.2 1.0 215.7 211.5 21.90 19.88 2 10.952 4796K 90K 0.0 0.0 L2 19/15 2.39 GB 5.2 1.0 0.8 0.2 1.0 0.8 4.0 1.3 213.9 213.4 4.83 4.46 3 1.610 435K 217 0.0 0.0 L3 20/2 1.15 GB 1.0 3.7 2.0 1.7 3.6 2.0 0.5 1.8 174.1 172.4 21.48 16.87 14 1.534 3751K 7911 0.0 0.0 L4 174/0 9.73 GB 1.0 1.3 1.2 0.1 1.3 1.2 1.0 1.0 116.1 115.9 11.15 6.27 15 0.743 1282K 1065 0.0 0.0 L5 1060/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/27 102.65 GB 0.0 15.5 8.6 6.9 22.0 15.1 7.6 3.3 157.3 223.3 101.02 84.08 147 0.687 15M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.5 8.6 6.9 22.0 15.1 7.5 3.3 157.3 223.3 101.02 84.08 147 0.687 15M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.5 8.6 6.9 15.4 8.5 0.0 0.0 200.0 198.3 79.46 66.86 52 1.528 15M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 315.6 21.56 17.21 95 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.5 total, 43.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.03 GB write, 518.78 MB/s write, 15.52 GB read, 365.51 MB/s read, 101.0 seconds Interval compaction: 22.03 GB write, 521.19 MB/s write, 15.52 GB read, 367.20 MB/s read, 101.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 37, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2738290 Average: 3.0337 StdDev: 28.83 Min: 0 Median: 1.4617 Max: 12604 Percentiles: P50: 1.46 P75: 1.86 P99: 7.49 P99.9: 160.38 P99.99: 562.87 ------------------------------------------------------ [ 0, 1 ] 568356 20.756% 20.756% #### ( 1, 2 ] 1734501 63.342% 84.098% ############# ( 2, 3 ] 245430 8.963% 93.061% ## ( 3, 4 ] 82813 3.024% 96.086% # ( 4, 6 ] 73488 2.684% 98.769% # ( 6, 10 ] 16979 0.620% 99.389% ( 10, 15 ] 3443 0.126% 99.515% ( 15, 22 ] 380 0.014% 99.529% ( 22, 34 ] 34 0.001% 99.530% ( 34, 51 ] 12 0.000% 99.531% ( 51, 76 ] 27 0.001% 99.532% ( 76, 110 ] 4767 0.174% 99.706% ( 110, 170 ] 6338 0.231% 99.937% ( 170, 250 ] 528 0.019% 99.956% ( 250, 380 ] 463 0.017% 99.973% ( 380, 580 ] 500 0.018% 99.992% ( 580, 870 ] 230 0.008% 100.000% ( 870, 1300 ] 111 0.004% 100.004% ( 1300, 1900 ] 76 0.003% 100.007% ( 1900, 2900 ] 79 0.003% 100.010% ( 2900, 4400 ] 53 0.002% 100.012% ( 4400, 6600 ] 7 0.000% 100.012% ( 6600, 9900 ] 2 0.000% 100.012% ( 9900, 14000 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 973094 Average: 6.3331 StdDev: 94.61 Min: 1 Median: 2.1877 Max: 12285 Percentiles: P50: 2.19 P75: 2.99 P99: 9.29 P99.9: 14.62 P99.99: 33.31 ------------------------------------------------------ [ 0, 1 ] 5350 0.550% 0.550% ( 1, 2 ] 424470 43.621% 44.170% ######### ( 2, 3 ] 302299 31.066% 75.236% ###### ( 3, 4 ] 97806 10.051% 85.287% ## ( 4, 6 ] 112416 11.552% 96.840% ## ( 6, 10 ] 25592 2.630% 99.470% # ( 10, 15 ] 4537 0.466% 99.936% ( 15, 22 ] 490 0.050% 99.986% ( 22, 34 ] 40 0.004% 99.990% ( 34, 51 ] 12 0.001% 99.992% ( 51, 76 ] 6 0.001% 99.992% ( 76, 110 ] 92 0.009% 100.002% ( 110, 170 ] 202 0.021% 100.022% ( 170, 250 ] 260 0.027% 100.049% ( 250, 380 ] 367 0.038% 100.087% ( 380, 580 ] 422 0.043% 100.130% ( 580, 870 ] 461 0.047% 100.178% ( 870, 1300 ] 313 0.032% 100.210% ( 1300, 1900 ] 186 0.019% 100.229% ( 1900, 2900 ] 219 0.023% 100.251% ( 2900, 4400 ] 214 0.022% 100.273% ( 4400, 6600 ] 55 0.006% 100.279% ( 6600, 9900 ] 26 0.003% 100.282% ( 9900, 14000 ] 6 0.001% 100.282% ** Level 2 read latency histogram (micros): Count: 240117 Average: 3.4261 StdDev: 46.74 Min: 1 Median: 1.7707 Max: 8594 Percentiles: P50: 1.77 P75: 2.60 P99: 8.10 P99.9: 14.07 P99.99: 100.12 ------------------------------------------------------ [ 0, 1 ] 21031 8.759% 8.759% ## ( 1, 2 ] 128490 53.511% 62.270% ########### ( 2, 3 ] 50845 21.175% 83.445% #### ( 3, 4 ] 16538 6.887% 90.333% # ( 4, 6 ] 19023 7.922% 98.255% ## ( 6, 10 ] 3400 1.416% 99.671% ( 10, 15 ] 676 0.282% 99.953% ( 15, 22 ] 61 0.025% 99.978% ( 22, 34 ] 4 0.002% 99.980% ( 34, 51 ] 1 0.000% 99.980% ( 51, 76 ] 2 0.001% 99.981% ( 76, 110 ] 31 0.013% 99.994% ( 110, 170 ] 50 0.021% 100.015% ( 170, 250 ] 36 0.015% 100.030% ( 250, 380 ] 24 0.010% 100.040% ( 380, 580 ] 18 0.007% 100.047% ( 580, 870 ] 13 0.005% 100.052% ( 870, 1300 ] 16 0.007% 100.059% ( 1300, 1900 ] 10 0.004% 100.063% ( 1900, 2900 ] 9 0.004% 100.067% ( 2900, 4400 ] 19 0.008% 100.075% ( 4400, 6600 ] 3 0.001% 100.076% ( 6600, 9900 ] 1 0.000% 100.077% ** Level 3 read latency histogram (micros): Count: 680569 Average: 8.4892 StdDev: 133.44 Min: 0 Median: 2.0837 Max: 27392 Percentiles: P50: 2.08 P75: 2.92 P99: 9.73 P99.9: 661.34 P99.99: 1225.30 ------------------------------------------------------ [ 0, 1 ] 9526 1.400% 1.400% ( 1, 2 ] 313702 46.094% 47.494% ######### ( 2, 3 ] 203816 29.948% 77.442% ###### ( 3, 4 ] 60817 8.936% 86.378% ## ( 4, 6 ] 70243 10.321% 96.699% ## ( 6, 10 ] 16800 2.469% 99.168% ( 10, 15 ] 3180 0.467% 99.635% ( 15, 22 ] 378 0.056% 99.690% ( 22, 34 ] 32 0.005% 99.695% ( 34, 51 ] 15 0.002% 99.697% ( 51, 76 ] 11 0.002% 99.699% ( 76, 110 ] 103 0.015% 99.714% ( 110, 170 ] 236 0.035% 99.749% ( 170, 250 ] 228 0.034% 99.782% ( 250, 380 ] 302 0.044% 99.827% ( 380, 580 ] 385 0.057% 99.883% ( 580, 870 ] 408 0.060% 99.943% ( 870, 1300 ] 386 0.057% 100.000% ( 1300, 1900 ] 238 0.035% 100.035% ( 1900, 2900 ] 295 0.043% 100.078% ( 2900, 4400 ] 266 0.039% 100.117% ( 4400, 6600 ] 65 0.010% 100.127% ( 6600, 9900 ] 26 0.004% 100.131% ( 9900, 14000 ] 6 0.001% 100.132% ( 14000, 22000 ] 3 0.000% 100.132% ( 22000, 33000 ] 1 0.000% 100.132% ** Level 4 read latency histogram (micros): Count: 14426 Average: 102.3812 StdDev: 513.74 Min: 0 Median: 2.2343 Max: 9808 Percentiles: P50: 2.23 P75: 3.32 P99: 2950.09 P99.9: 5931.06 P99.99: 7904.38 ------------------------------------------------------ [ 0, 1 ] 237 1.643% 1.643% ( 1, 2 ] 6022 41.744% 43.387% ######## ( 2, 3 ] 4071 28.220% 71.607% ###### ( 3, 4 ] 1519 10.530% 82.136% ## ( 4, 6 ] 1136 7.875% 90.011% ## ( 6, 10 ] 363 2.516% 92.527% # ( 10, 15 ] 84 0.582% 93.110% ( 15, 22 ] 24 0.166% 93.276% ( 22, 34 ] 11 0.076% 93.352% ( 34, 51 ] 6 0.042% 93.394% ( 51, 76 ] 1 0.007% 93.401% ( 76, 110 ] 6 0.042% 93.442% ( 110, 170 ] 17 0.118% 93.560% ( 170, 250 ] 45 0.312% 93.872% ( 250, 380 ] 59 0.409% 94.281% ( 380, 580 ] 122 0.846% 95.127% ( 580, 870 ] 177 1.227% 96.354% ( 870, 1300 ] 164 1.137% 97.491% ( 1300, 1900 ] 114 0.790% 98.281% ( 1900, 2900 ] 100 0.693% 98.974% ( 2900, 4400 ] 112 0.776% 99.750% ( 4400, 6600 ] 31 0.215% 99.965% ( 6600, 9900 ] 9 0.062% 100.028% ** Level 5 read latency histogram (micros): Count: 120 Average: 1688.1833 StdDev: 1880.49 Min: 97 Median: 847.6923 Max: 10170 Percentiles: P50: 847.69 P75: 2429.41 P99: 9570.00 P99.9: 10170.00 P99.99: 10170.00 ------------------------------------------------------ ( 76, 110 ] 2 1.667% 1.667% ( 110, 170 ] 13 10.833% 12.500% ## ( 170, 250 ] 10 8.333% 20.833% ## ( 250, 380 ] 9 7.500% 28.333% ## ( 380, 580 ] 14 11.667% 40.000% ## ( 580, 870 ] 13 10.833% 50.833% ## ( 870, 1300 ] 7 5.833% 56.667% # ( 1300, 1900 ] 13 10.833% 67.500% ## ( 1900, 2900 ] 17 14.167% 81.667% ### ( 2900, 4400 ] 9 7.500% 89.167% ## ( 4400, 6600 ] 10 8.333% 97.500% ## ( 6600, 9900 ] 2 1.667% 99.167% ( 9900, 14000 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 43.5 total, 5.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 158.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.496 H:M:S, 54.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 190.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.232 H:M:S, 43.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/06-22:38:23 ... thread 0: (1000000,8000000) ops and (193556.2,165114.0) ops/second in (5.166457,48.451387) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.54 GB 125.9 6.0 0.0 6.0 13.5 7.6 0.0 1.8 119.6 271.1 51.10 43.51 128 0.399 6204K 6745 0.0 0.0 L1 13/0 865.37 MB 86.5 5.8 5.8 0.0 5.7 5.7 0.2 1.0 205.4 202.1 28.82 25.53 3 9.606 6011K 95K 0.0 0.0 L2 3/2 330.28 MB 0.7 1.0 0.8 0.2 1.0 0.8 4.3 1.3 213.9 213.4 4.83 4.46 3 1.610 435K 217 0.0 0.0 L3 21/3 1.13 GB 1.0 6.4 4.3 2.2 6.4 4.2 0.6 1.5 166.1 165.0 39.58 30.22 19 2.083 6096K 10K 0.0 0.0 L4 176/0 9.46 GB 1.0 3.7 3.5 0.2 3.7 3.5 1.0 1.0 116.4 116.2 32.72 18.47 48 0.682 3682K 3338 0.0 0.0 L5 1092/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1315/9 103.55 GB 0.0 22.9 14.4 8.5 30.3 21.8 10.8 4.0 149.3 197.6 157.05 122.19 201 0.781 22M 117K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.9 14.4 8.5 30.3 21.8 10.7 4.0 149.3 197.6 157.05 122.19 201 0.781 22M 117K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.9 14.4 8.5 22.7 14.2 0.0 0.0 179.4 178.1 130.74 102.31 94 1.391 22M 117K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 294.5 26.31 19.88 107 0.246 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.7 total, 48.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.31 GB write, 637.94 MB/s write, 22.90 GB read, 481.96 MB/s read, 157.1 seconds Interval compaction: 30.31 GB write, 640.58 MB/s write, 22.90 GB read, 483.96 MB/s read, 157.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 64, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 64, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3188099 Average: 3.1662 StdDev: 35.48 Min: 0 Median: 1.5234 Max: 13636 Percentiles: P50: 1.52 P75: 1.93 P99: 7.99 P99.9: 156.41 P99.99: 499.06 ------------------------------------------------------ [ 0, 1 ] 575822 18.062% 18.062% #### ( 1, 2 ] 1945353 61.019% 79.081% ############ ( 2, 3 ] 370624 11.625% 90.706% ## ( 3, 4 ] 126171 3.958% 94.664% # ( 4, 6 ] 124924 3.918% 98.582% # ( 6, 10 ] 26764 0.839% 99.422% ( 10, 15 ] 4884 0.153% 99.575% ( 15, 22 ] 558 0.018% 99.592% ( 22, 34 ] 53 0.002% 99.594% ( 34, 51 ] 25 0.001% 99.595% ( 51, 76 ] 31 0.001% 99.596% ( 76, 110 ] 4777 0.150% 99.746% ( 110, 170 ] 6367 0.200% 99.945% ( 170, 250 ] 577 0.018% 99.963% ( 250, 380 ] 518 0.016% 99.980% ( 380, 580 ] 558 0.018% 99.997% ( 580, 870 ] 290 0.009% 100.006% ( 870, 1300 ] 157 0.005% 100.011% ( 1300, 1900 ] 102 0.003% 100.014% ( 1900, 2900 ] 93 0.003% 100.017% ( 2900, 4400 ] 67 0.002% 100.019% ( 4400, 6600 ] 16 0.001% 100.020% ( 6600, 9900 ] 13 0.000% 100.020% ( 9900, 14000 ] 3 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1184385 Average: 6.6452 StdDev: 108.45 Min: 1 Median: 2.1774 Max: 25109 Percentiles: P50: 2.18 P75: 2.98 P99: 9.34 P99.9: 15.48 P99.99: 201.36 ------------------------------------------------------ [ 0, 1 ] 6716 0.567% 0.567% ( 1, 2 ] 520095 43.913% 44.480% ######### ( 2, 3 ] 368555 31.118% 75.598% ###### ( 3, 4 ] 116702 9.853% 85.451% ## ( 4, 6 ] 134285 11.338% 96.789% ## ( 6, 10 ] 31372 2.649% 99.438% # ( 10, 15 ] 5436 0.459% 99.897% ( 15, 22 ] 588 0.050% 99.946% ( 22, 34 ] 42 0.004% 99.950% ( 34, 51 ] 13 0.001% 99.951% ( 51, 76 ] 7 0.001% 99.952% ( 76, 110 ] 98 0.008% 99.960% ( 110, 170 ] 230 0.019% 99.979% ( 170, 250 ] 328 0.028% 100.007% ( 250, 380 ] 459 0.039% 100.046% ( 380, 580 ] 542 0.046% 100.091% ( 580, 870 ] 595 0.050% 100.142% ( 870, 1300 ] 409 0.035% 100.176% ( 1300, 1900 ] 235 0.020% 100.196% ( 1900, 2900 ] 266 0.022% 100.219% ( 2900, 4400 ] 270 0.023% 100.241% ( 4400, 6600 ] 74 0.006% 100.248% ( 6600, 9900 ] 47 0.004% 100.252% ( 9900, 14000 ] 10 0.001% 100.252% ( 14000, 22000 ] 2 0.000% 100.253% ( 22000, 33000 ] 1 0.000% 100.253% ** Level 2 read latency histogram (micros): Count: 272821 Average: 4.4100 StdDev: 66.19 Min: 1 Median: 1.8161 Max: 8594 Percentiles: P50: 1.82 P75: 2.69 P99: 8.58 P99.9: 19.10 P99.99: 554.87 ------------------------------------------------------ [ 0, 1 ] 21109 7.737% 7.737% ## ( 1, 2 ] 141285 51.787% 59.524% ########## ( 2, 3 ] 61263 22.455% 81.979% #### ( 3, 4 ] 20250 7.422% 89.402% # ( 4, 6 ] 23387 8.572% 97.974% ## ( 6, 10 ] 4340 1.591% 99.565% ( 10, 15 ] 862 0.316% 99.881% ( 15, 22 ] 89 0.033% 99.913% ( 22, 34 ] 5 0.002% 99.915% ( 34, 51 ] 1 0.000% 99.916% ( 51, 76 ] 3 0.001% 99.917% ( 76, 110 ] 31 0.011% 99.928% ( 110, 170 ] 50 0.018% 99.946% ( 170, 250 ] 37 0.014% 99.960% ( 250, 380 ] 38 0.014% 99.974% ( 380, 580 ] 50 0.018% 99.992% ( 580, 870 ] 43 0.016% 100.008% ( 870, 1300 ] 45 0.016% 100.025% ( 1300, 1900 ] 27 0.010% 100.034% ( 1900, 2900 ] 39 0.014% 100.049% ( 2900, 4400 ] 45 0.016% 100.065% ( 4400, 6600 ] 5 0.002% 100.067% ( 6600, 9900 ] 1 0.000% 100.067% ** Level 3 read latency histogram (micros): Count: 1376992 Average: 8.6262 StdDev: 133.70 Min: 0 Median: 2.1978 Max: 27392 Percentiles: P50: 2.20 P75: 3.01 P99: 9.50 P99.9: 186.88 P99.99: 503.95 ------------------------------------------------------ [ 0, 1 ] 12483 0.907% 0.907% ( 1, 2 ] 591513 42.957% 43.863% ######### ( 2, 3 ] 427200 31.024% 74.888% ###### ( 3, 4 ] 138341 10.047% 84.934% ## ( 4, 6 ] 162696 11.815% 96.750% ## ( 6, 10 ] 35451 2.575% 99.324% # ( 10, 15 ] 6546 0.475% 99.799% ( 15, 22 ] 762 0.055% 99.855% ( 22, 34 ] 71 0.005% 99.860% ( 34, 51 ] 35 0.003% 99.862% ( 51, 76 ] 20 0.001% 99.864% ( 76, 110 ] 131 0.010% 99.873% ( 110, 170 ] 293 0.021% 99.895% ( 170, 250 ] 346 0.025% 99.920% ( 250, 380 ] 517 0.038% 99.957% ( 380, 580 ] 725 0.053% 100.010% ( 580, 870 ] 855 0.062% 100.072% ( 870, 1300 ] 814 0.059% 100.131% ( 1300, 1900 ] 519 0.038% 100.169% ( 1900, 2900 ] 581 0.042% 100.211% ( 2900, 4400 ] 540 0.039% 100.250% ( 4400, 6600 ] 168 0.012% 100.263% ( 6600, 9900 ] 45 0.003% 100.266% ( 9900, 14000 ] 8 0.001% 100.266% ( 14000, 22000 ] 7 0.001% 100.267% ( 22000, 33000 ] 2 0.000% 100.267% ** Level 4 read latency histogram (micros): Count: 47726 Average: 99.9714 StdDev: 493.22 Min: 0 Median: 2.2703 Max: 9808 Percentiles: P50: 2.27 P75: 3.39 P99: 2810.47 P99.9: 5666.70 P99.99: 6950.02 ------------------------------------------------------ [ 0, 1 ] 625 1.310% 1.310% ( 1, 2 ] 19598 41.064% 42.373% ######## ( 2, 3 ] 13468 28.219% 70.593% ###### ( 3, 4 ] 5391 11.296% 81.888% ## ( 4, 6 ] 3991 8.362% 90.251% ## ( 6, 10 ] 1162 2.435% 92.685% ( 10, 15 ] 256 0.536% 93.222% ( 15, 22 ] 38 0.080% 93.301% ( 22, 34 ] 35 0.073% 93.375% ( 34, 51 ] 13 0.027% 93.402% ( 51, 76 ] 6 0.013% 93.414% ( 76, 110 ] 7 0.015% 93.429% ( 110, 170 ] 43 0.090% 93.519% ( 170, 250 ] 132 0.277% 93.796% ( 250, 380 ] 186 0.390% 94.186% ( 380, 580 ] 394 0.826% 95.011% ( 580, 870 ] 595 1.247% 96.258% ( 870, 1300 ] 601 1.259% 97.517% ( 1300, 1900 ] 400 0.838% 98.355% ( 1900, 2900 ] 338 0.708% 99.063% ( 2900, 4400 ] 344 0.721% 99.784% ( 4400, 6600 ] 96 0.201% 99.985% ( 6600, 9900 ] 21 0.044% 100.029% ** Level 5 read latency histogram (micros): Count: 280 Average: 1756.9750 StdDev: 1838.22 Min: 97 Median: 958.9655 Max: 10170 Percentiles: P50: 958.97 P75: 2556.25 P99: 8415.00 P99.9: 10170.00 P99.99: 10170.00 ------------------------------------------------------ ( 76, 110 ] 2 0.714% 0.714% ( 110, 170 ] 19 6.786% 7.500% # ( 170, 250 ] 16 5.714% 13.214% # ( 250, 380 ] 27 9.643% 22.857% ## ( 380, 580 ] 34 12.143% 35.000% ## ( 580, 870 ] 36 12.857% 47.857% ### ( 870, 1300 ] 29 10.357% 58.214% ## ( 1300, 1900 ] 26 9.286% 67.500% ## ( 1900, 2900 ] 32 11.429% 78.929% ## ( 2900, 4400 ] 25 8.929% 87.857% ## ( 4400, 6600 ] 29 10.357% 98.214% ## ( 6600, 9900 ] 4 1.429% 99.643% ( 9900, 14000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 48.7 total, 5.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 161.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.693 H:M:S, 52.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 190.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.197 H:M:S, 42.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/06-22:38:27 ... thread 0: (1000000,9000000) ops and (298460.8,173738.8) ops/second in (3.350524,51.801911) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/7 2.52 GB 100.7 6.8 0.0 6.8 15.4 8.5 0.0 1.8 121.1 272.6 57.74 49.57 144 0.401 7099K 7762 0.0 0.0 L1 13/13 865.37 MB 0.0 5.8 5.8 0.0 5.7 5.7 0.2 1.0 205.4 202.1 28.82 25.53 3 9.606 6011K 95K 0.0 0.0 L2 1/0 72.73 MB 0.7 1.0 0.8 0.2 1.0 0.8 4.3 1.3 213.9 213.4 4.83 4.46 3 1.610 435K 217 0.0 0.0 L3 16/0 958.11 MB 1.0 6.8 4.5 2.3 6.8 4.5 0.6 1.5 167.4 166.3 41.78 32.04 21 1.989 6521K 12K 0.0 0.0 L4 180/0 9.60 GB 1.0 4.1 3.9 0.2 4.1 3.9 1.1 1.0 119.9 119.6 34.97 20.29 53 0.660 4054K 3528 0.0 0.0 L5 1096/0 90.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1320/20 104.53 GB 0.0 24.5 15.0 9.6 32.9 23.3 11.2 3.9 149.5 200.6 168.13 131.90 224 0.751 24M 119K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.5 15.0 9.6 32.9 23.3 11.1 3.9 149.5 200.6 168.13 131.90 224 0.751 24M 119K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.5 15.0 9.6 24.4 14.8 0.0 0.0 181.1 180.0 138.75 109.38 104 1.334 24M 119K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 298.0 29.38 22.52 120 0.245 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.0 total, 51.8 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.93 GB write, 648.51 MB/s write, 24.54 GB read, 483.27 MB/s read, 168.1 seconds Interval compaction: 32.93 GB write, 651.02 MB/s write, 24.54 GB read, 485.14 MB/s read, 168.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 69, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 69, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3485716 Average: 3.1237 StdDev: 34.31 Min: 0 Median: 1.5313 Max: 13636 Percentiles: P50: 1.53 P75: 1.94 P99: 7.81 P99.9: 154.45 P99.99: 479.47 ------------------------------------------------------ [ 0, 1 ] 606864 17.410% 17.410% ### ( 1, 2 ] 2138037 61.337% 78.747% ############ ( 2, 3 ] 420229 12.056% 90.803% ## ( 3, 4 ] 137742 3.952% 94.754% # ( 4, 6 ] 134715 3.865% 98.619% # ( 6, 10 ] 29255 0.839% 99.459% ( 10, 15 ] 5142 0.148% 99.606% ( 15, 22 ] 580 0.017% 99.623% ( 22, 34 ] 55 0.002% 99.624% ( 34, 51 ] 26 0.001% 99.625% ( 51, 76 ] 33 0.001% 99.626% ( 76, 110 ] 4792 0.137% 99.763% ( 110, 170 ] 6427 0.184% 99.948% ( 170, 250 ] 627 0.018% 99.966% ( 250, 380 ] 549 0.016% 99.982% ( 380, 580 ] 594 0.017% 99.999% ( 580, 870 ] 334 0.010% 100.008% ( 870, 1300 ] 169 0.005% 100.013% ( 1300, 1900 ] 108 0.003% 100.016% ( 1900, 2900 ] 96 0.003% 100.019% ( 2900, 4400 ] 68 0.002% 100.021% ( 4400, 6600 ] 16 0.000% 100.021% ( 6600, 9900 ] 13 0.000% 100.022% ( 9900, 14000 ] 3 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1232066 Average: 6.4998 StdDev: 106.35 Min: 1 Median: 2.1506 Max: 25109 Percentiles: P50: 2.15 P75: 2.96 P99: 9.32 P99.9: 16.55 P99.99: 204.74 ------------------------------------------------------ [ 0, 1 ] 8921 0.724% 0.724% ( 1, 2 ] 549975 44.638% 45.363% ######### ( 2, 3 ] 379380 30.792% 76.155% ###### ( 3, 4 ] 118626 9.628% 85.783% ## ( 4, 6 ] 136094 11.046% 96.829% ## ( 6, 10 ] 32230 2.616% 99.445% # ( 10, 15 ] 5476 0.444% 99.889% ( 15, 22 ] 595 0.048% 99.938% ( 22, 34 ] 42 0.003% 99.941% ( 34, 51 ] 13 0.001% 99.942% ( 51, 76 ] 7 0.001% 99.943% ( 76, 110 ] 181 0.015% 99.957% ( 110, 170 ] 256 0.021% 99.978% ( 170, 250 ] 338 0.027% 100.006% ( 250, 380 ] 468 0.038% 100.044% ( 380, 580 ] 545 0.044% 100.088% ( 580, 870 ] 597 0.048% 100.136% ( 870, 1300 ] 409 0.033% 100.169% ( 1300, 1900 ] 235 0.019% 100.188% ( 1900, 2900 ] 266 0.022% 100.210% ( 2900, 4400 ] 270 0.022% 100.232% ( 4400, 6600 ] 74 0.006% 100.238% ( 6600, 9900 ] 47 0.004% 100.242% ( 9900, 14000 ] 10 0.001% 100.243% ( 14000, 22000 ] 2 0.000% 100.243% ( 22000, 33000 ] 1 0.000% 100.243% ** Level 2 read latency histogram (micros): Count: 272821 Average: 4.4100 StdDev: 66.19 Min: 1 Median: 1.8161 Max: 8594 Percentiles: P50: 1.82 P75: 2.69 P99: 8.58 P99.9: 19.10 P99.99: 554.87 ------------------------------------------------------ [ 0, 1 ] 21109 7.737% 7.737% ## ( 1, 2 ] 141285 51.787% 59.524% ########## ( 2, 3 ] 61263 22.455% 81.979% #### ( 3, 4 ] 20250 7.422% 89.402% # ( 4, 6 ] 23387 8.572% 97.974% ## ( 6, 10 ] 4340 1.591% 99.565% ( 10, 15 ] 862 0.316% 99.881% ( 15, 22 ] 89 0.033% 99.913% ( 22, 34 ] 5 0.002% 99.915% ( 34, 51 ] 1 0.000% 99.916% ( 51, 76 ] 3 0.001% 99.917% ( 76, 110 ] 31 0.011% 99.928% ( 110, 170 ] 50 0.018% 99.946% ( 170, 250 ] 37 0.014% 99.960% ( 250, 380 ] 38 0.014% 99.974% ( 380, 580 ] 50 0.018% 99.992% ( 580, 870 ] 43 0.016% 100.008% ( 870, 1300 ] 45 0.016% 100.025% ( 1300, 1900 ] 27 0.010% 100.034% ( 1900, 2900 ] 39 0.014% 100.049% ( 2900, 4400 ] 45 0.016% 100.065% ( 4400, 6600 ] 5 0.002% 100.067% ( 6600, 9900 ] 1 0.000% 100.067% ** Level 3 read latency histogram (micros): Count: 1498641 Average: 8.2443 StdDev: 128.46 Min: 0 Median: 2.1802 Max: 27392 Percentiles: P50: 2.18 P75: 2.99 P99: 9.43 P99.9: 132.74 P99.99: 421.06 ------------------------------------------------------ [ 0, 1 ] 14294 0.954% 0.954% ( 1, 2 ] 651577 43.478% 44.432% ######### ( 2, 3 ] 463207 30.908% 75.340% ###### ( 3, 4 ] 148402 9.902% 85.243% ## ( 4, 6 ] 173482 11.576% 96.819% ## ( 6, 10 ] 38075 2.541% 99.359% # ( 10, 15 ] 6890 0.460% 99.819% ( 15, 22 ] 793 0.053% 99.872% ( 22, 34 ] 74 0.005% 99.877% ( 34, 51 ] 36 0.002% 99.879% ( 51, 76 ] 21 0.001% 99.881% ( 76, 110 ] 161 0.011% 99.891% ( 110, 170 ] 344 0.023% 99.914% ( 170, 250 ] 404 0.027% 99.941% ( 250, 380 ] 571 0.038% 99.979% ( 380, 580 ] 780 0.052% 100.031% ( 580, 870 ] 879 0.059% 100.090% ( 870, 1300 ] 829 0.055% 100.145% ( 1300, 1900 ] 526 0.035% 100.180% ( 1900, 2900 ] 587 0.039% 100.220% ( 2900, 4400 ] 541 0.036% 100.256% ( 4400, 6600 ] 168 0.011% 100.267% ( 6600, 9900 ] 45 0.003% 100.270% ( 9900, 14000 ] 8 0.001% 100.270% ( 14000, 22000 ] 7 0.000% 100.271% ( 22000, 33000 ] 2 0.000% 100.271% ** Level 4 read latency histogram (micros): Count: 52843 Average: 93.8871 StdDev: 472.36 Min: 0 Median: 2.2475 Max: 9808 Percentiles: P50: 2.25 P75: 3.36 P99: 2668.43 P99.9: 5549.43 P99.99: 6869.61 ------------------------------------------------------ [ 0, 1 ] 741 1.402% 1.402% ( 1, 2 ] 22035 41.699% 43.101% ######## ( 2, 3 ] 14730 27.875% 70.976% ###### ( 3, 4 ] 5907 11.178% 82.155% ## ( 4, 6 ] 4323 8.181% 90.336% ## ( 6, 10 ] 1262 2.388% 92.724% ( 10, 15 ] 273 0.517% 93.240% ( 15, 22 ] 39 0.074% 93.314% ( 22, 34 ] 38 0.072% 93.386% ( 34, 51 ] 13 0.025% 93.411% ( 51, 76 ] 7 0.013% 93.424% ( 76, 110 ] 7 0.013% 93.437% ( 110, 170 ] 90 0.170% 93.607% ( 170, 250 ] 181 0.343% 93.950% ( 250, 380 ] 239 0.452% 94.402% ( 380, 580 ] 478 0.905% 95.307% ( 580, 870 ] 644 1.219% 96.526% ( 870, 1300 ] 635 1.202% 97.727% ( 1300, 1900 ] 409 0.774% 98.501% ( 1900, 2900 ] 343 0.649% 99.150% ( 2900, 4400 ] 346 0.655% 99.805% ( 4400, 6600 ] 96 0.182% 99.987% ( 6600, 9900 ] 21 0.040% 100.026% ** Level 5 read latency histogram (micros): Count: 300 Average: 1699.2033 StdDev: 1809.08 Min: 97 Median: 884.8276 Max: 10170 Percentiles: P50: 884.83 P75: 2488.24 P99: 8250.00 P99.9: 10170.00 P99.99: 10170.00 ------------------------------------------------------ ( 76, 110 ] 2 0.667% 0.667% ( 110, 170 ] 28 9.333% 10.000% ## ( 170, 250 ] 16 5.333% 15.333% # ( 250, 380 ] 27 9.000% 24.333% ## ( 380, 580 ] 37 12.333% 36.667% ## ( 580, 870 ] 39 13.000% 49.667% ### ( 870, 1300 ] 29 9.667% 59.333% ## ( 1300, 1900 ] 27 9.000% 68.333% ## ( 1900, 2900 ] 34 11.333% 79.667% ## ( 2900, 4400 ] 27 9.000% 88.667% ## ( 4400, 6600 ] 29 9.667% 98.333% ## ( 6600, 9900 ] 4 1.333% 99.667% ( 9900, 14000 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 52.0 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 170.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.302 H:M:S, 50.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.610 H:M:S, 18.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-22:38:30 ... thread 0: (1000000,10000000) ops and (301274.8,181418.6) ops/second in (3.319229,55.121140) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.44 GB 195.1 7.6 0.0 7.6 17.1 9.5 0.0 1.8 122.8 275.2 63.60 55.09 160 0.398 7931K 8612 0.0 0.0 L1 13/13 865.37 MB 0.0 5.8 5.8 0.0 5.7 5.7 0.2 1.0 205.4 202.1 28.82 25.53 3 9.606 6011K 95K 0.0 0.0 L2 1/0 72.73 MB 0.7 1.0 0.8 0.2 1.0 0.8 4.3 1.3 213.9 213.4 4.83 4.46 3 1.610 435K 217 0.0 0.0 L3 16/0 958.11 MB 1.0 6.8 4.5 2.3 6.8 4.5 0.6 1.5 167.4 166.3 41.78 32.04 21 1.989 6521K 12K 0.0 0.0 L4 180/0 9.60 GB 1.0 4.1 3.9 0.2 4.1 3.9 1.1 1.0 119.9 119.6 34.97 20.29 53 0.660 4054K 3528 0.0 0.0 L5 1096/0 90.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/20 105.45 GB 0.0 25.3 15.0 10.4 34.7 24.3 11.2 3.7 149.1 204.0 174.00 137.41 240 0.725 24M 120K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.3 15.0 10.4 34.7 24.3 11.1 3.7 149.1 204.0 174.00 137.41 240 0.725 24M 120K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.3 15.0 10.4 25.2 14.8 0.0 0.0 182.9 181.8 141.88 112.46 107 1.326 24M 120K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 302.1 32.12 24.95 133 0.241 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.3 total, 55.1 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.66 GB write, 641.46 MB/s write, 25.34 GB read, 469.07 MB/s read, 174.0 seconds Interval compaction: 34.66 GB write, 643.80 MB/s write, 25.34 GB read, 470.78 MB/s read, 174.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 72, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 72, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3798561 Average: 3.0673 StdDev: 33.09 Min: 0 Median: 1.5356 Max: 13636 Percentiles: P50: 1.54 P75: 1.94 P99: 7.64 P99.9: 151.62 P99.99: 444.64 ------------------------------------------------------ [ 0, 1 ] 642360 16.911% 16.911% ### ( 1, 2 ] 2346792 61.781% 78.692% ############ ( 2, 3 ] 468951 12.345% 91.037% ## ( 3, 4 ] 147191 3.875% 94.912% # ( 4, 6 ] 142420 3.749% 98.661% # ( 6, 10 ] 31447 0.828% 99.489% ( 10, 15 ] 5523 0.145% 99.635% ( 15, 22 ] 604 0.016% 99.651% ( 22, 34 ] 58 0.002% 99.652% ( 34, 51 ] 26 0.001% 99.653% ( 51, 76 ] 34 0.001% 99.654% ( 76, 110 ] 4834 0.127% 99.781% ( 110, 170 ] 6520 0.172% 99.953% ( 170, 250 ] 650 0.017% 99.970% ( 250, 380 ] 574 0.015% 99.985% ( 380, 580 ] 610 0.016% 100.001% ( 580, 870 ] 349 0.009% 100.010% ( 870, 1300 ] 175 0.005% 100.015% ( 1300, 1900 ] 109 0.003% 100.018% ( 1900, 2900 ] 97 0.003% 100.020% ( 2900, 4400 ] 70 0.002% 100.022% ( 4400, 6600 ] 16 0.000% 100.022% ( 6600, 9900 ] 13 0.000% 100.023% ( 9900, 14000 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1311607 Average: 6.2878 StdDev: 103.14 Min: 1 Median: 2.0926 Max: 25109 Percentiles: P50: 2.09 P75: 2.93 P99: 9.29 P99.9: 19.10 P99.99: 220.86 ------------------------------------------------------ [ 0, 1 ] 17721 1.351% 1.351% ( 1, 2 ] 601742 45.878% 47.229% ######### ( 2, 3 ] 392556 29.929% 77.159% ###### ( 3, 4 ] 120789 9.209% 86.368% ## ( 4, 6 ] 138148 10.533% 96.901% ## ( 6, 10 ] 33455 2.551% 99.451% # ( 10, 15 ] 5532 0.422% 99.873% ( 15, 22 ] 603 0.046% 99.919% ( 22, 34 ] 45 0.003% 99.923% ( 34, 51 ] 13 0.001% 99.924% ( 51, 76 ] 7 0.001% 99.924% ( 76, 110 ] 272 0.021% 99.945% ( 110, 170 ] 351 0.027% 99.972% ( 170, 250 ] 382 0.029% 100.001% ( 250, 380 ] 492 0.038% 100.038% ( 380, 580 ] 573 0.044% 100.082% ( 580, 870 ] 604 0.046% 100.128% ( 870, 1300 ] 410 0.031% 100.159% ( 1300, 1900 ] 235 0.018% 100.177% ( 1900, 2900 ] 266 0.020% 100.197% ( 2900, 4400 ] 270 0.021% 100.218% ( 4400, 6600 ] 74 0.006% 100.224% ( 6600, 9900 ] 47 0.004% 100.227% ( 9900, 14000 ] 10 0.001% 100.228% ( 14000, 22000 ] 2 0.000% 100.228% ( 22000, 33000 ] 1 0.000% 100.228% ** Level 2 read latency histogram (micros): Count: 272821 Average: 4.4100 StdDev: 66.19 Min: 1 Median: 1.8161 Max: 8594 Percentiles: P50: 1.82 P75: 2.69 P99: 8.58 P99.9: 19.10 P99.99: 554.87 ------------------------------------------------------ [ 0, 1 ] 21109 7.737% 7.737% ## ( 1, 2 ] 141285 51.787% 59.524% ########## ( 2, 3 ] 61263 22.455% 81.979% #### ( 3, 4 ] 20250 7.422% 89.402% # ( 4, 6 ] 23387 8.572% 97.974% ## ( 6, 10 ] 4340 1.591% 99.565% ( 10, 15 ] 862 0.316% 99.881% ( 15, 22 ] 89 0.033% 99.913% ( 22, 34 ] 5 0.002% 99.915% ( 34, 51 ] 1 0.000% 99.916% ( 51, 76 ] 3 0.001% 99.917% ( 76, 110 ] 31 0.011% 99.928% ( 110, 170 ] 50 0.018% 99.946% ( 170, 250 ] 37 0.014% 99.960% ( 250, 380 ] 38 0.014% 99.974% ( 380, 580 ] 50 0.018% 99.992% ( 580, 870 ] 43 0.016% 100.008% ( 870, 1300 ] 45 0.016% 100.025% ( 1300, 1900 ] 27 0.010% 100.034% ( 1900, 2900 ] 39 0.014% 100.049% ( 2900, 4400 ] 45 0.016% 100.065% ( 4400, 6600 ] 5 0.002% 100.067% ( 6600, 9900 ] 1 0.000% 100.067% ** Level 3 read latency histogram (micros): Count: 1498641 Average: 8.2443 StdDev: 128.46 Min: 0 Median: 2.1802 Max: 27392 Percentiles: P50: 2.18 P75: 2.99 P99: 9.43 P99.9: 132.74 P99.99: 421.06 ------------------------------------------------------ [ 0, 1 ] 14294 0.954% 0.954% ( 1, 2 ] 651577 43.478% 44.432% ######### ( 2, 3 ] 463207 30.908% 75.340% ###### ( 3, 4 ] 148402 9.902% 85.243% ## ( 4, 6 ] 173482 11.576% 96.819% ## ( 6, 10 ] 38075 2.541% 99.359% # ( 10, 15 ] 6890 0.460% 99.819% ( 15, 22 ] 793 0.053% 99.872% ( 22, 34 ] 74 0.005% 99.877% ( 34, 51 ] 36 0.002% 99.879% ( 51, 76 ] 21 0.001% 99.881% ( 76, 110 ] 161 0.011% 99.891% ( 110, 170 ] 344 0.023% 99.914% ( 170, 250 ] 404 0.027% 99.941% ( 250, 380 ] 571 0.038% 99.979% ( 380, 580 ] 780 0.052% 100.031% ( 580, 870 ] 879 0.059% 100.090% ( 870, 1300 ] 829 0.055% 100.145% ( 1300, 1900 ] 526 0.035% 100.180% ( 1900, 2900 ] 587 0.039% 100.220% ( 2900, 4400 ] 541 0.036% 100.256% ( 4400, 6600 ] 168 0.011% 100.267% ( 6600, 9900 ] 45 0.003% 100.270% ( 9900, 14000 ] 8 0.001% 100.270% ( 14000, 22000 ] 7 0.000% 100.271% ( 22000, 33000 ] 2 0.000% 100.271% ** Level 4 read latency histogram (micros): Count: 52843 Average: 93.8871 StdDev: 472.36 Min: 0 Median: 2.2475 Max: 9808 Percentiles: P50: 2.25 P75: 3.36 P99: 2668.43 P99.9: 5549.43 P99.99: 6869.61 ------------------------------------------------------ [ 0, 1 ] 741 1.402% 1.402% ( 1, 2 ] 22035 41.699% 43.101% ######## ( 2, 3 ] 14730 27.875% 70.976% ###### ( 3, 4 ] 5907 11.178% 82.155% ## ( 4, 6 ] 4323 8.181% 90.336% ## ( 6, 10 ] 1262 2.388% 92.724% ( 10, 15 ] 273 0.517% 93.240% ( 15, 22 ] 39 0.074% 93.314% ( 22, 34 ] 38 0.072% 93.386% ( 34, 51 ] 13 0.025% 93.411% ( 51, 76 ] 7 0.013% 93.424% ( 76, 110 ] 7 0.013% 93.437% ( 110, 170 ] 90 0.170% 93.607% ( 170, 250 ] 181 0.343% 93.950% ( 250, 380 ] 239 0.452% 94.402% ( 380, 580 ] 478 0.905% 95.307% ( 580, 870 ] 644 1.219% 96.526% ( 870, 1300 ] 635 1.202% 97.727% ( 1300, 1900 ] 409 0.774% 98.501% ( 1900, 2900 ] 343 0.649% 99.150% ( 2900, 4400 ] 346 0.655% 99.805% ( 4400, 6600 ] 96 0.182% 99.987% ( 6600, 9900 ] 21 0.040% 100.026% ** Level 5 read latency histogram (micros): Count: 300 Average: 1699.2033 StdDev: 1809.08 Min: 97 Median: 884.8276 Max: 10170 Percentiles: P50: 884.83 P75: 2488.24 P99: 8250.00 P99.9: 10170.00 P99.99: 10170.00 ------------------------------------------------------ ( 76, 110 ] 2 0.667% 0.667% ( 110, 170 ] 28 9.333% 10.000% ## ( 170, 250 ] 16 5.333% 15.333% # ( 250, 380 ] 27 9.000% 24.333% ## ( 380, 580 ] 37 12.333% 36.667% ## ( 580, 870 ] 39 13.000% 49.667% ### ( 870, 1300 ] 29 9.667% 59.333% ## ( 1300, 1900 ] 27 9.000% 68.333% ## ( 1900, 2900 ] 34 11.333% 79.667% ## ( 2900, 4400 ] 27 9.000% 88.667% ## ( 4400, 6600 ] 29 9.667% 98.333% ## ( 6600, 9900 ] 4 1.333% 99.667% ( 9900, 14000 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 55.3 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 177.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.976 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 296.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.674 H:M:S, 20.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.688 micros/op 175790 ops/sec 60.003 seconds 10547999 operations; 170.3 MB/s Microseconds per write: Count: 10547999 Average: 5.6884 StdDev: 495.61 Min: 1 Median: 1.7730 Max: 757797 Percentiles: P50: 1.77 P75: 2.80 P99: 8.95 P99.9: 1108.20 P99.99: 2733.22 ------------------------------------------------------ [ 0, 1 ] 1189429 11.276% 11.276% ## ( 1, 2 ] 5284028 50.095% 61.371% ########## ( 2, 3 ] 1805013 17.112% 78.484% ### ( 3, 4 ] 1481925 14.049% 92.533% ### ( 4, 6 ] 594956 5.640% 98.174% # ( 6, 10 ] 118314 1.122% 99.295% ( 10, 15 ] 36502 0.346% 99.641% ( 15, 22 ] 8739 0.083% 99.724% ( 22, 34 ] 1727 0.016% 99.741% ( 34, 51 ] 249 0.002% 99.743% ( 51, 76 ] 48 0.000% 99.743% ( 76, 110 ] 7293 0.069% 99.813% ( 110, 170 ] 2905 0.028% 99.840% ( 170, 250 ] 315 0.003% 99.843% ( 250, 380 ] 169 0.002% 99.845% ( 380, 580 ] 55 0.001% 99.845% ( 580, 870 ] 49 0.000% 99.846% ( 870, 1300 ] 10353 0.098% 99.944% ( 1300, 1900 ] 25 0.000% 99.944% ( 1900, 2900 ] 5821 0.055% 99.999% ( 2900, 4400 ] 43 0.000% 100.000% ( 4400, 6600 ] 7 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 50000, 75000 ] 3 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 5 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 191544 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10547999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10885534968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 602 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30332414 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31155676680 rocksdb.compact.write.bytes COUNT : 30950407215 rocksdb.flush.write.bytes COUNT : 10767220262 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 68 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 342 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10680567808 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4296704 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31262074538 rocksdb.non.last.level.read.count COUNT : 7548546 rocksdb.block.checksum.compute.count COUNT : 7547410 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.408529 P95 : 3.900509 P99 : 7.202550 P100 : 757794.000000 COUNT : 10547999 SUM : 54727238 rocksdb.compaction.times.micros P50 : 837105.263158 P95 : 3880000.000000 P99 : 13580000.000000 P100 : 20308183.000000 COUNT : 110 SUM : 154932774 rocksdb.compaction.times.cpu_micros P50 : 527777.777778 P95 : 3600000.000000 P99 : 13580000.000000 P100 : 18332796.000000 COUNT : 110 SUM : 124969369 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 713.243243 P95 : 11745.000000 P99 : 47620.000000 P100 : 177827.000000 COUNT : 142 SUM : 482753 rocksdb.compaction.outfile.sync.micros P50 : 1246.250000 P95 : 49716.666667 P99 : 93200.000000 P100 : 109225.000000 COUNT : 384 SUM : 3364574 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 119.310345 P95 : 2327.777778 P99 : 4222.142857 P100 : 4482.000000 COUNT : 283 SUM : 130858 rocksdb.table.open.io.micros P50 : 1780.000000 P95 : 12046.470588 P99 : 20392.000000 P100 : 27096.000000 COUNT : 602 SUM : 1853774 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.822206 P95 : 8.499775 P99 : 12.645072 P100 : 27395.000000 COUNT : 7545635 SUM : 56421700 rocksdb.read.block.get.micros P50 : 583.333333 P95 : 4765.106383 P99 : 8339.294118 P100 : 21794.000000 COUNT : 1204 SUM : 1477146 rocksdb.write.raw.block.micros P50 : 0.515908 P95 : 0.980226 P99 : 2.952534 P100 : 89857.000000 COUNT : 10110788 SUM : 23895030 rocksdb.numfiles.in.singlecompaction P50 : 2.045455 P95 : 5.414286 P99 : 16.365000 P100 : 20.000000 COUNT : 161 SUM : 525 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566461 P95 : 1253.845696 P99 : 2666.024619 P100 : 757609.000000 COUNT : 138357 SUM : 30347693 rocksdb.sst.read.micros P50 : 1.723763 P95 : 5.164443 P99 : 9.193739 P100 : 27392.000000 COUNT : 7548778 SUM : 41314449 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10547999 SUM : 10885534968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215957.446809 P95 : 530100.000000 P99 : 829550.000000 P100 : 956740.000000 COUNT : 142 SUM : 33723942 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 364 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0