[2024-11-17 04:27:55.605715] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-17 04:27:55.605987] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid179764 ] Set seed to 1731814075599115 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 04:27:55.719242] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 04:27:55.740691] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 04:27:55.740731] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 179764' to capture a snapshot of events at runtime. [2024-11-17 04:27:55.740741] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 04:27:55.740753] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 04:27:55.740762] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid179764 for offline analysis/debug. [2024-11-17 04:27:55.741320] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 04:28:00 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-04:28:03 ... thread 0: (1000000,1000000) ops and (327801.8,327801.8) ops/second in (3.050624,3.050624) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.99 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 346.3 2.55 2.29 12 0.212 0 0 0.0 0.0 L2 3/2 237.21 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 252.1 252.0 1.38 1.33 2 0.692 354K 175 0.0 0.0 L3 10/0 818.89 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.8 313.1 3.93 3.62 14 0.281 354K 175 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.8 313.1 3.93 3.62 14 0.281 354K 175 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 252.1 252.0 1.38 1.33 2 0.692 354K 175 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 346.3 2.55 2.29 12 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 375.18 MB/s write, 0.34 GB read, 106.35 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 403.15 MB/s write, 0.34 GB read, 114.28 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 135353 Average: 2.0805 StdDev: 16.97 Min: 1 Median: 1.3482 Max: 3334 Percentiles: P50: 1.35 P75: 1.77 P99: 5.60 P99.9: 12.16 P99.99: 53.90 ------------------------------------------------------ [ 0, 1 ] 39829 29.426% 29.426% ###### ( 1, 2 ] 79982 59.091% 88.517% ############ ( 2, 3 ] 8975 6.631% 95.148% # ( 3, 4 ] 3229 2.386% 97.534% ( 4, 6 ] 2476 1.829% 99.363% ( 6, 10 ] 659 0.487% 99.850% ( 10, 15 ] 161 0.119% 99.969% ( 15, 22 ] 26 0.019% 99.988% ( 22, 34 ] 3 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 4 0.003% 99.994% ( 110, 170 ] 7 0.005% 99.999% ( 170, 250 ] 4 0.003% 100.002% ( 250, 380 ] 2 0.001% 100.004% ( 580, 870 ] 1 0.001% 100.004% ( 870, 1300 ] 4 0.003% 100.007% ( 1300, 1900 ] 1 0.001% 100.008% ( 1900, 2900 ] 3 0.002% 100.010% ( 2900, 4400 ] 2 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 12310 Average: 3.5310 StdDev: 37.85 Min: 1 Median: 1.2724 Max: 2110 Percentiles: P50: 1.27 P75: 1.74 P99: 11.90 P99.9: 426.00 P99.99: 2110.00 ------------------------------------------------------ [ 0, 1 ] 4354 35.370% 35.370% ####### ( 1, 2 ] 6612 53.712% 89.082% ########### ( 2, 3 ] 799 6.491% 95.573% # ( 3, 4 ] 137 1.113% 96.686% ( 4, 6 ] 164 1.332% 98.018% ( 6, 10 ] 111 0.902% 98.920% ( 10, 15 ] 26 0.211% 99.131% ( 15, 22 ] 11 0.089% 99.220% ( 22, 34 ] 4 0.032% 99.253% ( 34, 51 ] 35 0.284% 99.537% ( 51, 76 ] 13 0.106% 99.643% ( 76, 110 ] 8 0.065% 99.708% ( 110, 170 ] 4 0.032% 99.740% ( 170, 250 ] 14 0.114% 99.854% ( 250, 380 ] 5 0.041% 99.894% ( 380, 580 ] 3 0.024% 99.919% ( 580, 870 ] 6 0.049% 99.968% ( 1300, 1900 ] 2 0.016% 99.984% ( 1900, 2900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 70124 Average: 2.0135 StdDev: 4.64 Min: 0 Median: 1.3907 Max: 711 Percentiles: P50: 1.39 P75: 1.79 P99: 5.61 P99.9: 10.17 P99.99: 209.50 ------------------------------------------------------ [ 0, 1 ] 18017 25.693% 25.693% ##### ( 1, 2 ] 43629 62.217% 87.910% ############ ( 2, 3 ] 4856 6.925% 94.835% # ( 3, 4 ] 1782 2.541% 97.376% # ( 4, 6 ] 1419 2.024% 99.400% ( 6, 10 ] 350 0.499% 99.899% ( 10, 15 ] 56 0.080% 99.979% ( 15, 22 ] 3 0.004% 99.983% ( 22, 34 ] 1 0.001% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.990% ( 170, 250 ] 2 0.003% 99.993% ( 250, 380 ] 4 0.006% 99.999% ( 580, 870 ] 2 0.003% 100.001% ** Level 3 read latency histogram (micros): Count: 50 Average: 1455.3200 StdDev: 1065.28 Min: 129 Median: 1300.0000 Max: 3631 Percentiles: P50: 1300.00 P75: 2507.14 P99: 3631.00 P99.9: 3631.00 P99.99: 3631.00 ------------------------------------------------------ ( 110, 170 ] 3 6.000% 6.000% # ( 170, 250 ] 1 2.000% 8.000% ( 250, 380 ] 5 10.000% 18.000% ## ( 380, 580 ] 7 14.000% 32.000% ### ( 580, 870 ] 6 12.000% 44.000% ## ( 870, 1300 ] 3 6.000% 50.000% # ( 1300, 1900 ] 4 8.000% 58.000% ## ( 1900, 2900 ] 14 28.000% 86.000% ###### ( 2900, 4400 ] 7 14.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 25 Average: 1599.0400 StdDev: 943.36 Min: 273 Median: 1487.5000 Max: 3947 Percentiles: P50: 1487.50 P75: 2087.50 P99: 3947.00 P99.9: 3947.00 P99.99: 3947.00 ------------------------------------------------------ ( 250, 380 ] 1 4.000% 4.000% # ( 380, 580 ] 4 16.000% 20.000% ### ( 580, 870 ] 1 4.000% 24.000% # ( 870, 1300 ] 4 16.000% 40.000% ### ( 1300, 1900 ] 8 32.000% 72.000% ###### ( 1900, 2900 ] 4 16.000% 88.000% ### ( 2900, 4400 ] 3 12.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 300.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.417 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.417 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/17-04:28:06 ... thread 0: (1000000,2000000) ops and (346387.0,336838.2) ops/second in (2.886944,5.937568) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.29 GB 100.7 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.4 311.4 8.49 7.83 29 0.293 831K 840 0.0 0.0 L1 1/0 2.85 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 237.8 237.5 1.32 1.28 1 1.324 319K 430 0.0 0.0 L2 2/1 146.68 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.1 252.0 1.38 1.33 2 0.692 354K 175 0.0 0.0 L3 19/10 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 226.0 226.0 0.83 0.76 1 0.828 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 123.4 123.4 1.36 0.95 1 1.364 170K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/15 97.92 GB 0.0 1.8 0.8 1.0 3.6 2.6 0.7 2.0 137.3 273.6 13.39 12.14 34 0.394 1866K 1445 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.8 1.0 3.6 2.6 0.7 2.0 137.3 273.6 13.39 12.14 34 0.394 1866K 1445 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.8 1.0 1.8 0.8 0.0 0.0 226.4 226.2 8.12 7.47 8 1.015 1866K 1445 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 346.5 5.27 4.67 26 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.58 GB write, 594.10 MB/s write, 1.80 GB read, 298.09 MB/s read, 13.4 seconds Interval compaction: 3.58 GB write, 616.86 MB/s write, 1.80 GB read, 309.51 MB/s read, 13.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 378696 Average: 2.2465 StdDev: 13.52 Min: 1 Median: 1.4923 Max: 3334 Percentiles: P50: 1.49 P75: 1.89 P99: 5.80 P99.9: 11.25 P99.99: 18.15 ------------------------------------------------------ [ 0, 1 ] 71604 18.908% 18.908% #### ( 1, 2 ] 239164 63.155% 82.063% ############# ( 2, 3 ] 39879 10.531% 92.593% ## ( 3, 4 ] 14339 3.786% 96.380% # ( 4, 6 ] 11041 2.916% 99.295% # ( 6, 10 ] 2186 0.577% 99.872% ( 10, 15 ] 420 0.111% 99.983% ( 15, 22 ] 58 0.015% 99.999% ( 22, 34 ] 7 0.002% 100.001% ( 34, 51 ] 1 0.000% 100.001% ( 51, 76 ] 4 0.001% 100.002% ( 76, 110 ] 1 0.000% 100.002% ( 110, 170 ] 12 0.003% 100.005% ( 170, 250 ] 13 0.003% 100.009% ( 250, 380 ] 6 0.002% 100.010% ( 380, 580 ] 2 0.001% 100.011% ( 580, 870 ] 7 0.002% 100.013% ( 870, 1300 ] 9 0.002% 100.015% ( 1300, 1900 ] 2 0.001% 100.016% ( 1900, 2900 ] 4 0.001% 100.017% ( 2900, 4400 ] 3 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 12330 Average: 3.8040 StdDev: 40.29 Min: 1 Median: 1.2727 Max: 2110 Percentiles: P50: 1.27 P75: 1.74 P99: 13.02 P99.9: 604.29 P99.99: 2110.00 ------------------------------------------------------ [ 0, 1 ] 4361 35.369% 35.369% ####### ( 1, 2 ] 6615 53.650% 89.019% ########### ( 2, 3 ] 802 6.504% 95.523% # ( 3, 4 ] 137 1.111% 96.634% ( 4, 6 ] 164 1.330% 97.964% ( 6, 10 ] 112 0.908% 98.873% ( 10, 15 ] 26 0.211% 99.084% ( 15, 22 ] 11 0.089% 99.173% ( 22, 34 ] 4 0.032% 99.205% ( 34, 51 ] 35 0.284% 99.489% ( 51, 76 ] 13 0.105% 99.594% ( 76, 110 ] 8 0.065% 99.659% ( 110, 170 ] 4 0.032% 99.692% ( 170, 250 ] 15 0.122% 99.813% ( 250, 380 ] 6 0.049% 99.862% ( 380, 580 ] 4 0.032% 99.895% ( 580, 870 ] 8 0.065% 99.959% ( 870, 1300 ] 1 0.008% 99.968% ( 1300, 1900 ] 2 0.016% 99.984% ( 1900, 2900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 76111 Average: 2.0597 StdDev: 4.47 Min: 0 Median: 1.4203 Max: 711 Percentiles: P50: 1.42 P75: 1.82 P99: 5.70 P99.9: 10.74 P99.99: 185.56 ------------------------------------------------------ [ 0, 1 ] 18264 23.997% 23.997% ##### ( 1, 2 ] 47089 61.869% 85.865% ############ ( 2, 3 ] 6380 8.382% 94.248% ## ( 3, 4 ] 2124 2.791% 97.039% # ( 4, 6 ] 1761 2.314% 99.352% ( 6, 10 ] 407 0.535% 99.887% ( 10, 15 ] 67 0.088% 99.975% ( 15, 22 ] 5 0.007% 99.982% ( 22, 34 ] 2 0.003% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 2 0.003% 99.989% ( 170, 250 ] 2 0.003% 99.992% ( 250, 380 ] 4 0.005% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 184938 Average: 3.6255 StdDev: 36.22 Min: 1 Median: 1.6903 Max: 3790 Percentiles: P50: 1.69 P75: 2.35 P99: 9.16 P99.9: 181.12 P99.99: 442.02 ------------------------------------------------------ [ 0, 1 ] 16715 9.038% 9.038% ## ( 1, 2 ] 109745 59.342% 68.380% ############ ( 2, 3 ] 34752 18.791% 87.171% #### ( 3, 4 ] 9661 5.224% 92.395% # ( 4, 6 ] 9419 5.093% 97.488% # ( 6, 10 ] 3541 1.915% 99.403% ( 10, 15 ] 458 0.248% 99.650% ( 15, 22 ] 106 0.057% 99.707% ( 22, 34 ] 25 0.014% 99.721% ( 34, 51 ] 7 0.004% 99.725% ( 51, 76 ] 2 0.001% 99.726% ( 76, 110 ] 76 0.041% 99.767% ( 110, 170 ] 234 0.127% 99.893% ( 170, 250 ] 94 0.051% 99.944% ( 250, 380 ] 70 0.038% 99.982% ( 380, 580 ] 50 0.027% 100.009% ( 580, 870 ] 26 0.014% 100.023% ( 870, 1300 ] 9 0.005% 100.028% ( 1300, 1900 ] 8 0.004% 100.032% ( 1900, 2900 ] 15 0.008% 100.041% ( 2900, 4400 ] 9 0.005% 100.045% ** Level 4 read latency histogram (micros): Count: 315 Average: 132.9556 StdDev: 506.44 Min: 0 Median: 1.8950 Max: 3947 Percentiles: P50: 1.89 P75: 6.55 P99: 2862.50 P99.9: 3947.00 P99.99: 3947.00 ------------------------------------------------------ [ 0, 1 ] 51 16.190% 16.190% ### ( 1, 2 ] 119 37.778% 53.968% ######## ( 2, 3 ] 43 13.651% 67.619% ### ( 3, 4 ] 13 4.127% 71.746% # ( 4, 6 ] 6 1.905% 73.651% ( 6, 10 ] 31 9.841% 83.492% ## ( 10, 15 ] 20 6.349% 89.841% # ( 15, 22 ] 3 0.952% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 2 0.635% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 4 1.270% 93.651% ( 580, 870 ] 1 0.317% 93.968% ( 870, 1300 ] 4 1.270% 95.238% ( 1300, 1900 ] 8 2.540% 97.778% # ( 1900, 2900 ] 4 1.270% 99.048% ( 2900, 4400 ] 3 0.952% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 319.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.607 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 340.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.190 H:M:S, 6.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-04:28:09 ... thread 0: (1000000,3000000) ops and (331526.6,335048.9) ops/second in (3.016349,8.953917) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.27 GB 6.3 1.9 0.0 1.9 4.7 2.8 0.0 1.7 125.1 306.5 15.61 14.58 47 0.332 1982K 2136 0.0 0.0 L1 1/1 2.85 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 237.8 237.5 1.32 1.28 1 1.324 319K 430 0.0 0.0 L2 1/0 96.66 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.1 252.0 1.38 1.33 2 0.692 354K 175 0.0 0.0 L3 19/0 843.72 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 236.2 235.8 4.47 4.09 2 2.236 1072K 1586 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 123.4 123.4 1.36 0.95 1 1.364 170K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/12 98.90 GB 0.0 3.8 0.9 2.9 6.5 3.7 1.4 2.4 159.0 276.2 24.16 22.23 53 0.456 3900K 4327 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 0.9 2.9 6.5 3.7 1.4 2.4 159.0 276.2 24.16 22.23 53 0.456 3900K 4327 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 0.9 2.9 3.7 0.9 0.0 0.0 238.8 238.6 16.08 15.05 13 1.237 3900K 4327 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.1 8.07 7.18 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.52 GB write, 726.49 MB/s write, 3.75 GB read, 418.28 MB/s read, 24.2 seconds Interval compaction: 6.52 GB write, 744.95 MB/s write, 3.75 GB read, 428.91 MB/s read, 24.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 634613 Average: 2.1901 StdDev: 12.46 Min: 1 Median: 1.4645 Max: 3336 Percentiles: P50: 1.46 P75: 1.86 P99: 5.71 P99.9: 11.30 P99.99: 30.72 ------------------------------------------------------ [ 0, 1 ] 130636 20.585% 20.585% #### ( 1, 2 ] 401904 63.331% 83.916% ############# ( 2, 3 ] 60419 9.521% 93.436% ## ( 3, 4 ] 21795 3.434% 96.871% # ( 4, 6 ] 15841 2.496% 99.367% ( 6, 10 ] 3214 0.506% 99.873% ( 10, 15 ] 653 0.103% 99.976% ( 15, 22 ] 81 0.013% 99.989% ( 22, 34 ] 9 0.001% 99.990% ( 34, 51 ] 2 0.000% 99.991% ( 51, 76 ] 10 0.002% 99.992% ( 76, 110 ] 46 0.007% 100.000% ( 110, 170 ] 28 0.004% 100.004% ( 170, 250 ] 23 0.004% 100.008% ( 250, 380 ] 17 0.003% 100.010% ( 380, 580 ] 7 0.001% 100.011% ( 580, 870 ] 13 0.002% 100.013% ( 870, 1300 ] 11 0.002% 100.015% ( 1300, 1900 ] 2 0.000% 100.015% ( 1900, 2900 ] 4 0.001% 100.016% ( 2900, 4400 ] 5 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 12331 Average: 3.8040 StdDev: 40.29 Min: 1 Median: 1.2728 Max: 2110 Percentiles: P50: 1.27 P75: 1.74 P99: 13.02 P99.9: 604.25 P99.99: 2110.00 ------------------------------------------------------ [ 0, 1 ] 4361 35.366% 35.366% ####### ( 1, 2 ] 6615 53.645% 89.011% ########### ( 2, 3 ] 802 6.504% 95.515% # ( 3, 4 ] 138 1.119% 96.634% ( 4, 6 ] 164 1.330% 97.964% ( 6, 10 ] 112 0.908% 98.873% ( 10, 15 ] 26 0.211% 99.084% ( 15, 22 ] 11 0.089% 99.173% ( 22, 34 ] 4 0.032% 99.205% ( 34, 51 ] 35 0.284% 99.489% ( 51, 76 ] 13 0.105% 99.595% ( 76, 110 ] 8 0.065% 99.659% ( 110, 170 ] 4 0.032% 99.692% ( 170, 250 ] 15 0.122% 99.813% ( 250, 380 ] 6 0.049% 99.862% ( 380, 580 ] 4 0.032% 99.895% ( 580, 870 ] 8 0.065% 99.959% ( 870, 1300 ] 1 0.008% 99.968% ( 1300, 1900 ] 2 0.016% 99.984% ( 1900, 2900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 88536 Average: 2.0482 StdDev: 4.16 Min: 0 Median: 1.4222 Max: 711 Percentiles: P50: 1.42 P75: 1.82 P99: 5.63 P99.9: 10.00 P99.99: 144.39 ------------------------------------------------------ [ 0, 1 ] 20835 23.533% 23.533% ##### ( 1, 2 ] 55500 62.686% 86.219% ############# ( 2, 3 ] 7326 8.275% 94.494% ## ( 3, 4 ] 2424 2.738% 97.232% # ( 4, 6 ] 1917 2.165% 99.397% ( 6, 10 ] 446 0.504% 99.901% ( 10, 15 ] 69 0.078% 99.979% ( 15, 22 ] 5 0.006% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 2 0.002% 99.993% ( 250, 380 ] 4 0.005% 99.998% ( 580, 870 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 250739 Average: 3.4653 StdDev: 32.21 Min: 0 Median: 1.6543 Max: 3790 Percentiles: P50: 1.65 P75: 2.22 P99: 9.02 P99.9: 190.16 P99.99: 495.73 ------------------------------------------------------ [ 0, 1 ] 24566 9.797% 9.797% ## ( 1, 2 ] 154053 61.440% 71.237% ############ ( 2, 3 ] 42472 16.939% 88.176% ### ( 3, 4 ] 12262 4.890% 93.066% # ( 4, 6 ] 11404 4.548% 97.614% # ( 6, 10 ] 4609 1.838% 99.452% ( 10, 15 ] 493 0.197% 99.649% ( 15, 22 ] 110 0.044% 99.693% ( 22, 34 ] 27 0.011% 99.704% ( 34, 51 ] 7 0.003% 99.706% ( 51, 76 ] 2 0.001% 99.707% ( 76, 110 ] 97 0.039% 99.746% ( 110, 170 ] 353 0.141% 99.887% ( 170, 250 ] 132 0.053% 99.939% ( 250, 380 ] 87 0.035% 99.974% ( 380, 580 ] 69 0.028% 100.002% ( 580, 870 ] 35 0.014% 100.016% ( 870, 1300 ] 12 0.005% 100.020% ( 1300, 1900 ] 8 0.003% 100.024% ( 1900, 2900 ] 15 0.006% 100.030% ( 2900, 4400 ] 9 0.004% 100.033% ** Level 4 read latency histogram (micros): Count: 315 Average: 132.9556 StdDev: 506.44 Min: 0 Median: 1.8950 Max: 3947 Percentiles: P50: 1.89 P75: 6.55 P99: 2862.50 P99.9: 3947.00 P99.99: 3947.00 ------------------------------------------------------ [ 0, 1 ] 51 16.190% 16.190% ### ( 1, 2 ] 119 37.778% 53.968% ######## ( 2, 3 ] 43 13.651% 67.619% ### ( 3, 4 ] 13 4.127% 71.746% # ( 4, 6 ] 6 1.905% 73.651% ( 6, 10 ] 31 9.841% 83.492% ## ( 10, 15 ] 20 6.349% 89.841% # ( 15, 22 ] 3 0.952% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 2 0.635% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 4 1.270% 93.651% ( 580, 870 ] 1 0.317% 93.968% ( 870, 1300 ] 4 1.270% 95.238% ( 1300, 1900 ] 8 2.540% 97.778% # ( 1900, 2900 ] 4 1.270% 99.048% ( 2900, 4400 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 786.3000 StdDev: 856.84 Min: 105 Median: 380.0000 Max: 2978 Percentiles: P50: 380.00 P75: 1300.00 P99: 2978.00 P99.9: 2978.00 P99.99: 2978.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 4 20.000% 45.000% #### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 321.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.985 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-04:28:12 ... thread 0: (1000000,4000000) ops and (253473.9,310099.2) ops/second in (3.945180,12.899097) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.32 GB 113.3 2.7 0.0 2.7 6.5 3.8 0.0 1.7 127.5 307.1 21.73 20.31 65 0.334 2814K 2978 0.0 0.0 L1 1/1 2.85 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 237.8 237.5 1.32 1.28 1 1.324 319K 430 0.0 0.0 L2 1/0 96.66 MB 1.0 0.3 0.2 0.2 0.3 0.2 0.4 1.8 252.1 252.0 1.38 1.33 2 0.692 354K 175 0.0 0.0 L3 19/0 843.72 MB 0.8 1.0 0.2 0.8 1.0 0.2 0.2 4.4 236.2 235.8 4.47 4.09 2 2.236 1072K 1586 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 123.4 123.4 1.36 0.95 1 1.364 170K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/12 99.95 GB 0.0 4.6 0.9 3.7 8.4 4.7 1.4 2.2 153.9 282.7 30.28 27.96 71 0.426 4732K 5169 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.9 3.7 8.4 4.7 1.4 2.2 153.9 282.7 30.28 27.96 71 0.426 4732K 5169 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.9 3.7 4.5 0.9 0.0 0.0 243.6 243.4 19.13 18.04 16 1.195 4732K 5169 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 350.3 11.15 9.92 55 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.1 total, 12.9 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.36 GB write, 652.06 MB/s write, 4.55 GB read, 354.96 MB/s read, 30.3 seconds Interval compaction: 8.36 GB write, 663.56 MB/s write, 4.55 GB read, 361.22 MB/s read, 30.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 11, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1073655 Average: 2.1602 StdDev: 11.43 Min: 1 Median: 1.4651 Max: 3873 Percentiles: P50: 1.47 P75: 1.85 P99: 5.58 P99.9: 9.93 P99.99: 15.66 ------------------------------------------------------ [ 0, 1 ] 211328 19.683% 19.683% #### ( 1, 2 ] 699848 65.184% 84.867% ############# ( 2, 3 ] 100106 9.324% 94.191% ## ( 3, 4 ] 34297 3.194% 97.385% # ( 4, 6 ] 21985 2.048% 99.433% ( 6, 10 ] 5106 0.476% 99.908% ( 10, 15 ] 868 0.081% 99.989% ( 15, 22 ] 113 0.011% 100.000% ( 22, 34 ] 15 0.001% 100.001% ( 34, 51 ] 3 0.000% 100.001% ( 51, 76 ] 14 0.001% 100.003% ( 76, 110 ] 51 0.005% 100.007% ( 110, 170 ] 65 0.006% 100.013% ( 170, 250 ] 33 0.003% 100.016% ( 250, 380 ] 27 0.003% 100.019% ( 380, 580 ] 18 0.002% 100.021% ( 580, 870 ] 19 0.002% 100.022% ( 870, 1300 ] 16 0.001% 100.024% ( 1300, 1900 ] 2 0.000% 100.024% ( 1900, 2900 ] 6 0.001% 100.025% ( 2900, 4400 ] 6 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 12331 Average: 3.8040 StdDev: 40.29 Min: 1 Median: 1.2728 Max: 2110 Percentiles: P50: 1.27 P75: 1.74 P99: 13.02 P99.9: 604.25 P99.99: 2110.00 ------------------------------------------------------ [ 0, 1 ] 4361 35.366% 35.366% ####### ( 1, 2 ] 6615 53.645% 89.011% ########### ( 2, 3 ] 802 6.504% 95.515% # ( 3, 4 ] 138 1.119% 96.634% ( 4, 6 ] 164 1.330% 97.964% ( 6, 10 ] 112 0.908% 98.873% ( 10, 15 ] 26 0.211% 99.084% ( 15, 22 ] 11 0.089% 99.173% ( 22, 34 ] 4 0.032% 99.205% ( 34, 51 ] 35 0.284% 99.489% ( 51, 76 ] 13 0.105% 99.595% ( 76, 110 ] 8 0.065% 99.659% ( 110, 170 ] 4 0.032% 99.692% ( 170, 250 ] 15 0.122% 99.813% ( 250, 380 ] 6 0.049% 99.862% ( 380, 580 ] 4 0.032% 99.895% ( 580, 870 ] 8 0.065% 99.959% ( 870, 1300 ] 1 0.008% 99.968% ( 1300, 1900 ] 2 0.016% 99.984% ( 1900, 2900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 88536 Average: 2.0482 StdDev: 4.16 Min: 0 Median: 1.4222 Max: 711 Percentiles: P50: 1.42 P75: 1.82 P99: 5.63 P99.9: 10.00 P99.99: 144.39 ------------------------------------------------------ [ 0, 1 ] 20835 23.533% 23.533% ##### ( 1, 2 ] 55500 62.686% 86.219% ############# ( 2, 3 ] 7326 8.275% 94.494% ## ( 3, 4 ] 2424 2.738% 97.232% # ( 4, 6 ] 1917 2.165% 99.397% ( 6, 10 ] 446 0.504% 99.901% ( 10, 15 ] 69 0.078% 99.979% ( 15, 22 ] 5 0.006% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 2 0.002% 99.993% ( 250, 380 ] 4 0.005% 99.998% ( 580, 870 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 250739 Average: 3.4653 StdDev: 32.21 Min: 0 Median: 1.6543 Max: 3790 Percentiles: P50: 1.65 P75: 2.22 P99: 9.02 P99.9: 190.16 P99.99: 495.73 ------------------------------------------------------ [ 0, 1 ] 24566 9.797% 9.797% ## ( 1, 2 ] 154053 61.440% 71.237% ############ ( 2, 3 ] 42472 16.939% 88.176% ### ( 3, 4 ] 12262 4.890% 93.066% # ( 4, 6 ] 11404 4.548% 97.614% # ( 6, 10 ] 4609 1.838% 99.452% ( 10, 15 ] 493 0.197% 99.649% ( 15, 22 ] 110 0.044% 99.693% ( 22, 34 ] 27 0.011% 99.704% ( 34, 51 ] 7 0.003% 99.706% ( 51, 76 ] 2 0.001% 99.707% ( 76, 110 ] 97 0.039% 99.746% ( 110, 170 ] 353 0.141% 99.887% ( 170, 250 ] 132 0.053% 99.939% ( 250, 380 ] 87 0.035% 99.974% ( 380, 580 ] 69 0.028% 100.002% ( 580, 870 ] 35 0.014% 100.016% ( 870, 1300 ] 12 0.005% 100.020% ( 1300, 1900 ] 8 0.003% 100.024% ( 1900, 2900 ] 15 0.006% 100.030% ( 2900, 4400 ] 9 0.004% 100.033% ** Level 4 read latency histogram (micros): Count: 315 Average: 132.9556 StdDev: 506.44 Min: 0 Median: 1.8950 Max: 3947 Percentiles: P50: 1.89 P75: 6.55 P99: 2862.50 P99.9: 3947.00 P99.99: 3947.00 ------------------------------------------------------ [ 0, 1 ] 51 16.190% 16.190% ### ( 1, 2 ] 119 37.778% 53.968% ######## ( 2, 3 ] 43 13.651% 67.619% ### ( 3, 4 ] 13 4.127% 71.746% # ( 4, 6 ] 6 1.905% 73.651% ( 6, 10 ] 31 9.841% 83.492% ## ( 10, 15 ] 20 6.349% 89.841% # ( 15, 22 ] 3 0.952% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 2 0.635% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 4 1.270% 93.651% ( 580, 870 ] 1 0.317% 93.968% ( 870, 1300 ] 4 1.270% 95.238% ( 1300, 1900 ] 8 2.540% 97.778% # ( 1900, 2900 ] 4 1.270% 99.048% ( 2900, 4400 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 786.3000 StdDev: 856.84 Min: 105 Median: 380.0000 Max: 2978 Percentiles: P50: 380.00 P75: 1300.00 P99: 2978.00 P99.9: 2978.00 P99.99: 2978.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 4 20.000% 45.000% #### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 13.1 total, 3.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 299.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.196 H:M:S, 16.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 249.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.211 H:M:S, 30.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/17-04:28:19 ... thread 0: (1000000,5000000) ops and (151299.5,256298.5) ops/second in (6.609409,19.508506) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.97 GB 31.5 3.4 0.0 3.4 8.1 4.7 0.0 1.7 129.4 304.8 27.27 25.29 82 0.333 3582K 3699 0.0 0.0 L1 6/6 690.35 MB 0.0 2.5 2.5 0.0 2.5 2.5 0.2 1.0 230.9 228.7 11.19 10.88 2 5.595 2623K 23K 0.0 0.0 L2 14/8 1.61 GB 7.6 0.3 0.2 0.2 0.3 0.2 1.9 1.8 252.1 252.0 1.38 1.33 2 0.692 354K 175 0.0 0.0 L3 19/13 843.72 MB 0.0 1.0 0.2 0.8 1.0 0.2 0.2 4.4 236.2 235.8 4.47 4.09 2 2.236 1072K 1586 0.0 0.0 L4 174/0 9.58 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 123.4 123.4 1.36 0.95 1 1.364 170K 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/37 100.78 GB 0.0 7.5 3.1 4.4 12.2 7.7 2.9 2.6 168.2 272.4 45.68 42.53 89 0.513 7803K 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 3.1 4.4 12.2 7.7 2.9 2.6 168.2 272.4 45.68 42.53 89 0.513 7803K 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 3.1 4.4 7.5 3.1 0.0 0.0 242.1 241.1 31.74 30.35 20 1.587 7803K 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 343.5 13.94 12.18 69 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.7 total, 19.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.15 GB write, 630.39 MB/s write, 7.50 GB read, 389.33 MB/s read, 45.7 seconds Interval compaction: 12.15 GB write, 637.75 MB/s write, 7.50 GB read, 393.87 MB/s read, 45.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 12, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1781961 Average: 2.2061 StdDev: 10.81 Min: 0 Median: 1.4750 Max: 3940 Percentiles: P50: 1.48 P75: 1.86 P99: 5.75 P99.9: 11.12 P99.99: 87.93 ------------------------------------------------------ [ 0, 1 ] 337950 18.965% 18.965% #### ( 1, 2 ] 1164240 65.335% 84.300% ############# ( 2, 3 ] 168271 9.443% 93.743% ## ( 3, 4 ] 59558 3.342% 97.085% # ( 4, 6 ] 38927 2.185% 99.270% ( 6, 10 ] 10863 0.610% 99.879% ( 10, 15 ] 1650 0.093% 99.972% ( 15, 22 ] 189 0.011% 99.982% ( 22, 34 ] 23 0.001% 99.984% ( 34, 51 ] 5 0.000% 99.984% ( 51, 76 ] 17 0.001% 99.985% ( 76, 110 ] 256 0.014% 99.999% ( 110, 170 ] 237 0.013% 100.013% ( 170, 250 ] 94 0.005% 100.018% ( 250, 380 ] 64 0.004% 100.021% ( 380, 580 ] 53 0.003% 100.024% ( 580, 870 ] 26 0.001% 100.026% ( 870, 1300 ] 21 0.001% 100.027% ( 1300, 1900 ] 6 0.000% 100.027% ( 1900, 2900 ] 7 0.000% 100.028% ( 2900, 4400 ] 8 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 143003 Average: 3.7580 StdDev: 25.22 Min: 1 Median: 1.9109 Max: 3081 Percentiles: P50: 1.91 P75: 2.92 P99: 8.98 P99.9: 14.78 P99.99: 40.00 ------------------------------------------------------ [ 0, 1 ] 6132 4.288% 4.288% # ( 1, 2 ] 71764 50.184% 54.472% ########## ( 2, 3 ] 32071 22.427% 76.898% #### ( 3, 4 ] 14373 10.051% 86.949% ## ( 4, 6 ] 15095 10.556% 97.505% ## ( 6, 10 ] 2873 2.009% 99.514% ( 10, 15 ] 579 0.405% 99.919% ( 15, 22 ] 81 0.057% 99.976% ( 22, 34 ] 9 0.006% 99.982% ( 34, 51 ] 36 0.025% 100.007% ( 51, 76 ] 16 0.011% 100.018% ( 76, 110 ] 46 0.032% 100.050% ( 110, 170 ] 80 0.056% 100.106% ( 170, 250 ] 79 0.055% 100.162% ( 250, 380 ] 47 0.033% 100.194% ( 380, 580 ] 46 0.032% 100.227% ( 580, 870 ] 28 0.020% 100.246% ( 870, 1300 ] 9 0.006% 100.252% ( 1300, 1900 ] 11 0.008% 100.260% ( 1900, 2900 ] 3 0.002% 100.262% ( 2900, 4400 ] 1 0.001% 100.263% ** Level 2 read latency histogram (micros): Count: 88536 Average: 2.0482 StdDev: 4.16 Min: 0 Median: 1.4222 Max: 711 Percentiles: P50: 1.42 P75: 1.82 P99: 5.63 P99.9: 10.00 P99.99: 144.39 ------------------------------------------------------ [ 0, 1 ] 20835 23.533% 23.533% ##### ( 1, 2 ] 55500 62.686% 86.219% ############# ( 2, 3 ] 7326 8.275% 94.494% ## ( 3, 4 ] 2424 2.738% 97.232% # ( 4, 6 ] 1917 2.165% 99.397% ( 6, 10 ] 446 0.504% 99.901% ( 10, 15 ] 69 0.078% 99.979% ( 15, 22 ] 5 0.006% 99.984% ( 22, 34 ] 2 0.002% 99.986% ( 34, 51 ] 1 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 110, 170 ] 2 0.002% 99.991% ( 170, 250 ] 2 0.002% 99.993% ( 250, 380 ] 4 0.005% 99.998% ( 580, 870 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 285688 Average: 3.8212 StdDev: 35.82 Min: 0 Median: 1.6908 Max: 3790 Percentiles: P50: 1.69 P75: 2.37 P99: 9.30 P99.9: 259.17 P99.99: 667.62 ------------------------------------------------------ [ 0, 1 ] 24927 8.725% 8.725% ## ( 1, 2 ] 170699 59.750% 68.475% ############ ( 2, 3 ] 51037 17.865% 86.340% #### ( 3, 4 ] 16182 5.664% 92.004% # ( 4, 6 ] 15300 5.355% 97.360% # ( 6, 10 ] 5677 1.987% 99.347% ( 10, 15 ] 668 0.234% 99.581% ( 15, 22 ] 131 0.046% 99.627% ( 22, 34 ] 30 0.011% 99.637% ( 34, 51 ] 7 0.002% 99.639% ( 51, 76 ] 2 0.001% 99.640% ( 76, 110 ] 128 0.045% 99.685% ( 110, 170 ] 416 0.146% 99.831% ( 170, 250 ] 189 0.066% 99.897% ( 250, 380 ] 132 0.046% 99.943% ( 380, 580 ] 116 0.041% 99.984% ( 580, 870 ] 61 0.021% 100.005% ( 870, 1300 ] 28 0.010% 100.015% ( 1300, 1900 ] 12 0.004% 100.019% ( 1900, 2900 ] 17 0.006% 100.025% ( 2900, 4400 ] 12 0.004% 100.029% ** Level 4 read latency histogram (micros): Count: 315 Average: 132.9556 StdDev: 506.44 Min: 0 Median: 1.8950 Max: 3947 Percentiles: P50: 1.89 P75: 6.55 P99: 2862.50 P99.9: 3947.00 P99.99: 3947.00 ------------------------------------------------------ [ 0, 1 ] 51 16.190% 16.190% ### ( 1, 2 ] 119 37.778% 53.968% ######## ( 2, 3 ] 43 13.651% 67.619% ### ( 3, 4 ] 13 4.127% 71.746% # ( 4, 6 ] 6 1.905% 73.651% ( 6, 10 ] 31 9.841% 83.492% ## ( 10, 15 ] 20 6.349% 89.841% # ( 15, 22 ] 3 0.952% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 2 0.635% 91.746% ( 250, 380 ] 2 0.635% 92.381% ( 380, 580 ] 4 1.270% 93.651% ( 580, 870 ] 1 0.317% 93.968% ( 870, 1300 ] 4 1.270% 95.238% ( 1300, 1900 ] 8 2.540% 97.778% # ( 1900, 2900 ] 4 1.270% 99.048% ( 2900, 4400 ] 3 0.952% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 786.3000 StdDev: 856.84 Min: 105 Median: 380.0000 Max: 2978 Percentiles: P50: 380.00 P75: 1300.00 P99: 2978.00 P99.9: 2978.00 P99.99: 2978.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 4 20.000% 25.000% #### ( 170, 250 ] 4 20.000% 45.000% #### ( 250, 380 ] 1 5.000% 50.000% # ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 19.7 total, 6.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 249.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.893 H:M:S, 29.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 148.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.698 H:M:S, 55.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/17-04:28:24 ... thread 0: (1000000,6000000) ops and (210379.3,247302.1) ops/second in (4.753320,24.261826) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 2.88 GB 18.9 5.7 0.0 5.7 11.3 5.6 0.0 2.0 141.8 280.2 41.31 37.13 97 0.426 5947K 13K 0.0 0.0 L1 0/0 0.00 KB 0.0 2.5 2.5 0.0 2.5 2.5 0.2 1.0 230.9 228.7 11.19 10.88 2 5.595 2623K 23K 0.0 0.0 L2 5/4 533.09 MB 1.3 1.1 0.9 0.3 1.1 0.9 1.9 1.3 203.7 203.3 5.58 4.95 3 1.859 1153K 2443 0.0 0.0 L3 29/9 1.43 GB 1.0 3.3 1.5 1.8 3.2 1.5 0.7 2.2 190.7 189.5 17.55 14.53 13 1.350 3398K 21K 0.0 0.0 L4 187/7 10.11 GB 1.0 0.9 0.8 0.0 0.9 0.8 0.7 1.1 115.0 114.8 7.79 4.43 18 0.433 865K 159 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/27 101.67 GB 0.0 13.5 5.7 7.8 19.0 11.2 4.5 3.4 165.7 233.6 83.41 71.92 133 0.627 13M 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 5.7 7.8 19.0 11.2 4.5 3.4 165.7 233.6 83.41 71.92 133 0.627 13M 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 5.7 7.8 13.4 5.6 0.0 0.0 211.7 210.7 65.27 57.19 53 1.231 13M 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 316.0 18.14 14.73 80 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.5 total, 24.3 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.03 GB write, 795.72 MB/s write, 13.49 GB read, 564.22 MB/s read, 83.4 seconds Interval compaction: 19.03 GB write, 803.18 MB/s write, 13.49 GB read, 569.51 MB/s read, 83.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 35, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2211894 Average: 2.5893 StdDev: 24.68 Min: 0 Median: 1.5460 Max: 7407 Percentiles: P50: 1.55 P75: 1.94 P99: 6.46 P99.9: 13.22 P99.99: 134.14 ------------------------------------------------------ [ 0, 1 ] 348803 15.769% 15.769% ### ( 1, 2 ] 1386703 62.693% 78.462% ############# ( 2, 3 ] 264416 11.954% 90.417% ## ( 3, 4 ] 101451 4.587% 95.003% # ( 4, 6 ] 86091 3.892% 98.896% # ( 6, 10 ] 20100 0.909% 99.804% ( 10, 15 ] 3289 0.149% 99.953% ( 15, 22 ] 404 0.018% 99.971% ( 22, 34 ] 29 0.001% 99.973% ( 34, 51 ] 6 0.000% 99.973% ( 51, 76 ] 18 0.001% 99.974% ( 76, 110 ] 262 0.012% 99.985% ( 110, 170 ] 253 0.011% 99.997% ( 170, 250 ] 128 0.006% 100.003% ( 250, 380 ] 124 0.006% 100.008% ( 380, 580 ] 133 0.006% 100.014% ( 580, 870 ] 148 0.007% 100.021% ( 870, 1300 ] 108 0.005% 100.026% ( 1300, 1900 ] 46 0.002% 100.028% ( 1900, 2900 ] 38 0.002% 100.030% ( 2900, 4400 ] 34 0.002% 100.031% ( 4400, 6600 ] 11 0.000% 100.032% ( 6600, 9900 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 625983 Average: 5.1030 StdDev: 62.79 Min: 1 Median: 1.9903 Max: 8082 Percentiles: P50: 1.99 P75: 3.00 P99: 9.31 P99.9: 15.06 P99.99: 128.58 ------------------------------------------------------ [ 0, 1 ] 10824 1.729% 1.729% ( 1, 2 ] 305137 48.745% 50.474% ########## ( 2, 3 ] 153425 24.509% 74.984% ##### ( 3, 4 ] 65775 10.507% 85.491% ## ( 4, 6 ] 71208 11.375% 96.867% ## ( 6, 10 ] 16124 2.576% 99.442% # ( 10, 15 ] 2862 0.457% 99.900% ( 15, 22 ] 359 0.057% 99.957% ( 22, 34 ] 21 0.003% 99.960% ( 34, 51 ] 39 0.006% 99.967% ( 51, 76 ] 23 0.004% 99.970% ( 76, 110 ] 73 0.012% 99.982% ( 110, 170 ] 166 0.027% 100.008% ( 170, 250 ] 180 0.029% 100.037% ( 250, 380 ] 212 0.034% 100.071% ( 380, 580 ] 261 0.042% 100.113% ( 580, 870 ] 246 0.039% 100.152% ( 870, 1300 ] 151 0.024% 100.176% ( 1300, 1900 ] 100 0.016% 100.192% ( 1900, 2900 ] 121 0.019% 100.212% ( 2900, 4400 ] 59 0.009% 100.221% ( 4400, 6600 ] 8 0.001% 100.222% ( 6600, 9900 ] 4 0.001% 100.223% ** Level 2 read latency histogram (micros): Count: 156611 Average: 2.7384 StdDev: 26.95 Min: 0 Median: 1.6511 Max: 4566 Percentiles: P50: 1.65 P75: 2.34 P99: 6.85 P99.9: 11.48 P99.99: 13.18 ------------------------------------------------------ [ 0, 1 ] 21284 13.590% 13.590% ### ( 1, 2 ] 87578 55.921% 69.511% ########### ( 2, 3 ] 25230 16.110% 85.621% ### ( 3, 4 ] 10133 6.470% 92.091% # ( 4, 6 ] 10471 6.686% 98.777% # ( 6, 10 ] 1635 1.044% 99.821% ( 10, 15 ] 416 0.266% 100.087% ( 15, 22 ] 38 0.024% 100.111% ( 22, 34 ] 5 0.003% 100.114% ( 34, 51 ] 1 0.001% 100.115% ( 51, 76 ] 1 0.001% 100.116% ( 110, 170 ] 8 0.005% 100.121% ( 170, 250 ] 4 0.003% 100.123% ( 250, 380 ] 4 0.003% 100.126% ( 380, 580 ] 5 0.003% 100.129% ( 580, 870 ] 6 0.004% 100.133% ( 870, 1300 ] 2 0.001% 100.134% ( 1300, 1900 ] 3 0.002% 100.136% ( 1900, 2900 ] 2 0.001% 100.137% ( 2900, 4400 ] 4 0.003% 100.140% ( 4400, 6600 ] 2 0.001% 100.141% ** Level 3 read latency histogram (micros): Count: 700125 Average: 7.1859 StdDev: 96.87 Min: 0 Median: 1.8819 Max: 10186 Percentiles: P50: 1.88 P75: 2.84 P99: 9.64 P99.9: 500.03 P99.99: 856.81 ------------------------------------------------------ [ 0, 1 ] 28070 4.009% 4.009% # ( 1, 2 ] 365101 52.148% 56.157% ########## ( 2, 3 ] 157991 22.566% 78.723% ##### ( 3, 4 ] 61848 8.834% 87.557% ## ( 4, 6 ] 64762 9.250% 96.807% ## ( 6, 10 ] 16852 2.407% 99.214% ( 10, 15 ] 2616 0.374% 99.588% ( 15, 22 ] 388 0.055% 99.643% ( 22, 34 ] 53 0.008% 99.651% ( 34, 51 ] 24 0.003% 99.654% ( 51, 76 ] 7 0.001% 99.655% ( 76, 110 ] 159 0.023% 99.678% ( 110, 170 ] 528 0.075% 99.753% ( 170, 250 ] 349 0.050% 99.803% ( 250, 380 ] 394 0.056% 99.860% ( 380, 580 ] 473 0.068% 99.927% ( 580, 870 ] 462 0.066% 99.993% ( 870, 1300 ] 398 0.057% 100.050% ( 1300, 1900 ] 194 0.028% 100.078% ( 1900, 2900 ] 219 0.031% 100.109% ( 2900, 4400 ] 206 0.029% 100.138% ( 4400, 6600 ] 38 0.005% 100.144% ( 6600, 9900 ] 6 0.001% 100.145% ( 9900, 14000 ] 1 0.000% 100.145% ** Level 4 read latency histogram (micros): Count: 15941 Average: 120.7651 StdDev: 499.16 Min: 0 Median: 1.9995 Max: 7755 Percentiles: P50: 2.00 P75: 3.43 P99: 2879.04 P99.9: 5577.66 P99.99: 7046.49 ------------------------------------------------------ [ 0, 1 ] 419 2.628% 2.628% # ( 1, 2 ] 7555 47.394% 50.022% ######### ( 2, 3 ] 3272 20.526% 70.548% #### ( 3, 4 ] 1658 10.401% 80.948% ## ( 4, 6 ] 1032 6.474% 87.422% # ( 6, 10 ] 392 2.459% 89.881% ( 10, 15 ] 82 0.514% 90.396% ( 15, 22 ] 14 0.088% 90.484% ( 34, 51 ] 2 0.013% 90.496% ( 76, 110 ] 2 0.013% 90.509% ( 110, 170 ] 42 0.263% 90.772% ( 170, 250 ] 51 0.320% 91.092% ( 250, 380 ] 124 0.778% 91.870% ( 380, 580 ] 228 1.430% 93.300% ( 580, 870 ] 315 1.976% 95.276% ( 870, 1300 ] 292 1.832% 97.108% ( 1300, 1900 ] 189 1.186% 98.294% ( 1900, 2900 ] 115 0.721% 99.015% ( 2900, 4400 ] 125 0.784% 99.799% ( 4400, 6600 ] 30 0.188% 99.987% ( 6600, 9900 ] 3 0.019% 100.006% ** Level 5 read latency histogram (micros): Count: 60 Average: 1111.2667 StdDev: 1200.24 Min: 105 Median: 540.0000 Max: 4402 Percentiles: P50: 540.00 P75: 1600.00 P99: 4402.00 P99.9: 4402.00 P99.99: 4402.00 ------------------------------------------------------ ( 76, 110 ] 1 1.667% 1.667% ( 110, 170 ] 8 13.333% 15.000% ### ( 170, 250 ] 8 13.333% 28.333% ### ( 250, 380 ] 9 15.000% 43.333% ### ( 380, 580 ] 5 8.333% 51.667% ## ( 580, 870 ] 5 8.333% 60.000% ## ( 870, 1300 ] 7 11.667% 71.667% ## ( 1300, 1900 ] 4 6.667% 78.333% # ( 1900, 2900 ] 6 10.000% 88.333% ## ( 2900, 4400 ] 6 10.000% 98.333% ## ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 24.5 total, 4.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 241.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.619 H:M:S, 31.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 207.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.725 H:M:S, 36.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-04:28:27 ... thread 0: (1000000,7000000) ops and (279291.1,251415.8) ops/second in (3.580493,27.842319) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 3.86 GB 88.1 6.4 0.0 6.4 13.0 6.6 0.0 2.0 138.3 280.3 47.37 42.41 112 0.423 6650K 14K 0.0 0.0 L1 0/0 0.00 KB 0.0 2.5 2.5 0.0 2.5 2.5 0.2 1.0 230.9 228.7 11.19 10.88 2 5.595 2623K 23K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.3 1.1 0.9 1.9 1.3 203.7 203.3 5.58 4.95 3 1.859 1153K 2443 0.0 0.0 L3 18/0 967.24 MB 1.0 4.0 2.0 2.0 4.0 2.0 0.7 2.0 182.9 181.9 22.63 18.16 16 1.414 4203K 23K 0.0 0.0 L4 196/0 9.75 GB 1.0 1.9 1.8 0.1 1.9 1.8 0.7 1.1 121.0 120.8 16.36 9.62 43 0.381 1944K 1612 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/11 102.65 GB 0.0 16.0 7.2 8.8 22.5 13.7 5.9 3.4 158.9 223.6 103.13 86.03 176 0.586 16M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.0 7.2 8.8 22.5 13.7 5.9 3.4 158.9 223.6 103.13 86.03 176 0.586 16M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.0 7.2 8.8 15.9 7.1 0.0 0.0 200.7 199.9 81.65 68.68 83 0.984 16M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 313.9 21.48 17.35 93 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.1 total, 27.8 interval Flush(GB): cumulative 6.582, interval 6.582 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.52 GB write, 821.48 MB/s write, 16.00 GB read, 583.77 MB/s read, 103.1 seconds Interval compaction: 22.52 GB write, 828.20 MB/s write, 16.00 GB read, 588.54 MB/s read, 103.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 48, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2622122 Average: 2.6109 StdDev: 24.36 Min: 0 Median: 1.5654 Max: 7407 Percentiles: P50: 1.57 P75: 1.96 P99: 6.66 P99.9: 13.07 P99.99: 102.32 ------------------------------------------------------ [ 0, 1 ] 382825 14.600% 14.600% ### ( 1, 2 ] 1641748 62.611% 77.211% ############# ( 2, 3 ] 337909 12.887% 90.098% ### ( 3, 4 ] 123584 4.713% 94.811% # ( 4, 6 ] 105646 4.029% 98.840% # ( 6, 10 ] 25254 0.963% 99.803% ( 10, 15 ] 4128 0.157% 99.961% ( 15, 22 ] 489 0.019% 99.979% ( 22, 34 ] 33 0.001% 99.981% ( 34, 51 ] 10 0.000% 99.981% ( 51, 76 ] 19 0.001% 99.982% ( 76, 110 ] 280 0.011% 99.992% ( 110, 170 ] 326 0.012% 100.005% ( 170, 250 ] 181 0.007% 100.012% ( 250, 380 ] 150 0.006% 100.018% ( 380, 580 ] 161 0.006% 100.024% ( 580, 870 ] 163 0.006% 100.030% ( 870, 1300 ] 119 0.005% 100.034% ( 1300, 1900 ] 52 0.002% 100.036% ( 1900, 2900 ] 40 0.002% 100.038% ( 2900, 4400 ] 39 0.001% 100.039% ( 4400, 6600 ] 14 0.001% 100.040% ( 6600, 9900 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 659735 Average: 5.1663 StdDev: 64.06 Min: 1 Median: 1.9838 Max: 8082 Percentiles: P50: 1.98 P75: 2.99 P99: 9.33 P99.9: 16.81 P99.99: 162.89 ------------------------------------------------------ [ 0, 1 ] 11508 1.744% 1.744% ( 1, 2 ] 323610 49.052% 50.796% ########## ( 2, 3 ] 161115 24.421% 75.217% ##### ( 3, 4 ] 68656 10.407% 85.624% ## ( 4, 6 ] 74112 11.234% 96.857% ## ( 6, 10 ] 17002 2.577% 99.434% # ( 10, 15 ] 2978 0.451% 99.886% ( 15, 22 ] 365 0.055% 99.941% ( 22, 34 ] 24 0.004% 99.945% ( 34, 51 ] 39 0.006% 99.951% ( 51, 76 ] 25 0.004% 99.954% ( 76, 110 ] 79 0.012% 99.966% ( 110, 170 ] 177 0.027% 99.993% ( 170, 250 ] 183 0.028% 100.021% ( 250, 380 ] 224 0.034% 100.055% ( 380, 580 ] 274 0.042% 100.096% ( 580, 870 ] 266 0.040% 100.137% ( 870, 1300 ] 172 0.026% 100.163% ( 1300, 1900 ] 113 0.017% 100.180% ( 1900, 2900 ] 130 0.020% 100.200% ( 2900, 4400 ] 64 0.010% 100.209% ( 4400, 6600 ] 8 0.001% 100.211% ( 6600, 9900 ] 5 0.001% 100.211% ** Level 2 read latency histogram (micros): Count: 156611 Average: 2.7384 StdDev: 26.95 Min: 0 Median: 1.6511 Max: 4566 Percentiles: P50: 1.65 P75: 2.34 P99: 6.85 P99.9: 11.48 P99.99: 13.18 ------------------------------------------------------ [ 0, 1 ] 21284 13.590% 13.590% ### ( 1, 2 ] 87578 55.921% 69.511% ########### ( 2, 3 ] 25230 16.110% 85.621% ### ( 3, 4 ] 10133 6.470% 92.091% # ( 4, 6 ] 10471 6.686% 98.777% # ( 6, 10 ] 1635 1.044% 99.821% ( 10, 15 ] 416 0.266% 100.087% ( 15, 22 ] 38 0.024% 100.111% ( 22, 34 ] 5 0.003% 100.114% ( 34, 51 ] 1 0.001% 100.115% ( 51, 76 ] 1 0.001% 100.116% ( 110, 170 ] 8 0.005% 100.121% ( 170, 250 ] 4 0.003% 100.123% ( 250, 380 ] 4 0.003% 100.126% ( 380, 580 ] 5 0.003% 100.129% ( 580, 870 ] 6 0.004% 100.133% ( 870, 1300 ] 2 0.001% 100.134% ( 1300, 1900 ] 3 0.002% 100.136% ( 1900, 2900 ] 2 0.001% 100.137% ( 2900, 4400 ] 4 0.003% 100.140% ( 4400, 6600 ] 2 0.001% 100.141% ** Level 3 read latency histogram (micros): Count: 940994 Average: 6.3286 StdDev: 85.58 Min: 0 Median: 1.9087 Max: 10186 Percentiles: P50: 1.91 P75: 2.87 P99: 9.35 P99.9: 203.02 P99.99: 453.10 ------------------------------------------------------ [ 0, 1 ] 30503 3.242% 3.242% # ( 1, 2 ] 484202 51.456% 54.698% ########## ( 2, 3 ] 219537 23.330% 78.028% ##### ( 3, 4 ] 87623 9.312% 87.340% ## ( 4, 6 ] 91560 9.730% 97.070% ## ( 6, 10 ] 21666 2.302% 99.373% ( 10, 15 ] 3520 0.374% 99.747% ( 15, 22 ] 477 0.051% 99.797% ( 22, 34 ] 58 0.006% 99.804% ( 34, 51 ] 33 0.004% 99.807% ( 51, 76 ] 7 0.001% 99.808% ( 76, 110 ] 159 0.017% 99.825% ( 110, 170 ] 552 0.059% 99.883% ( 170, 250 ] 378 0.040% 99.924% ( 250, 380 ] 433 0.046% 99.970% ( 380, 580 ] 525 0.056% 100.025% ( 580, 870 ] 506 0.054% 100.079% ( 870, 1300 ] 442 0.047% 100.126% ( 1300, 1900 ] 208 0.022% 100.148% ( 1900, 2900 ] 235 0.025% 100.173% ( 2900, 4400 ] 213 0.023% 100.196% ( 4400, 6600 ] 40 0.004% 100.200% ( 6600, 9900 ] 6 0.001% 100.201% ( 9900, 14000 ] 1 0.000% 100.201% ** Level 4 read latency histogram (micros): Count: 32094 Average: 99.1769 StdDev: 435.00 Min: 0 Median: 1.9821 Max: 8383 Percentiles: P50: 1.98 P75: 3.35 P99: 2364.95 P99.9: 4516.48 P99.99: 6281.65 ------------------------------------------------------ [ 0, 1 ] 854 2.661% 2.661% # ( 1, 2 ] 15470 48.202% 50.863% ########## ( 2, 3 ] 6566 20.459% 71.322% #### ( 3, 4 ] 3353 10.447% 81.769% ## ( 4, 6 ] 2073 6.459% 88.228% # ( 6, 10 ] 747 2.328% 90.556% ( 10, 15 ] 140 0.436% 90.992% ( 15, 22 ] 24 0.075% 91.067% ( 22, 34 ] 1 0.003% 91.070% ( 34, 51 ] 3 0.009% 91.079% ( 51, 76 ] 2 0.006% 91.086% ( 76, 110 ] 39 0.122% 91.207% ( 110, 170 ] 144 0.449% 91.656% ( 170, 250 ] 147 0.458% 92.114% ( 250, 380 ] 287 0.894% 93.008% ( 380, 580 ] 467 1.455% 94.463% ( 580, 870 ] 566 1.764% 96.227% ( 870, 1300 ] 490 1.527% 97.753% ( 1300, 1900 ] 308 0.960% 98.713% ( 1900, 2900 ] 198 0.617% 99.330% ( 2900, 4400 ] 181 0.564% 99.894% ( 4400, 6600 ] 36 0.112% 100.006% ( 6600, 9900 ] 5 0.016% 100.022% ** Level 5 read latency histogram (micros): Count: 140 Average: 1405.4714 StdDev: 1358.27 Min: 105 Median: 843.6364 Max: 7830 Percentiles: P50: 843.64 P75: 2291.30 P99: 6160.00 P99.9: 7830.00 P99.99: 7830.00 ------------------------------------------------------ ( 76, 110 ] 1 0.714% 0.714% ( 110, 170 ] 9 6.429% 7.143% # ( 170, 250 ] 13 9.286% 16.429% ## ( 250, 380 ] 19 13.571% 30.000% ### ( 380, 580 ] 18 12.857% 42.857% ### ( 580, 870 ] 11 7.857% 50.714% ## ( 870, 1300 ] 13 9.286% 60.000% ## ( 1300, 1900 ] 12 8.571% 68.571% ## ( 1900, 2900 ] 23 16.429% 85.000% ### ( 2900, 4400 ] 18 12.857% 97.857% ### ( 4400, 6600 ] 2 1.429% 99.286% ( 6600, 9900 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 28.1 total, 3.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 245.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.426 H:M:S, 30.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.807 H:M:S, 22.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-04:28:31 ... thread 0: (1000000,8000000) ops and (282173.7,254888.8) ops/second in (3.543917,31.386236) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 4.85 GB 195.0 7.6 0.0 7.6 15.1 7.6 0.0 2.0 141.2 282.1 54.86 49.49 130 0.422 7866K 15K 0.0 0.0 L1 0/0 0.00 KB 0.0 2.5 2.5 0.0 2.5 2.5 0.2 1.0 230.9 228.7 11.19 10.88 2 5.595 2623K 23K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.3 1.1 0.9 1.9 1.3 203.7 203.3 5.58 4.95 3 1.859 1153K 2443 0.0 0.0 L3 18/0 967.24 MB 1.0 4.0 2.0 2.0 4.0 2.0 0.7 2.0 182.9 181.9 22.63 18.16 16 1.414 4203K 23K 0.0 0.0 L4 196/0 9.75 GB 1.0 1.9 1.8 0.1 1.9 1.8 0.7 1.1 121.0 120.8 16.36 9.62 43 0.381 1944K 1612 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/11 103.64 GB 0.0 17.2 7.2 10.0 24.7 14.7 5.9 3.3 159.0 228.4 110.62 93.11 194 0.570 17M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.2 7.2 10.0 24.7 14.7 5.9 3.3 159.0 228.4 110.62 93.11 194 0.570 17M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.2 7.2 10.0 17.1 7.1 0.0 0.0 203.8 203.0 86.28 73.21 87 0.992 17M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 318.3 24.34 19.89 107 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.6 total, 31.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.67 GB write, 799.10 MB/s write, 17.17 GB read, 556.19 MB/s read, 110.6 seconds Interval compaction: 24.67 GB write, 804.89 MB/s write, 17.17 GB read, 560.22 MB/s read, 110.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 50, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3125565 Average: 2.5671 StdDev: 22.73 Min: 0 Median: 1.5671 Max: 7407 Percentiles: P50: 1.57 P75: 1.96 P99: 6.52 P99.9: 12.48 P99.99: 20.75 ------------------------------------------------------ [ 0, 1 ] 440748 14.101% 14.101% ### ( 1, 2 ] 1978589 63.303% 77.405% ############# ( 2, 3 ] 408187 13.060% 90.464% ### ( 3, 4 ] 144022 4.608% 95.072% # ( 4, 6 ] 118871 3.803% 98.875% # ( 6, 10 ] 29705 0.950% 99.826% ( 10, 15 ] 4679 0.150% 99.976% ( 15, 22 ] 551 0.018% 99.993% ( 22, 34 ] 41 0.001% 99.994% ( 34, 51 ] 12 0.000% 99.995% ( 51, 76 ] 25 0.001% 99.996% ( 76, 110 ] 322 0.010% 100.006% ( 110, 170 ] 358 0.011% 100.017% ( 170, 250 ] 196 0.006% 100.024% ( 250, 380 ] 163 0.005% 100.029% ( 380, 580 ] 171 0.005% 100.034% ( 580, 870 ] 174 0.006% 100.040% ( 870, 1300 ] 124 0.004% 100.044% ( 1300, 1900 ] 52 0.002% 100.046% ( 1900, 2900 ] 41 0.001% 100.047% ( 2900, 4400 ] 40 0.001% 100.048% ( 4400, 6600 ] 15 0.000% 100.049% ( 6600, 9900 ] 1 0.000% 100.049% ** Level 1 read latency histogram (micros): Count: 659735 Average: 5.1663 StdDev: 64.06 Min: 1 Median: 1.9838 Max: 8082 Percentiles: P50: 1.98 P75: 2.99 P99: 9.33 P99.9: 16.81 P99.99: 162.89 ------------------------------------------------------ [ 0, 1 ] 11508 1.744% 1.744% ( 1, 2 ] 323610 49.052% 50.796% ########## ( 2, 3 ] 161115 24.421% 75.217% ##### ( 3, 4 ] 68656 10.407% 85.624% ## ( 4, 6 ] 74112 11.234% 96.857% ## ( 6, 10 ] 17002 2.577% 99.434% # ( 10, 15 ] 2978 0.451% 99.886% ( 15, 22 ] 365 0.055% 99.941% ( 22, 34 ] 24 0.004% 99.945% ( 34, 51 ] 39 0.006% 99.951% ( 51, 76 ] 25 0.004% 99.954% ( 76, 110 ] 79 0.012% 99.966% ( 110, 170 ] 177 0.027% 99.993% ( 170, 250 ] 183 0.028% 100.021% ( 250, 380 ] 224 0.034% 100.055% ( 380, 580 ] 274 0.042% 100.096% ( 580, 870 ] 266 0.040% 100.137% ( 870, 1300 ] 172 0.026% 100.163% ( 1300, 1900 ] 113 0.017% 100.180% ( 1900, 2900 ] 130 0.020% 100.200% ( 2900, 4400 ] 64 0.010% 100.209% ( 4400, 6600 ] 8 0.001% 100.211% ( 6600, 9900 ] 5 0.001% 100.211% ** Level 2 read latency histogram (micros): Count: 156611 Average: 2.7384 StdDev: 26.95 Min: 0 Median: 1.6511 Max: 4566 Percentiles: P50: 1.65 P75: 2.34 P99: 6.85 P99.9: 11.48 P99.99: 13.18 ------------------------------------------------------ [ 0, 1 ] 21284 13.590% 13.590% ### ( 1, 2 ] 87578 55.921% 69.511% ########### ( 2, 3 ] 25230 16.110% 85.621% ### ( 3, 4 ] 10133 6.470% 92.091% # ( 4, 6 ] 10471 6.686% 98.777% # ( 6, 10 ] 1635 1.044% 99.821% ( 10, 15 ] 416 0.266% 100.087% ( 15, 22 ] 38 0.024% 100.111% ( 22, 34 ] 5 0.003% 100.114% ( 34, 51 ] 1 0.001% 100.115% ( 51, 76 ] 1 0.001% 100.116% ( 110, 170 ] 8 0.005% 100.121% ( 170, 250 ] 4 0.003% 100.123% ( 250, 380 ] 4 0.003% 100.126% ( 380, 580 ] 5 0.003% 100.129% ( 580, 870 ] 6 0.004% 100.133% ( 870, 1300 ] 2 0.001% 100.134% ( 1300, 1900 ] 3 0.002% 100.136% ( 1900, 2900 ] 2 0.001% 100.137% ( 2900, 4400 ] 4 0.003% 100.140% ( 4400, 6600 ] 2 0.001% 100.141% ** Level 3 read latency histogram (micros): Count: 940994 Average: 6.3286 StdDev: 85.58 Min: 0 Median: 1.9087 Max: 10186 Percentiles: P50: 1.91 P75: 2.87 P99: 9.35 P99.9: 203.02 P99.99: 453.10 ------------------------------------------------------ [ 0, 1 ] 30503 3.242% 3.242% # ( 1, 2 ] 484202 51.456% 54.698% ########## ( 2, 3 ] 219537 23.330% 78.028% ##### ( 3, 4 ] 87623 9.312% 87.340% ## ( 4, 6 ] 91560 9.730% 97.070% ## ( 6, 10 ] 21666 2.302% 99.373% ( 10, 15 ] 3520 0.374% 99.747% ( 15, 22 ] 477 0.051% 99.797% ( 22, 34 ] 58 0.006% 99.804% ( 34, 51 ] 33 0.004% 99.807% ( 51, 76 ] 7 0.001% 99.808% ( 76, 110 ] 159 0.017% 99.825% ( 110, 170 ] 552 0.059% 99.883% ( 170, 250 ] 378 0.040% 99.924% ( 250, 380 ] 433 0.046% 99.970% ( 380, 580 ] 525 0.056% 100.025% ( 580, 870 ] 506 0.054% 100.079% ( 870, 1300 ] 442 0.047% 100.126% ( 1300, 1900 ] 208 0.022% 100.148% ( 1900, 2900 ] 235 0.025% 100.173% ( 2900, 4400 ] 213 0.023% 100.196% ( 4400, 6600 ] 40 0.004% 100.200% ( 6600, 9900 ] 6 0.001% 100.201% ( 9900, 14000 ] 1 0.000% 100.201% ** Level 4 read latency histogram (micros): Count: 32094 Average: 99.1769 StdDev: 435.00 Min: 0 Median: 1.9821 Max: 8383 Percentiles: P50: 1.98 P75: 3.35 P99: 2364.95 P99.9: 4516.48 P99.99: 6281.65 ------------------------------------------------------ [ 0, 1 ] 854 2.661% 2.661% # ( 1, 2 ] 15470 48.202% 50.863% ########## ( 2, 3 ] 6566 20.459% 71.322% #### ( 3, 4 ] 3353 10.447% 81.769% ## ( 4, 6 ] 2073 6.459% 88.228% # ( 6, 10 ] 747 2.328% 90.556% ( 10, 15 ] 140 0.436% 90.992% ( 15, 22 ] 24 0.075% 91.067% ( 22, 34 ] 1 0.003% 91.070% ( 34, 51 ] 3 0.009% 91.079% ( 51, 76 ] 2 0.006% 91.086% ( 76, 110 ] 39 0.122% 91.207% ( 110, 170 ] 144 0.449% 91.656% ( 170, 250 ] 147 0.458% 92.114% ( 250, 380 ] 287 0.894% 93.008% ( 380, 580 ] 467 1.455% 94.463% ( 580, 870 ] 566 1.764% 96.227% ( 870, 1300 ] 490 1.527% 97.753% ( 1300, 1900 ] 308 0.960% 98.713% ( 1900, 2900 ] 198 0.617% 99.330% ( 2900, 4400 ] 181 0.564% 99.894% ( 4400, 6600 ] 36 0.112% 100.006% ( 6600, 9900 ] 5 0.016% 100.022% ** Level 5 read latency histogram (micros): Count: 140 Average: 1405.4714 StdDev: 1358.27 Min: 105 Median: 843.6364 Max: 7830 Percentiles: P50: 843.64 P75: 2291.30 P99: 6160.00 P99.9: 7830.00 P99.99: 7830.00 ------------------------------------------------------ ( 76, 110 ] 1 0.714% 0.714% ( 110, 170 ] 9 6.429% 7.143% # ( 170, 250 ] 13 9.286% 16.429% ## ( 250, 380 ] 19 13.571% 30.000% ### ( 380, 580 ] 18 12.857% 42.857% ### ( 580, 870 ] 11 7.857% 50.714% ## ( 870, 1300 ] 13 9.286% 60.000% ## ( 1300, 1900 ] 12 8.571% 68.571% ## ( 1900, 2900 ] 23 16.429% 85.000% ### ( 2900, 4400 ] 18 12.857% 97.857% ### ( 4400, 6600 ] 2 1.429% 99.286% ( 6600, 9900 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 31.6 total, 3.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 249.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.226 H:M:S, 29.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.800 H:M:S, 22.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-04:28:36 ... thread 0: (1000000,9000000) ops and (183842.6,244394.7) ops/second in (5.439436,36.825672) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/5 3.07 GB 207.6 8.5 0.0 8.5 17.0 8.5 0.0 2.0 142.6 284.0 61.38 55.64 149 0.412 8889K 16K 0.0 0.0 L1 19/0 1.81 GB 184.9 5.2 5.2 0.0 5.2 5.2 0.2 1.0 221.5 219.4 24.12 22.86 3 8.041 5426K 50K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.3 1.1 0.9 2.7 1.3 203.7 203.3 5.58 4.95 3 1.859 1153K 2443 0.0 0.0 L3 25/8 1.78 GB 1.0 4.0 2.0 2.0 4.0 2.0 1.6 2.0 182.9 181.9 22.63 18.16 16 1.414 4203K 23K 0.0 0.0 L4 197/34 9.79 GB 0.9 2.0 1.8 0.1 2.0 1.8 0.7 1.1 120.5 120.3 16.73 9.79 44 0.380 1978K 1612 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1327/47 104.53 GB 0.0 20.9 9.9 11.0 29.3 18.3 7.6 3.4 164.0 229.9 130.44 111.41 215 0.607 21M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.9 9.9 11.0 29.3 18.3 7.6 3.4 164.0 229.9 130.44 111.41 215 0.607 21M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.9 9.9 11.0 20.8 9.8 0.0 0.0 207.0 206.1 103.31 89.03 93 1.111 21M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 320.4 27.13 22.37 122 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.1 total, 36.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.28 GB write, 809.22 MB/s write, 20.89 GB read, 577.22 MB/s read, 130.4 seconds Interval compaction: 29.28 GB write, 814.22 MB/s write, 20.89 GB read, 580.79 MB/s read, 130.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 50, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3714752 Average: 2.5186 StdDev: 21.57 Min: 0 Median: 1.5571 Max: 7407 Percentiles: P50: 1.56 P75: 1.95 P99: 6.37 P99.9: 12.22 P99.99: 20.61 ------------------------------------------------------ [ 0, 1 ] 535128 14.405% 14.405% ### ( 1, 2 ] 2373637 63.898% 78.303% ############# ( 2, 3 ] 472521 12.720% 91.023% ### ( 3, 4 ] 162432 4.373% 95.396% # ( 4, 6 ] 130721 3.519% 98.915% # ( 6, 10 ] 34317 0.924% 99.839% ( 10, 15 ] 5143 0.138% 99.977% ( 15, 22 ] 602 0.016% 99.993% ( 22, 34 ] 46 0.001% 99.994% ( 34, 51 ] 15 0.000% 99.995% ( 51, 76 ] 27 0.001% 99.996% ( 76, 110 ] 372 0.010% 100.006% ( 110, 170 ] 431 0.012% 100.017% ( 170, 250 ] 230 0.006% 100.023% ( 250, 380 ] 187 0.005% 100.028% ( 380, 580 ] 192 0.005% 100.034% ( 580, 870 ] 193 0.005% 100.039% ( 870, 1300 ] 129 0.003% 100.042% ( 1300, 1900 ] 54 0.001% 100.044% ( 1900, 2900 ] 41 0.001% 100.045% ( 2900, 4400 ] 43 0.001% 100.046% ( 4400, 6600 ] 15 0.000% 100.046% ( 6600, 9900 ] 2 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 675540 Average: 5.6661 StdDev: 73.79 Min: 1 Median: 1.9844 Max: 8266 Percentiles: P50: 1.98 P75: 2.99 P99: 9.40 P99.9: 25.76 P99.99: 276.72 ------------------------------------------------------ [ 0, 1 ] 11740 1.738% 1.738% ( 1, 2 ] 331207 49.028% 50.766% ########## ( 2, 3 ] 164882 24.407% 75.174% ##### ( 3, 4 ] 70219 10.394% 85.568% ## ( 4, 6 ] 75912 11.237% 96.806% ## ( 6, 10 ] 17465 2.585% 99.391% # ( 10, 15 ] 3054 0.452% 99.843% ( 15, 22 ] 377 0.056% 99.899% ( 22, 34 ] 27 0.004% 99.903% ( 34, 51 ] 39 0.006% 99.909% ( 51, 76 ] 26 0.004% 99.912% ( 76, 110 ] 85 0.013% 99.925% ( 110, 170 ] 188 0.028% 99.953% ( 170, 250 ] 198 0.029% 99.982% ( 250, 380 ] 260 0.038% 100.021% ( 380, 580 ] 338 0.050% 100.071% ( 580, 870 ] 328 0.049% 100.119% ( 870, 1300 ] 218 0.032% 100.151% ( 1300, 1900 ] 136 0.020% 100.172% ( 1900, 2900 ] 144 0.021% 100.193% ( 2900, 4400 ] 92 0.014% 100.207% ( 4400, 6600 ] 18 0.003% 100.209% ( 6600, 9900 ] 6 0.001% 100.210% ** Level 2 read latency histogram (micros): Count: 163988 Average: 3.3454 StdDev: 43.00 Min: 0 Median: 1.6674 Max: 4778 Percentiles: P50: 1.67 P75: 2.40 P99: 7.35 P99.9: 12.72 P99.99: 14.35 ------------------------------------------------------ [ 0, 1 ] 21340 13.013% 13.013% ### ( 1, 2 ] 90883 55.421% 68.434% ########### ( 2, 3 ] 27205 16.590% 85.023% ### ( 3, 4 ] 10930 6.665% 91.688% # ( 4, 6 ] 11363 6.929% 98.618% # ( 6, 10 ] 1857 1.132% 99.750% ( 10, 15 ] 452 0.276% 100.026% ( 15, 22 ] 42 0.026% 100.051% ( 22, 34 ] 7 0.004% 100.055% ( 34, 51 ] 2 0.001% 100.057% ( 51, 76 ] 2 0.001% 100.058% ( 110, 170 ] 8 0.005% 100.063% ( 170, 250 ] 7 0.004% 100.067% ( 250, 380 ] 9 0.005% 100.073% ( 380, 580 ] 22 0.013% 100.086% ( 580, 870 ] 33 0.020% 100.106% ( 870, 1300 ] 17 0.010% 100.116% ( 1300, 1900 ] 9 0.005% 100.122% ( 1900, 2900 ] 8 0.005% 100.127% ( 2900, 4400 ] 10 0.006% 100.133% ( 4400, 6600 ] 3 0.002% 100.135% ** Level 3 read latency histogram (micros): Count: 968516 Average: 6.5131 StdDev: 89.03 Min: 0 Median: 1.9143 Max: 10186 Percentiles: P50: 1.91 P75: 2.88 P99: 9.41 P99.9: 237.11 P99.99: 483.55 ------------------------------------------------------ [ 0, 1 ] 30626 3.162% 3.162% # ( 1, 2 ] 496175 51.230% 54.393% ########## ( 2, 3 ] 227069 23.445% 77.838% ##### ( 3, 4 ] 90598 9.354% 87.192% ## ( 4, 6 ] 95133 9.823% 97.015% ## ( 6, 10 ] 22571 2.330% 99.345% ( 10, 15 ] 3693 0.381% 99.726% ( 15, 22 ] 503 0.052% 99.778% ( 22, 34 ] 60 0.006% 99.784% ( 34, 51 ] 34 0.004% 99.788% ( 51, 76 ] 8 0.001% 99.789% ( 76, 110 ] 160 0.017% 99.805% ( 110, 170 ] 566 0.058% 99.864% ( 170, 250 ] 419 0.043% 99.907% ( 250, 380 ] 508 0.052% 99.959% ( 380, 580 ] 572 0.059% 100.018% ( 580, 870 ] 529 0.055% 100.073% ( 870, 1300 ] 451 0.047% 100.120% ( 1300, 1900 ] 212 0.022% 100.142% ( 1900, 2900 ] 246 0.025% 100.167% ( 2900, 4400 ] 245 0.025% 100.192% ( 4400, 6600 ] 43 0.004% 100.197% ( 6600, 9900 ] 9 0.001% 100.198% ( 9900, 14000 ] 1 0.000% 100.198% ** Level 4 read latency histogram (micros): Count: 68938 Average: 53.8811 StdDev: 315.88 Min: 0 Median: 2.1045 Max: 8383 Percentiles: P50: 2.10 P75: 3.38 P99: 1345.45 P99.9: 3646.76 P99.99: 4105.22 ------------------------------------------------------ [ 0, 1 ] 1192 1.729% 1.729% ( 1, 2 ] 31597 45.834% 47.563% ######### ( 2, 3 ] 16072 23.314% 70.877% ##### ( 3, 4 ] 7518 10.905% 81.782% ## ( 4, 6 ] 6605 9.581% 91.363% ## ( 6, 10 ] 2108 3.058% 94.421% # ( 10, 15 ] 389 0.564% 94.985% ( 15, 22 ] 69 0.100% 95.085% ( 22, 34 ] 6 0.009% 95.094% ( 34, 51 ] 5 0.007% 95.101% ( 51, 76 ] 3 0.004% 95.106% ( 76, 110 ] 41 0.059% 95.165% ( 110, 170 ] 186 0.270% 95.435% ( 170, 250 ] 233 0.338% 95.773% ( 250, 380 ] 406 0.589% 96.362% ( 380, 580 ] 595 0.863% 97.225% ( 580, 870 ] 661 0.959% 98.184% ( 870, 1300 ] 538 0.780% 98.964% ( 1300, 1900 ] 325 0.471% 99.436% ( 1900, 2900 ] 219 0.318% 99.753% ( 2900, 4400 ] 203 0.294% 100.048% ( 4400, 6600 ] 40 0.058% 100.106% ( 6600, 9900 ] 5 0.007% 100.113% ** Level 5 read latency histogram (micros): Count: 140 Average: 1405.4714 StdDev: 1358.27 Min: 105 Median: 843.6364 Max: 7830 Percentiles: P50: 843.64 P75: 2291.30 P99: 6160.00 P99.9: 7830.00 P99.99: 7830.00 ------------------------------------------------------ ( 76, 110 ] 1 0.714% 0.714% ( 110, 170 ] 9 6.429% 7.143% # ( 170, 250 ] 13 9.286% 16.429% ## ( 250, 380 ] 19 13.571% 30.000% ### ( 380, 580 ] 18 12.857% 42.857% ### ( 580, 870 ] 11 7.857% 50.714% ## ( 870, 1300 ] 13 9.286% 60.000% ## ( 1300, 1900 ] 12 8.571% 68.571% ## ( 1900, 2900 ] 23 16.429% 85.000% ### ( 2900, 4400 ] 18 12.857% 97.857% ### ( 4400, 6600 ] 2 1.429% 99.286% ( 6600, 9900 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 37.1 total, 5.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 239.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.799 H:M:S, 31.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 180.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.573 H:M:S, 47.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-04:28:51 ... thread 0: (1000000,10000000) ops and (68326.5,194320.9) ops/second in (14.635603,51.461275) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 4.17 GB 75.5 10.4 0.0 10.4 20.0 9.6 0.0 2.1 145.4 279.4 73.18 65.87 169 0.433 10M 22K 0.0 0.0 L1 19/19 1.81 GB 0.0 5.2 5.2 0.0 5.2 5.2 0.2 1.0 221.5 219.4 24.12 22.86 3 8.041 5426K 50K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 0.9 0.3 1.1 0.9 2.7 1.3 203.7 203.3 5.58 4.95 3 1.859 1153K 2443 0.0 0.0 L3 15/0 907.73 MB 0.9 4.0 2.0 2.0 4.0 2.0 1.6 2.0 182.9 181.9 22.63 18.16 16 1.414 4203K 23K 0.0 0.0 L4 189/0 9.65 GB 1.0 4.5 2.7 1.7 4.4 2.7 0.7 1.6 138.7 137.4 33.07 20.91 53 0.624 3793K 14K 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/31 105.59 GB 0.0 25.2 10.8 14.4 34.7 20.3 8.6 3.6 163.0 224.1 158.58 132.76 244 0.650 25M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.2 10.8 14.4 34.7 20.3 8.6 3.6 163.0 224.1 158.58 132.76 244 0.650 25M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.2 10.8 14.4 25.1 10.7 0.0 0.0 203.0 201.9 127.32 107.41 106 1.201 25M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.6 9.6 0.0 0.0 0.0 314.4 31.26 25.35 138 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.7 total, 51.5 interval Flush(GB): cumulative 9.597, interval 9.597 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.70 GB write, 687.39 MB/s write, 25.24 GB read, 500.04 MB/s read, 158.6 seconds Interval compaction: 34.70 GB write, 690.43 MB/s write, 25.24 GB read, 502.25 MB/s read, 158.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 17, pending-compaction-bytes-stops: 0, total-delays: 40, total-stops: 55, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4617103 Average: 2.5145 StdDev: 20.92 Min: 0 Median: 1.5474 Max: 7407 Percentiles: P50: 1.55 P75: 1.94 P99: 6.49 P99.9: 12.85 P99.99: 102.57 ------------------------------------------------------ [ 0, 1 ] 694754 15.047% 15.047% ### ( 1, 2 ] 2948304 63.856% 78.904% ############# ( 2, 3 ] 565106 12.239% 91.143% ## ( 3, 4 ] 195289 4.230% 95.373% # ( 4, 6 ] 162212 3.513% 98.886% # ( 6, 10 ] 43235 0.936% 99.822% ( 10, 15 ] 6291 0.136% 99.959% ( 15, 22 ] 811 0.018% 99.976% ( 22, 34 ] 50 0.001% 99.977% ( 34, 51 ] 19 0.000% 99.978% ( 51, 76 ] 43 0.001% 99.979% ( 76, 110 ] 676 0.015% 99.993% ( 110, 170 ] 739 0.016% 100.009% ( 170, 250 ] 344 0.007% 100.017% ( 250, 380 ] 259 0.006% 100.022% ( 380, 580 ] 266 0.006% 100.028% ( 580, 870 ] 252 0.005% 100.034% ( 870, 1300 ] 153 0.003% 100.037% ( 1300, 1900 ] 64 0.001% 100.038% ( 1900, 2900 ] 49 0.001% 100.039% ( 2900, 4400 ] 49 0.001% 100.040% ( 4400, 6600 ] 15 0.000% 100.041% ( 6600, 9900 ] 3 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 947060 Average: 4.8598 StdDev: 65.96 Min: 1 Median: 1.8266 Max: 8266 Percentiles: P50: 1.83 P75: 2.81 P99: 9.23 P99.9: 54.77 P99.99: 250.63 ------------------------------------------------------ [ 0, 1 ] 80496 8.500% 8.500% ## ( 1, 2 ] 475485 50.206% 58.706% ########## ( 2, 3 ] 190612 20.127% 78.833% #### ( 3, 4 ] 82609 8.723% 87.555% ## ( 4, 6 ] 91011 9.610% 97.165% ## ( 6, 10 ] 21517 2.272% 99.437% ( 10, 15 ] 3742 0.395% 99.832% ( 15, 22 ] 548 0.058% 99.890% ( 22, 34 ] 35 0.004% 99.894% ( 34, 51 ] 43 0.005% 99.898% ( 51, 76 ] 99 0.010% 99.909% ( 76, 110 ] 274 0.029% 99.938% ( 110, 170 ] 278 0.029% 99.967% ( 170, 250 ] 215 0.023% 99.990% ( 250, 380 ] 268 0.028% 100.018% ( 380, 580 ] 350 0.037% 100.055% ( 580, 870 ] 336 0.035% 100.091% ( 870, 1300 ] 223 0.024% 100.114% ( 1300, 1900 ] 140 0.015% 100.129% ( 1900, 2900 ] 154 0.016% 100.145% ( 2900, 4400 ] 105 0.011% 100.156% ( 4400, 6600 ] 23 0.002% 100.159% ( 6600, 9900 ] 7 0.001% 100.159% ** Level 2 read latency histogram (micros): Count: 221990 Average: 4.5767 StdDev: 72.76 Min: 0 Median: 1.7824 Max: 7267 Percentiles: P50: 1.78 P75: 2.69 P99: 8.82 P99.9: 14.64 P99.99: 276.01 ------------------------------------------------------ [ 0, 1 ] 21604 9.732% 9.732% ## ( 1, 2 ] 114259 51.470% 61.202% ########## ( 2, 3 ] 44144 19.886% 81.088% #### ( 3, 4 ] 17622 7.938% 89.026% ## ( 4, 6 ] 19260 8.676% 97.702% ## ( 6, 10 ] 4089 1.842% 99.544% ( 10, 15 ] 851 0.383% 99.927% ( 15, 22 ] 97 0.044% 99.971% ( 22, 34 ] 7 0.003% 99.974% ( 34, 51 ] 4 0.002% 99.976% ( 51, 76 ] 3 0.001% 99.977% ( 110, 170 ] 13 0.006% 99.983% ( 170, 250 ] 11 0.005% 99.988% ( 250, 380 ] 19 0.009% 99.997% ( 380, 580 ] 49 0.022% 100.019% ( 580, 870 ] 65 0.029% 100.048% ( 870, 1300 ] 30 0.014% 100.062% ( 1300, 1900 ] 25 0.011% 100.073% ( 1900, 2900 ] 20 0.009% 100.082% ( 2900, 4400 ] 39 0.018% 100.100% ( 4400, 6600 ] 14 0.006% 100.106% ( 6600, 9900 ] 2 0.001% 100.107% ** Level 3 read latency histogram (micros): Count: 1068290 Average: 6.2689 StdDev: 86.34 Min: 0 Median: 1.8617 Max: 10186 Percentiles: P50: 1.86 P75: 2.80 P99: 9.36 P99.9: 248.33 P99.99: 516.48 ------------------------------------------------------ [ 0, 1 ] 49043 4.591% 4.591% # ( 1, 2 ] 562974 52.699% 57.289% ########### ( 2, 3 ] 235073 22.005% 79.294% #### ( 3, 4 ] 93582 8.760% 88.054% ## ( 4, 6 ] 96806 9.062% 97.116% ## ( 6, 10 ] 23981 2.245% 99.361% ( 10, 15 ] 3780 0.354% 99.714% ( 15, 22 ] 511 0.048% 99.762% ( 22, 34 ] 60 0.006% 99.768% ( 34, 51 ] 34 0.003% 99.771% ( 51, 76 ] 9 0.001% 99.772% ( 76, 110 ] 247 0.023% 99.795% ( 110, 170 ] 685 0.064% 99.859% ( 170, 250 ] 446 0.042% 99.901% ( 250, 380 ] 540 0.051% 99.951% ( 380, 580 ] 604 0.057% 100.008% ( 580, 870 ] 583 0.055% 100.063% ( 870, 1300 ] 466 0.044% 100.106% ( 1300, 1900 ] 219 0.021% 100.127% ( 1900, 2900 ] 253 0.024% 100.150% ( 2900, 4400 ] 254 0.024% 100.174% ( 4400, 6600 ] 45 0.004% 100.178% ( 6600, 9900 ] 9 0.001% 100.179% ( 9900, 14000 ] 1 0.000% 100.179% ** Level 4 read latency histogram (micros): Count: 308687 Average: 19.5220 StdDev: 180.70 Min: 0 Median: 1.7754 Max: 8383 Percentiles: P50: 1.78 P75: 2.71 P99: 513.57 P99.9: 2267.16 P99.99: 3383.03 ------------------------------------------------------ [ 0, 1 ] 24593 7.967% 7.967% ## ( 1, 2 ] 167333 54.208% 62.175% ########### ( 2, 3 ] 55388 17.943% 80.118% #### ( 3, 4 ] 23902 7.743% 87.861% ## ( 4, 6 ] 23166 7.505% 95.366% ## ( 6, 10 ] 7799 2.527% 97.892% # ( 10, 15 ] 1059 0.343% 98.235% ( 15, 22 ] 150 0.049% 98.284% ( 22, 34 ] 14 0.005% 98.289% ( 34, 51 ] 8 0.003% 98.291% ( 51, 76 ] 29 0.009% 98.301% ( 76, 110 ] 129 0.042% 98.342% ( 110, 170 ] 414 0.134% 98.476% ( 170, 250 ] 375 0.121% 98.598% ( 250, 380 ] 602 0.195% 98.793% ( 380, 580 ] 957 0.310% 99.103% ( 580, 870 ] 1062 0.344% 99.447% ( 870, 1300 ] 824 0.267% 99.714% ( 1300, 1900 ] 466 0.151% 99.865% ( 1900, 2900 ] 295 0.096% 99.960% ( 2900, 4400 ] 283 0.092% 100.052% ( 4400, 6600 ] 61 0.020% 100.072% ( 6600, 9900 ] 8 0.003% 100.075% ** Level 5 read latency histogram (micros): Count: 200 Average: 1227.8500 StdDev: 1279.52 Min: 88 Median: 660.5556 Max: 7830 Percentiles: P50: 660.56 P75: 2007.14 P99: 5500.00 P99.9: 7830.00 P99.99: 7830.00 ------------------------------------------------------ ( 76, 110 ] 6 3.000% 3.000% # ( 110, 170 ] 22 11.000% 14.000% ## ( 170, 250 ] 19 9.500% 23.500% ## ( 250, 380 ] 28 14.000% 37.500% ### ( 380, 580 ] 20 10.000% 47.500% ## ( 580, 870 ] 18 9.000% 56.500% ## ( 870, 1300 ] 16 8.000% 64.500% ## ( 1300, 1900 ] 18 9.000% 73.500% ## ( 1900, 2900 ] 28 14.000% 87.500% ### ( 2900, 4400 ] 22 11.000% 98.500% ## ( 4400, 6600 ] 2 1.000% 99.500% ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 51.7 total, 14.6 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 190.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.240 H:M:S, 45.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 67.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.441 H:M:S, 78.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.984 micros/op 167115 ops/sec 60.108 seconds 10044999 operations; 161.9 MB/s Microseconds per write: Count: 10044999 Average: 5.9839 StdDev: 413.91 Min: 1 Median: 1.7742 Max: 661907 Percentiles: P50: 1.77 P75: 2.83 P99: 9.86 P99.9: 1141.98 P99.99: 2638.11 ------------------------------------------------------ [ 0, 1 ] 1158576 11.534% 11.534% ## ( 1, 2 ] 4990862 49.685% 61.219% ########## ( 2, 3 ] 1667528 16.601% 77.819% ### ( 3, 4 ] 1402183 13.959% 91.778% ### ( 4, 6 ] 582758 5.801% 97.580% # ( 6, 10 ] 147827 1.472% 99.052% ( 10, 15 ] 50430 0.502% 99.554% ( 15, 22 ] 10916 0.109% 99.662% ( 22, 34 ] 2164 0.022% 99.684% ( 34, 51 ] 330 0.003% 99.687% ( 51, 76 ] 67 0.001% 99.688% ( 76, 110 ] 6654 0.066% 99.754% ( 110, 170 ] 3010 0.030% 99.784% ( 170, 250 ] 293 0.003% 99.787% ( 250, 380 ] 242 0.002% 99.789% ( 380, 580 ] 51 0.001% 99.790% ( 580, 870 ] 37 0.000% 99.790% ( 870, 1300 ] 17432 0.174% 99.964% ( 1300, 1900 ] 43 0.000% 99.964% ( 1900, 2900 ] 3511 0.035% 99.999% ( 2900, 4400 ] 52 0.001% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 3 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 238664 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10044999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10366438968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 581 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31429398 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31668230996 rocksdb.compact.write.bytes COUNT : 31442253864 rocksdb.flush.write.bytes COUNT : 10304741344 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 53 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 345 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10221808640 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4119552 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31428172576 rocksdb.non.last.level.read.count COUNT : 7596525 rocksdb.block.checksum.compute.count COUNT : 7675422 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.432231 P95 : 3.983044 P99 : 8.652004 P100 : 661904.000000 COUNT : 10044999 SUM : 55214262 rocksdb.compaction.times.micros P50 : 860000.000000 P95 : 4195000.000000 P99 : 11774000.000000 P100 : 12934905.000000 COUNT : 106 SUM : 127323221 rocksdb.compaction.times.cpu_micros P50 : 618333.333333 P95 : 3495000.000000 P99 : 9602000.000000 P100 : 11980229.000000 COUNT : 106 SUM : 107407762 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 698.450704 P95 : 6204.000000 P99 : 65500.000000 P100 : 84670.000000 COUNT : 138 SUM : 340024 rocksdb.compaction.outfile.sync.micros P50 : 1216.529412 P95 : 16050.000000 P99 : 42554.000000 P100 : 97769.000000 COUNT : 419 SUM : 1723353 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.989247 P95 : 1431.250000 P99 : 3575.000000 P100 : 4887.000000 COUNT : 265 SUM : 83135 rocksdb.table.open.io.micros P50 : 1159.137931 P95 : 7659.193548 P99 : 11182.714286 P100 : 14295.000000 COUNT : 581 SUM : 1095204 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.678412 P95 : 8.064662 P99 : 11.653996 P100 : 12926.000000 COUNT : 7673807 SUM : 48936002 rocksdb.read.block.get.micros P50 : 331.250000 P95 : 3138.392857 P99 : 4383.392857 P100 : 7902.000000 COUNT : 1162 SUM : 876904 rocksdb.write.raw.block.micros P50 : 0.514391 P95 : 0.977343 P99 : 2.995045 P100 : 14636.000000 COUNT : 10111027 SUM : 21010476 rocksdb.numfiles.in.singlecompaction P50 : 3.018868 P95 : 8.640000 P99 : 14.575000 P100 : 31.000000 COUNT : 134 SUM : 489 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566806 P95 : 1166.622038 P99 : 2399.038961 P100 : 661706.000000 COUNT : 178783 SUM : 31449821 rocksdb.sst.read.micros P50 : 1.617103 P95 : 4.840911 P99 : 8.759576 P100 : 10186.000000 COUNT : 7596794 SUM : 32443252 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10044999 SUM : 10366438968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215333.333333 P95 : 409857.142857 P99 : 559685.714286 P100 : 827201.000000 COUNT : 138 SUM : 31256936 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 379 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0