[2024-07-14 21:14:02.063039] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 22.11.4 initialization... [2024-07-14 21:14:02.063136] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3831131 ] Set seed to 1720984442060707 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 21:14:02.147547] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 21:14:02.189476] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 21:14:02.189532] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3831131' to capture a snapshot of events at runtime. [2024-07-14 21:14:02.189542] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-14 21:14:02.189552] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-14 21:14:02.189560] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3831131 for offline analysis/debug. [2024-07-14 21:14:02.189649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 21:14:06 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-21:14:09 ... thread 0: (1000000,1000000) ops and (336031.9,336031.9) ops/second in (2.975908,2.975908) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 503.99 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 346.9 2.54 2.30 12 0.212 0 0 0.0 0.0 L1 2/0 187.39 MB 18.7 0.2 0.2 0.0 0.2 0.2 0.2 1.0 255.4 255.2 0.74 0.71 1 0.740 191K 118 0.0 0.0 L2 3/2 190.39 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 9/0 741.23 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/6 97.00 GB 0.0 0.4 0.3 0.1 1.2 1.2 1.0 1.4 94.5 313.4 4.03 3.74 15 0.269 386K 191 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.2 0.6 1.4 94.5 313.4 4.03 3.74 15 0.269 386K 191 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 256.2 256.0 1.49 1.43 3 0.496 386K 191 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 346.9 2.54 2.30 12 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 395.39 MB/s write, 0.37 GB read, 119.28 MB/s read, 4.0 seconds Interval compaction: 1.23 GB write, 423.98 MB/s write, 0.37 GB read, 127.90 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 141347 Average: 1.8422 StdDev: 16.13 Min: 1 Median: 1.1907 Max: 3451 Percentiles: P50: 1.19 P75: 1.65 P99: 4.00 P99.9: 9.45 P99.99: 227.31 ------------------------------------------------------ [ 0, 1 ] 56079 39.675% 39.675% ######## ( 1, 2 ] 76530 54.143% 93.818% ########### ( 2, 3 ] 5478 3.876% 97.694% # ( 3, 4 ] 1851 1.310% 99.003% ( 4, 6 ] 951 0.673% 99.676% ( 6, 10 ] 369 0.261% 99.937% ( 10, 15 ] 53 0.037% 99.975% ( 15, 22 ] 14 0.010% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 110, 170 ] 6 0.004% 99.989% ( 170, 250 ] 4 0.003% 99.992% ( 250, 380 ] 5 0.004% 99.996% ( 380, 580 ] 2 0.001% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.001% ( 2900, 4400 ] 2 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 395 Average: 7.9975 StdDev: 64.96 Min: 0 Median: 1.7013 Max: 1117 Percentiles: P50: 1.70 P75: 2.35 P99: 174.00 P99.9: 1117.00 P99.99: 1117.00 ------------------------------------------------------ [ 0, 1 ] 32 8.101% 8.101% ## ( 1, 2 ] 236 59.747% 67.848% ############ ( 2, 3 ] 80 20.253% 88.101% #### ( 3, 4 ] 17 4.304% 92.405% # ( 4, 6 ] 20 5.063% 97.468% # ( 6, 10 ] 3 0.759% 98.228% ( 10, 15 ] 2 0.506% 98.734% ( 15, 22 ] 1 0.253% 98.987% ( 170, 250 ] 1 0.253% 99.241% ( 250, 380 ] 1 0.253% 99.494% ( 380, 580 ] 1 0.253% 99.747% ( 870, 1300 ] 1 0.253% 100.000% ** Level 2 read latency histogram (micros): Count: 41623 Average: 2.5350 StdDev: 35.46 Min: 1 Median: 1.4559 Max: 4432 Percentiles: P50: 1.46 P75: 1.82 P99: 5.50 P99.9: 9.81 P99.99: 1760.52 ------------------------------------------------------ [ 0, 1 ] 7709 18.521% 18.521% #### ( 1, 2 ] 28738 69.044% 87.565% ############## ( 2, 3 ] 3092 7.429% 94.993% # ( 3, 4 ] 1184 2.845% 97.838% # ( 4, 6 ] 646 1.552% 99.390% ( 6, 10 ] 223 0.536% 99.926% ( 10, 15 ] 13 0.031% 99.957% ( 15, 22 ] 2 0.005% 99.962% ( 22, 34 ] 1 0.002% 99.964% ( 34, 51 ] 1 0.002% 99.966% ( 110, 170 ] 1 0.002% 99.969% ( 170, 250 ] 1 0.002% 99.971% ( 250, 380 ] 2 0.005% 99.976% ( 580, 870 ] 1 0.002% 99.978% ( 870, 1300 ] 1 0.002% 99.981% ( 1300, 1900 ] 5 0.012% 99.993% ( 1900, 2900 ] 1 0.002% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1748.6727 StdDev: 1606.89 Min: 68 Median: 1149.5000 Max: 6572 Percentiles: P50: 1149.50 P75: 2462.50 P99: 6398.33 P99.9: 6572.00 P99.99: 6572.00 ------------------------------------------------------ ( 51, 76 ] 1 1.818% 1.818% ( 76, 110 ] 1 1.818% 3.636% ( 110, 170 ] 2 3.636% 7.273% # ( 170, 250 ] 2 3.636% 10.909% # ( 250, 380 ] 1 1.818% 12.727% ( 380, 580 ] 3 5.455% 18.182% # ( 580, 870 ] 11 20.000% 38.182% #### ( 870, 1300 ] 10 18.182% 56.364% #### ( 1300, 1900 ] 8 14.545% 70.909% ### ( 1900, 2900 ] 4 7.273% 78.182% # ( 2900, 4400 ] 6 10.909% 89.091% ## ( 4400, 6600 ] 6 10.909% 100.000% ## ** Level 4 read latency histogram (micros): Count: 15 Average: 1815.8000 StdDev: 1569.27 Min: 282 Median: 1085.0000 Max: 5814 Percentiles: P50: 1085.00 P75: 3025.00 P99: 5814.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 3 20.000% 26.667% #### ( 580, 870 ] 3 20.000% 46.667% #### ( 870, 1300 ] 1 6.667% 53.333% # ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 3 20.000% 93.333% #### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 608.6000 StdDev: 925.51 Min: 74 Median: 150.0000 Max: 3816 Percentiles: P50: 150.00 P75: 580.00 P99: 3816.00 P99.9: 3816.00 P99.99: 3816.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 5 25.000% 30.000% ##### ( 110, 170 ] 6 30.000% 60.000% ###### ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 308.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.441 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.441 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-21:14:12 ... thread 0: (1000000,2000000) ops and (338832.4,337426.3) ops/second in (2.951312,5.927220) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 1.41 GB 56.7 0.5 0.0 0.5 2.3 1.8 0.0 1.3 70.2 333.1 7.18 6.63 28 0.257 511K 509 0.0 0.0 L1 2/2 187.39 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 255.4 255.2 0.74 0.71 1 0.740 191K 118 0.0 0.0 L2 1/0 2.91 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 18/0 928.71 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 229.9 229.9 0.82 0.74 1 0.816 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/12 97.92 GB 0.0 1.0 0.5 0.6 2.9 2.3 1.0 1.6 113.0 312.2 9.49 8.81 32 0.296 1088K 700 0.0 0.0 Int 0/0 0.00 KB 0.0 1.0 0.5 0.6 2.9 2.3 0.6 1.6 113.0 312.2 9.49 8.81 32 0.296 1088K 700 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.0 0.5 0.6 1.0 0.5 0.0 0.0 259.2 259.0 4.14 3.98 6 0.690 1088K 700 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.3 5.35 4.83 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.89 GB write, 481.97 MB/s write, 1.05 GB read, 174.53 MB/s read, 9.5 seconds Interval compaction: 2.89 GB write, 499.47 MB/s write, 1.05 GB read, 180.86 MB/s read, 9.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 402731 Average: 1.9767 StdDev: 12.33 Min: 1 Median: 1.3580 Max: 3451 Percentiles: P50: 1.36 P75: 1.76 P99: 4.65 P99.9: 9.39 P99.99: 17.89 ------------------------------------------------------ [ 0, 1 ] 111535 27.695% 27.695% ###### ( 1, 2 ] 250951 62.312% 90.007% ############ ( 2, 3 ] 26608 6.607% 96.614% # ( 3, 4 ] 8328 2.068% 98.682% ( 4, 6 ] 3928 0.975% 99.657% ( 6, 10 ] 1155 0.287% 99.944% ( 10, 15 ] 177 0.044% 99.988% ( 15, 22 ] 26 0.006% 99.994% ( 22, 34 ] 6 0.001% 99.996% ( 34, 51 ] 2 0.000% 99.996% ( 51, 76 ] 2 0.000% 99.997% ( 110, 170 ] 15 0.004% 100.000% ( 170, 250 ] 5 0.001% 100.002% ( 250, 380 ] 13 0.003% 100.005% ( 380, 580 ] 4 0.001% 100.006% ( 580, 870 ] 8 0.002% 100.008% ( 870, 1300 ] 3 0.001% 100.009% ( 1300, 1900 ] 2 0.000% 100.009% ( 1900, 2900 ] 3 0.001% 100.010% ( 2900, 4400 ] 3 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 37866 Average: 1.9903 StdDev: 6.71 Min: 0 Median: 1.4062 Max: 1117 Percentiles: P50: 1.41 P75: 1.79 P99: 4.51 P99.9: 8.86 P99.99: 187.07 ------------------------------------------------------ [ 0, 1 ] 8784 23.198% 23.198% ##### ( 1, 2 ] 24984 65.980% 89.178% ############# ( 2, 3 ] 2784 7.352% 96.530% # ( 3, 4 ] 837 2.210% 98.740% ( 4, 6 ] 384 1.014% 99.754% ( 6, 10 ] 77 0.203% 99.958% ( 10, 15 ] 8 0.021% 99.979% ( 15, 22 ] 4 0.011% 99.989% ( 170, 250 ] 1 0.003% 99.992% ( 250, 380 ] 1 0.003% 99.995% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.4895 StdDev: 33.03 Min: 1 Median: 1.4701 Max: 4432 Percentiles: P50: 1.47 P75: 1.83 P99: 5.49 P99.9: 9.79 P99.99: 1684.22 ------------------------------------------------------ [ 0, 1 ] 8456 17.623% 17.623% #### ( 1, 2 ] 33044 68.867% 86.491% ############## ( 2, 3 ] 4018 8.374% 94.865% ## ( 3, 4 ] 1394 2.905% 97.770% # ( 4, 6 ] 792 1.651% 99.421% ( 6, 10 ] 243 0.506% 99.927% ( 10, 15 ] 16 0.033% 99.960% ( 15, 22 ] 3 0.006% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 580, 870 ] 1 0.002% 99.981% ( 870, 1300 ] 1 0.002% 99.983% ( 1300, 1900 ] 5 0.010% 99.994% ( 1900, 2900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 100 Average: 989.7600 StdDev: 1466.12 Min: 1 Median: 420.0000 Max: 6572 Percentiles: P50: 420.00 P75: 1300.00 P99: 6233.33 P99.9: 6563.33 P99.99: 6572.00 ------------------------------------------------------ [ 0, 1 ] 15 15.000% 15.000% ### ( 1, 2 ] 16 16.000% 31.000% ### ( 2, 3 ] 2 2.000% 33.000% ( 4, 6 ] 2 2.000% 35.000% ( 6, 10 ] 5 5.000% 40.000% # ( 51, 76 ] 1 1.000% 41.000% ( 76, 110 ] 1 1.000% 42.000% ( 110, 170 ] 4 4.000% 46.000% # ( 170, 250 ] 2 2.000% 48.000% ( 250, 380 ] 1 1.000% 49.000% ( 380, 580 ] 5 5.000% 54.000% # ( 580, 870 ] 11 11.000% 65.000% ## ( 870, 1300 ] 10 10.000% 75.000% ## ( 1300, 1900 ] 9 9.000% 84.000% ## ( 1900, 2900 ] 4 4.000% 88.000% # ( 2900, 4400 ] 6 6.000% 94.000% # ( 4400, 6600 ] 6 6.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 15 Average: 1815.8000 StdDev: 1569.27 Min: 282 Median: 1085.0000 Max: 5814 Percentiles: P50: 1085.00 P75: 3025.00 P99: 5814.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 3 20.000% 26.667% #### ( 580, 870 ] 3 20.000% 46.667% #### ( 870, 1300 ] 1 6.667% 53.333% # ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 3 20.000% 93.333% #### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 608.6000 StdDev: 925.51 Min: 74 Median: 150.0000 Max: 3816 Percentiles: P50: 150.00 P75: 580.00 P99: 3816.00 P99.9: 3816.00 P99.99: 3816.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 5 25.000% 30.000% ##### ( 110, 170 ] 6 30.000% 60.000% ###### ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.859 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.418 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-21:14:15 ... thread 0: (1000000,3000000) ops and (337506.7,337453.1) ops/second in (2.962904,8.890124) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 1.78 GB 6.3 1.6 0.0 1.6 4.4 2.8 0.0 1.6 116.1 316.9 14.11 13.17 45 0.313 1663K 1752 0.0 0.0 L1 4/4 299.10 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.2 241.5 240.8 4.17 4.05 2 2.083 1021K 2914 0.0 0.0 L2 5/4 518.00 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 18/1 928.71 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.1 1.0 229.9 229.9 0.82 0.74 1 0.816 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/18 98.90 GB 0.0 3.0 1.1 1.8 5.7 3.9 1.5 2.1 152.4 295.1 19.84 18.69 50 0.397 3069K 4739 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.1 1.8 5.7 3.9 1.1 2.1 152.4 295.1 19.84 18.69 50 0.397 3069K 4739 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.1 1.8 2.9 1.1 0.0 0.0 255.5 255.1 11.83 11.50 11 1.076 3069K 4739 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.3 8.00 7.18 39 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.72 GB write, 642.68 MB/s write, 2.95 GB read, 331.97 MB/s read, 19.8 seconds Interval compaction: 5.72 GB write, 658.24 MB/s write, 2.95 GB read, 340.00 MB/s read, 19.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 678020 Average: 2.0543 StdDev: 12.02 Min: 1 Median: 1.4103 Max: 3451 Percentiles: P50: 1.41 P75: 1.80 P99: 5.10 P99.9: 9.43 P99.99: 14.63 ------------------------------------------------------ [ 0, 1 ] 160739 23.707% 23.707% ##### ( 1, 2 ] 434455 64.077% 87.784% ############# ( 2, 3 ] 53485 7.888% 95.673% ## ( 3, 4 ] 17521 2.584% 98.257% # ( 4, 6 ] 9181 1.354% 99.611% ( 6, 10 ] 2288 0.337% 99.948% ( 10, 15 ] 307 0.045% 99.994% ( 15, 22 ] 40 0.006% 99.999% ( 22, 34 ] 12 0.002% 100.001% ( 34, 51 ] 2 0.000% 100.001% ( 51, 76 ] 3 0.000% 100.002% ( 110, 170 ] 21 0.003% 100.005% ( 170, 250 ] 10 0.001% 100.006% ( 250, 380 ] 17 0.003% 100.009% ( 380, 580 ] 8 0.001% 100.010% ( 580, 870 ] 12 0.002% 100.012% ( 870, 1300 ] 10 0.001% 100.013% ( 1300, 1900 ] 3 0.000% 100.014% ( 1900, 2900 ] 5 0.001% 100.015% ( 2900, 4400 ] 4 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 128065 Average: 2.2478 StdDev: 8.66 Min: 0 Median: 1.5349 Max: 1521 Percentiles: P50: 1.53 P75: 1.91 P99: 5.64 P99.9: 10.91 P99.99: 297.53 ------------------------------------------------------ [ 0, 1 ] 18180 14.196% 14.196% ### ( 1, 2 ] 85720 66.935% 81.131% ############# ( 2, 3 ] 16135 12.599% 93.730% ### ( 3, 4 ] 4228 3.301% 97.031% # ( 4, 6 ] 3075 2.401% 99.432% ( 6, 10 ] 578 0.451% 99.884% ( 10, 15 ] 121 0.094% 99.978% ( 15, 22 ] 8 0.006% 99.984% ( 22, 34 ] 4 0.003% 99.988% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 1 0.001% 99.989% ( 250, 380 ] 6 0.005% 99.994% ( 380, 580 ] 2 0.002% 99.995% ( 580, 870 ] 2 0.002% 99.997% ( 870, 1300 ] 3 0.002% 99.999% ( 1300, 1900 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.4895 StdDev: 33.03 Min: 1 Median: 1.4701 Max: 4432 Percentiles: P50: 1.47 P75: 1.83 P99: 5.49 P99.9: 9.79 P99.99: 1684.22 ------------------------------------------------------ [ 0, 1 ] 8456 17.623% 17.623% #### ( 1, 2 ] 33044 68.867% 86.491% ############## ( 2, 3 ] 4018 8.374% 94.865% ## ( 3, 4 ] 1394 2.905% 97.770% # ( 4, 6 ] 792 1.651% 99.421% ( 6, 10 ] 243 0.506% 99.927% ( 10, 15 ] 16 0.033% 99.960% ( 15, 22 ] 3 0.006% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 580, 870 ] 1 0.002% 99.981% ( 870, 1300 ] 1 0.002% 99.983% ( 1300, 1900 ] 5 0.010% 99.994% ( 1900, 2900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 18613 Average: 7.5482 StdDev: 129.46 Min: 1 Median: 1.5784 Max: 6572 Percentiles: P50: 1.58 P75: 1.96 P99: 6.08 P99.9: 1725.80 P99.99: 5917.52 ------------------------------------------------------ [ 0, 1 ] 2212 11.884% 11.884% ## ( 1, 2 ] 12266 65.900% 77.784% ############# ( 2, 3 ] 2698 14.495% 92.280% ### ( 3, 4 ] 725 3.895% 96.175% # ( 4, 6 ] 524 2.815% 98.990% # ( 6, 10 ] 97 0.521% 99.511% ( 10, 15 ] 26 0.140% 99.651% ( 15, 22 ] 4 0.021% 99.672% ( 22, 34 ] 1 0.005% 99.678% ( 51, 76 ] 1 0.005% 99.683% ( 76, 110 ] 1 0.005% 99.688% ( 110, 170 ] 4 0.021% 99.710% ( 170, 250 ] 2 0.011% 99.721% ( 250, 380 ] 1 0.005% 99.726% ( 380, 580 ] 5 0.027% 99.753% ( 580, 870 ] 11 0.059% 99.812% ( 870, 1300 ] 10 0.054% 99.866% ( 1300, 1900 ] 9 0.048% 99.914% ( 1900, 2900 ] 4 0.021% 99.936% ( 2900, 4400 ] 6 0.032% 99.968% ( 4400, 6600 ] 6 0.032% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1815.8000 StdDev: 1569.27 Min: 282 Median: 1085.0000 Max: 5814 Percentiles: P50: 1085.00 P75: 3025.00 P99: 5814.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 3 20.000% 26.667% #### ( 580, 870 ] 3 20.000% 46.667% #### ( 870, 1300 ] 1 6.667% 53.333% # ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 3 20.000% 93.333% #### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 608.6000 StdDev: 925.51 Min: 74 Median: 150.0000 Max: 3816 Percentiles: P50: 150.00 P75: 580.00 P99: 3816.00 P99.9: 3816.00 P99.99: 3816.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 5 25.000% 30.000% ##### ( 110, 170 ] 6 30.000% 60.000% ###### ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 1 5.000% 90.000% # ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.253 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-21:14:18 ... thread 0: (1000000,4000000) ops and (334610.7,336738.0) ops/second in (2.988548,11.878672) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 2.70 GB 69.2 2.2 0.0 2.2 5.8 3.7 0.0 1.6 116.1 314.9 19.00 17.72 60 0.317 2238K 2374 0.0 0.0 L1 4/4 299.10 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.2 241.5 240.8 4.17 4.05 2 2.083 1021K 2914 0.0 0.0 L2 1/0 2.91 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 29/0 945.16 MB 0.9 0.8 0.7 0.1 0.8 0.7 0.1 1.2 216.1 215.8 3.85 3.48 2 1.923 844K 982 0.0 0.0 L4 144/0 9.71 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/17 99.82 GB 0.0 4.1 1.6 2.5 7.8 5.3 2.3 2.1 152.6 288.5 27.76 25.97 66 0.421 4299K 6343 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.6 2.5 7.8 5.3 1.9 2.1 152.6 288.5 27.76 25.97 66 0.421 4299K 6343 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.6 2.5 4.1 1.6 0.0 0.0 248.7 248.3 17.03 16.35 14 1.216 4299K 6343 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.3 10.73 9.62 52 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.82 GB write, 661.98 MB/s write, 4.14 GB read, 350.05 MB/s read, 27.8 seconds Interval compaction: 7.82 GB write, 673.97 MB/s write, 4.14 GB read, 356.39 MB/s read, 27.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1033190 Average: 2.1341 StdDev: 12.52 Min: 1 Median: 1.4551 Max: 4060 Percentiles: P50: 1.46 P75: 1.84 P99: 5.39 P99.9: 9.73 P99.99: 14.80 ------------------------------------------------------ [ 0, 1 ] 210186 20.343% 20.343% #### ( 1, 2 ] 673238 65.161% 85.505% ############# ( 2, 3 ] 96510 9.341% 94.845% ## ( 3, 4 ] 30383 2.941% 97.786% # ( 4, 6 ] 18002 1.742% 99.529% ( 6, 10 ] 4122 0.399% 99.928% ( 10, 15 ] 676 0.065% 99.993% ( 15, 22 ] 67 0.006% 99.999% ( 22, 34 ] 14 0.001% 100.001% ( 34, 51 ] 5 0.000% 100.001% ( 51, 76 ] 5 0.000% 100.002% ( 76, 110 ] 41 0.004% 100.006% ( 110, 170 ] 39 0.004% 100.009% ( 170, 250 ] 23 0.002% 100.012% ( 250, 380 ] 24 0.002% 100.014% ( 380, 580 ] 14 0.001% 100.015% ( 580, 870 ] 18 0.002% 100.017% ( 870, 1300 ] 13 0.001% 100.018% ( 1300, 1900 ] 8 0.001% 100.019% ( 1900, 2900 ] 5 0.000% 100.020% ( 2900, 4400 ] 7 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 178790 Average: 2.2595 StdDev: 7.35 Min: 0 Median: 1.5550 Max: 1521 Percentiles: P50: 1.55 P75: 1.93 P99: 5.68 P99.9: 10.87 P99.99: 31.36 ------------------------------------------------------ [ 0, 1 ] 22953 12.838% 12.838% ### ( 1, 2 ] 119718 66.960% 79.798% ############# ( 2, 3 ] 24010 13.429% 93.227% ### ( 3, 4 ] 6260 3.501% 96.729% # ( 4, 6 ] 4842 2.708% 99.437% # ( 6, 10 ] 798 0.446% 99.883% ( 10, 15 ] 174 0.097% 99.980% ( 15, 22 ] 14 0.008% 99.988% ( 22, 34 ] 4 0.002% 99.990% ( 110, 170 ] 1 0.001% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 6 0.003% 99.995% ( 380, 580 ] 2 0.001% 99.996% ( 580, 870 ] 2 0.001% 99.997% ( 870, 1300 ] 3 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.4895 StdDev: 33.03 Min: 1 Median: 1.4701 Max: 4432 Percentiles: P50: 1.47 P75: 1.83 P99: 5.49 P99.9: 9.79 P99.99: 1684.22 ------------------------------------------------------ [ 0, 1 ] 8456 17.623% 17.623% #### ( 1, 2 ] 33044 68.867% 86.491% ############## ( 2, 3 ] 4018 8.374% 94.865% ## ( 3, 4 ] 1394 2.905% 97.770% # ( 4, 6 ] 792 1.651% 99.421% ( 6, 10 ] 243 0.506% 99.927% ( 10, 15 ] 16 0.033% 99.960% ( 15, 22 ] 3 0.006% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 580, 870 ] 1 0.002% 99.981% ( 870, 1300 ] 1 0.002% 99.983% ( 1300, 1900 ] 5 0.010% 99.994% ( 1900, 2900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 33007 Average: 5.4773 StdDev: 97.47 Min: 0 Median: 1.5949 Max: 6572 Percentiles: P50: 1.59 P75: 1.98 P99: 6.63 P99.9: 955.70 P99.99: 5389.74 ------------------------------------------------------ [ 0, 1 ] 3638 11.022% 11.022% ## ( 1, 2 ] 21627 65.522% 76.544% ############# ( 2, 3 ] 4979 15.085% 91.629% ### ( 3, 4 ] 1359 4.117% 95.746% # ( 4, 6 ] 1047 3.172% 98.918% # ( 6, 10 ] 172 0.521% 99.440% ( 10, 15 ] 47 0.142% 99.582% ( 15, 22 ] 16 0.048% 99.630% ( 22, 34 ] 6 0.018% 99.649% ( 34, 51 ] 13 0.039% 99.688% ( 51, 76 ] 17 0.052% 99.739% ( 76, 110 ] 8 0.024% 99.764% ( 110, 170 ] 12 0.036% 99.800% ( 170, 250 ] 8 0.024% 99.824% ( 250, 380 ] 5 0.015% 99.839% ( 380, 580 ] 7 0.021% 99.861% ( 580, 870 ] 11 0.033% 99.894% ( 870, 1300 ] 10 0.030% 99.924% ( 1300, 1900 ] 9 0.027% 99.952% ( 1900, 2900 ] 4 0.012% 99.964% ( 2900, 4400 ] 6 0.018% 99.982% ( 4400, 6600 ] 6 0.018% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1815.8000 StdDev: 1569.27 Min: 282 Median: 1085.0000 Max: 5814 Percentiles: P50: 1085.00 P75: 3025.00 P99: 5814.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 3 20.000% 26.667% #### ( 580, 870 ] 3 20.000% 46.667% #### ( 870, 1300 ] 1 6.667% 53.333% # ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 3 20.000% 93.333% #### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 631.3750 StdDev: 814.38 Min: 74 Median: 170.0000 Max: 3816 Percentiles: P50: 170.00 P75: 977.50 P99: 3800.00 P99.9: 3816.00 P99.99: 3816.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 9 22.500% 25.000% ##### ( 110, 170 ] 10 25.000% 50.000% ##### ( 250, 380 ] 4 10.000% 60.000% ## ( 380, 580 ] 3 7.500% 67.500% ## ( 580, 870 ] 2 5.000% 72.500% # ( 870, 1300 ] 4 10.000% 82.500% ## ( 1300, 1900 ] 3 7.500% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.656 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-21:14:22 ... thread 0: (1000000,5000000) ops and (218082.9,303691.3) ops/second in (4.585413,16.464085) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 3.75 GB 207.7 3.5 0.0 3.5 8.2 4.7 0.0 1.7 131.7 309.5 27.26 25.57 81 0.337 3645K 3838 0.0 0.0 L1 4/4 299.10 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.2 241.5 240.8 4.17 4.05 2 2.083 1021K 2914 0.0 0.0 L2 1/0 2.91 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 29/0 945.16 MB 0.9 0.8 0.7 0.1 0.8 0.7 0.1 1.2 216.1 215.8 3.85 3.48 2 1.923 844K 982 0.0 0.0 L4 144/0 9.71 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/13 100.87 GB 0.0 5.5 1.6 3.9 10.2 6.3 2.3 2.2 156.0 290.5 36.02 33.82 87 0.414 5706K 7807 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.6 3.9 10.2 6.3 1.9 2.2 156.0 290.5 36.02 33.82 87 0.414 5706K 7807 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.6 3.9 5.5 1.6 0.0 0.0 252.6 252.2 22.25 21.48 19 1.171 5706K 7807 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.3 13.77 12.34 68 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.7 total, 16.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.22 GB write, 627.20 MB/s write, 5.49 GB read, 336.91 MB/s read, 36.0 seconds Interval compaction: 10.22 GB write, 635.40 MB/s write, 5.49 GB read, 341.32 MB/s read, 36.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 16, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1566747 Average: 2.1774 StdDev: 11.41 Min: 1 Median: 1.4728 Max: 4060 Percentiles: P50: 1.47 P75: 1.85 P99: 5.53 P99.9: 9.90 P99.99: 58.27 ------------------------------------------------------ [ 0, 1 ] 293693 18.745% 18.745% #### ( 1, 2 ] 1035614 66.100% 84.845% ############# ( 2, 3 ] 152294 9.720% 94.565% ## ( 3, 4 ] 47800 3.051% 97.616% # ( 4, 6 ] 28320 1.808% 99.424% ( 6, 10 ] 7659 0.489% 99.913% ( 10, 15 ] 1082 0.069% 99.982% ( 15, 22 ] 96 0.006% 99.988% ( 22, 34 ] 22 0.001% 99.989% ( 34, 51 ] 9 0.001% 99.990% ( 51, 76 ] 8 0.001% 99.990% ( 76, 110 ] 177 0.011% 100.002% ( 110, 170 ] 121 0.008% 100.009% ( 170, 250 ] 63 0.004% 100.013% ( 250, 380 ] 46 0.003% 100.016% ( 380, 580 ] 44 0.003% 100.019% ( 580, 870 ] 27 0.002% 100.021% ( 870, 1300 ] 20 0.001% 100.022% ( 1300, 1900 ] 12 0.001% 100.023% ( 1900, 2900 ] 5 0.000% 100.023% ( 2900, 4400 ] 8 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 233221 Average: 2.2950 StdDev: 7.41 Min: 0 Median: 1.5374 Max: 1521 Percentiles: P50: 1.54 P75: 1.91 P99: 5.88 P99.9: 13.70 P99.99: 261.02 ------------------------------------------------------ [ 0, 1 ] 32567 13.964% 13.964% ### ( 1, 2 ] 156394 67.058% 81.022% ############# ( 2, 3 ] 28874 12.381% 93.403% ## ( 3, 4 ] 7725 3.312% 96.715% # ( 4, 6 ] 5677 2.434% 99.149% ( 6, 10 ] 1582 0.678% 99.828% ( 10, 15 ] 228 0.098% 99.925% ( 15, 22 ] 25 0.011% 99.936% ( 22, 34 ] 5 0.002% 99.938% ( 51, 76 ] 2 0.001% 99.939% ( 76, 110 ] 74 0.032% 99.971% ( 110, 170 ] 39 0.017% 99.988% ( 170, 250 ] 5 0.002% 99.990% ( 250, 380 ] 8 0.003% 99.993% ( 380, 580 ] 7 0.003% 99.996% ( 580, 870 ] 4 0.002% 99.998% ( 870, 1300 ] 3 0.001% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.4895 StdDev: 33.03 Min: 1 Median: 1.4701 Max: 4432 Percentiles: P50: 1.47 P75: 1.83 P99: 5.49 P99.9: 9.79 P99.99: 1684.22 ------------------------------------------------------ [ 0, 1 ] 8456 17.623% 17.623% #### ( 1, 2 ] 33044 68.867% 86.491% ############## ( 2, 3 ] 4018 8.374% 94.865% ## ( 3, 4 ] 1394 2.905% 97.770% # ( 4, 6 ] 792 1.651% 99.421% ( 6, 10 ] 243 0.506% 99.927% ( 10, 15 ] 16 0.033% 99.960% ( 15, 22 ] 3 0.006% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 580, 870 ] 1 0.002% 99.981% ( 870, 1300 ] 1 0.002% 99.983% ( 1300, 1900 ] 5 0.010% 99.994% ( 1900, 2900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 33007 Average: 5.4773 StdDev: 97.47 Min: 0 Median: 1.5949 Max: 6572 Percentiles: P50: 1.59 P75: 1.98 P99: 6.63 P99.9: 955.70 P99.99: 5389.74 ------------------------------------------------------ [ 0, 1 ] 3638 11.022% 11.022% ## ( 1, 2 ] 21627 65.522% 76.544% ############# ( 2, 3 ] 4979 15.085% 91.629% ### ( 3, 4 ] 1359 4.117% 95.746% # ( 4, 6 ] 1047 3.172% 98.918% # ( 6, 10 ] 172 0.521% 99.440% ( 10, 15 ] 47 0.142% 99.582% ( 15, 22 ] 16 0.048% 99.630% ( 22, 34 ] 6 0.018% 99.649% ( 34, 51 ] 13 0.039% 99.688% ( 51, 76 ] 17 0.052% 99.739% ( 76, 110 ] 8 0.024% 99.764% ( 110, 170 ] 12 0.036% 99.800% ( 170, 250 ] 8 0.024% 99.824% ( 250, 380 ] 5 0.015% 99.839% ( 380, 580 ] 7 0.021% 99.861% ( 580, 870 ] 11 0.033% 99.894% ( 870, 1300 ] 10 0.030% 99.924% ( 1300, 1900 ] 9 0.027% 99.952% ( 1900, 2900 ] 4 0.012% 99.964% ( 2900, 4400 ] 6 0.018% 99.982% ( 4400, 6600 ] 6 0.018% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 1815.8000 StdDev: 1569.27 Min: 282 Median: 1085.0000 Max: 5814 Percentiles: P50: 1085.00 P75: 3025.00 P99: 5814.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ ( 250, 380 ] 1 6.667% 6.667% # ( 380, 580 ] 3 20.000% 26.667% #### ( 580, 870 ] 3 20.000% 46.667% #### ( 870, 1300 ] 1 6.667% 53.333% # ( 1300, 1900 ] 1 6.667% 60.000% # ( 1900, 2900 ] 2 13.333% 73.333% ### ( 2900, 4400 ] 3 20.000% 93.333% #### ( 4400, 6600 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 631.3750 StdDev: 814.38 Min: 74 Median: 170.0000 Max: 3816 Percentiles: P50: 170.00 P75: 977.50 P99: 3800.00 P99.9: 3816.00 P99.99: 3816.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 76, 110 ] 9 22.500% 25.000% ##### ( 110, 170 ] 10 25.000% 50.000% ##### ( 250, 380 ] 4 10.000% 60.000% ## ( 380, 580 ] 3 7.500% 67.500% ## ( 580, 870 ] 2 5.000% 72.500% # ( 870, 1300 ] 4 10.000% 82.500% ## ( 1300, 1900 ] 3 7.500% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 16.7 total, 4.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 294.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.537 H:M:S, 21.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 214.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.881 H:M:S, 41.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-21:14:26 ... thread 0: (1000000,6000000) ops and (278955.3,299268.5) ops/second in (3.584804,20.048889) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 2.89 GB 37.8 4.0 0.0 4.0 9.6 5.6 0.0 1.7 129.6 310.9 31.60 29.63 96 0.329 4157K 4319 0.0 0.0 L1 14/14 1.49 GB 0.0 3.0 2.5 0.5 3.0 2.5 0.2 1.2 235.4 233.7 13.03 12.60 3 4.344 3114K 22K 0.0 0.0 L2 1/0 2.91 MB 0.0 0.2 0.1 0.1 0.2 0.1 1.1 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 16/0 897.17 MB 0.9 0.8 0.7 0.1 0.8 0.7 0.6 1.2 216.1 215.8 3.85 3.48 2 1.923 844K 982 0.0 0.0 L4 166/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.3 1.0 129.0 129.0 0.31 0.20 1 0.309 40K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/27 101.71 GB 0.0 8.0 3.4 4.7 13.6 8.9 4.5 2.4 166.1 281.2 49.53 46.64 104 0.476 8352K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 3.4 4.7 13.6 8.9 4.0 2.4 166.1 281.2 49.53 46.64 104 0.476 8352K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 3.4 4.7 8.0 3.3 0.0 0.0 247.2 246.4 33.27 32.06 23 1.447 8352K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 352.5 16.27 14.58 81 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.3 total, 20.1 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.60 GB write, 687.34 MB/s write, 8.03 GB read, 405.87 MB/s read, 49.5 seconds Interval compaction: 13.60 GB write, 694.72 MB/s write, 8.03 GB read, 410.23 MB/s read, 49.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 17, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1911258 Average: 2.2008 StdDev: 11.59 Min: 1 Median: 1.4717 Max: 4163 Percentiles: P50: 1.47 P75: 1.85 P99: 5.57 P99.9: 10.43 P99.99: 107.68 ------------------------------------------------------ [ 0, 1 ] 358436 18.754% 18.754% #### ( 1, 2 ] 1266067 66.243% 84.997% ############# ( 2, 3 ] 184166 9.636% 94.632% ## ( 3, 4 ] 57126 2.989% 97.621% # ( 4, 6 ] 33529 1.754% 99.376% ( 6, 10 ] 9902 0.518% 99.894% ( 10, 15 ] 1422 0.074% 99.968% ( 15, 22 ] 129 0.007% 99.975% ( 22, 34 ] 25 0.001% 99.976% ( 34, 51 ] 10 0.001% 99.977% ( 51, 76 ] 8 0.000% 99.977% ( 76, 110 ] 266 0.014% 99.991% ( 110, 170 ] 223 0.012% 100.003% ( 170, 250 ] 117 0.006% 100.009% ( 250, 380 ] 85 0.004% 100.013% ( 380, 580 ] 67 0.004% 100.017% ( 580, 870 ] 53 0.003% 100.020% ( 870, 1300 ] 28 0.001% 100.021% ( 1300, 1900 ] 12 0.001% 100.022% ( 1900, 2900 ] 5 0.000% 100.022% ( 2900, 4400 ] 9 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 254825 Average: 2.4436 StdDev: 12.37 Min: 0 Median: 1.5292 Max: 1557 Percentiles: P50: 1.53 P75: 1.90 P99: 5.97 P99.9: 92.89 P99.99: 624.01 ------------------------------------------------------ [ 0, 1 ] 37234 14.612% 14.612% ### ( 1, 2 ] 170398 66.869% 81.480% ############# ( 2, 3 ] 30539 11.984% 93.465% ## ( 3, 4 ] 8243 3.235% 96.699% # ( 4, 6 ] 5961 2.339% 99.039% ( 6, 10 ] 1867 0.733% 99.771% ( 10, 15 ] 245 0.096% 99.867% ( 15, 22 ] 25 0.010% 99.877% ( 22, 34 ] 6 0.002% 99.880% ( 34, 51 ] 1 0.000% 99.880% ( 51, 76 ] 2 0.001% 99.881% ( 76, 110 ] 99 0.039% 99.920% ( 110, 170 ] 128 0.050% 99.970% ( 170, 250 ] 12 0.005% 99.974% ( 250, 380 ] 16 0.006% 99.981% ( 380, 580 ] 22 0.009% 99.989% ( 580, 870 ] 10 0.004% 99.993% ( 870, 1300 ] 13 0.005% 99.998% ( 1300, 1900 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47982 Average: 2.4895 StdDev: 33.03 Min: 1 Median: 1.4701 Max: 4432 Percentiles: P50: 1.47 P75: 1.83 P99: 5.49 P99.9: 9.79 P99.99: 1684.22 ------------------------------------------------------ [ 0, 1 ] 8456 17.623% 17.623% #### ( 1, 2 ] 33044 68.867% 86.491% ############## ( 2, 3 ] 4018 8.374% 94.865% ## ( 3, 4 ] 1394 2.905% 97.770% # ( 4, 6 ] 792 1.651% 99.421% ( 6, 10 ] 243 0.506% 99.927% ( 10, 15 ] 16 0.033% 99.960% ( 15, 22 ] 3 0.006% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 110, 170 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 2 0.004% 99.979% ( 580, 870 ] 1 0.002% 99.981% ( 870, 1300 ] 1 0.002% 99.983% ( 1300, 1900 ] 5 0.010% 99.994% ( 1900, 2900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 43140 Average: 5.1778 StdDev: 86.82 Min: 0 Median: 1.5852 Max: 6572 Percentiles: P50: 1.59 P75: 1.97 P99: 8.34 P99.9: 742.81 P99.99: 5018.20 ------------------------------------------------------ [ 0, 1 ] 5252 12.174% 12.174% ## ( 1, 2 ] 27886 64.641% 76.815% ############# ( 2, 3 ] 6545 15.172% 91.987% ### ( 3, 4 ] 1571 3.642% 95.628% # ( 4, 6 ] 1267 2.937% 98.565% # ( 6, 10 ] 321 0.744% 99.309% ( 10, 15 ] 91 0.211% 99.520% ( 15, 22 ] 18 0.042% 99.562% ( 22, 34 ] 6 0.014% 99.576% ( 34, 51 ] 13 0.030% 99.606% ( 51, 76 ] 18 0.042% 99.648% ( 76, 110 ] 16 0.037% 99.685% ( 110, 170 ] 28 0.065% 99.750% ( 170, 250 ] 23 0.053% 99.803% ( 250, 380 ] 17 0.039% 99.842% ( 380, 580 ] 17 0.039% 99.882% ( 580, 870 ] 14 0.032% 99.914% ( 870, 1300 ] 11 0.025% 99.940% ( 1300, 1900 ] 9 0.021% 99.961% ( 1900, 2900 ] 5 0.012% 99.972% ( 2900, 4400 ] 6 0.014% 99.986% ( 4400, 6600 ] 6 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 85 Average: 322.3765 StdDev: 955.25 Min: 0 Median: 1.3421 Max: 5814 Percentiles: P50: 1.34 P75: 7.22 P99: 4730.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ [ 0, 1 ] 36 42.353% 42.353% ######## ( 1, 2 ] 19 22.353% 64.706% #### ( 2, 3 ] 1 1.176% 65.882% ( 3, 4 ] 2 2.353% 68.235% ( 4, 6 ] 3 3.529% 71.765% # ( 6, 10 ] 9 10.588% 82.353% ## ( 250, 380 ] 1 1.176% 83.529% ( 380, 580 ] 3 3.529% 87.059% # ( 580, 870 ] 3 3.529% 90.588% # ( 870, 1300 ] 1 1.176% 91.765% ( 1300, 1900 ] 1 1.176% 92.941% ( 1900, 2900 ] 2 2.353% 95.294% ( 2900, 4400 ] 3 3.529% 98.824% # ( 4400, 6600 ] 1 1.176% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 709.5125 StdDev: 845.78 Min: 74 Median: 298.7500 Max: 3816 Percentiles: P50: 298.75 P75: 1031.25 P99: 3800.00 P99.9: 3816.00 P99.99: 3816.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 19 23.750% 41.250% ##### ( 170, 250 ] 4 5.000% 46.250% # ( 250, 380 ] 8 10.000% 56.250% ## ( 380, 580 ] 5 6.250% 62.500% # ( 580, 870 ] 7 8.750% 71.250% ## ( 870, 1300 ] 8 10.000% 81.250% ## ( 1300, 1900 ] 4 5.000% 86.250% # ( 1900, 2900 ] 9 11.250% 97.500% ## ( 2900, 4400 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 20.3 total, 3.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 291.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.548 H:M:S, 22.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.011 H:M:S, 28.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-21:14:40 ... thread 0: (1000000,7000000) ops and (69400.3,203145.6) ops/second in (14.409157,34.458046) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 3/3 1.77 GB 0.0 7.0 0.0 7.0 13.6 6.7 0.0 2.0 153.4 301.0 46.40 43.66 117 0.397 7226K 15K 0.0 0.0 L1 14/14 1.63 GB 0.0 6.7 4.7 2.0 6.6 4.7 0.2 1.4 231.8 229.0 29.60 28.27 4 7.399 6965K 81K 0.0 0.0 L2 7/4 775.59 MB 3.9 0.2 0.1 0.1 0.2 0.1 3.1 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 26/12 2.13 GB 0.9 0.8 0.7 0.1 0.8 0.7 1.9 1.2 216.1 215.8 3.85 3.48 2 1.923 844K 982 0.0 0.0 L4 166/9 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.3 1.0 129.0 129.0 0.31 0.20 1 0.309 40K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/42 102.75 GB 0.0 14.7 5.6 9.1 21.3 12.2 7.7 3.2 185.9 269.6 80.90 76.34 126 0.642 15M 97K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.7 5.6 9.1 21.3 12.2 7.3 3.2 185.9 269.6 80.90 76.34 126 0.642 15M 97K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.7 5.6 9.1 14.6 5.5 0.0 0.0 245.0 243.4 61.39 58.85 30 2.046 15M 97K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 352.0 19.51 17.49 96 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.7 total, 34.5 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.30 GB write, 628.92 MB/s write, 14.69 GB read, 433.72 MB/s read, 80.9 seconds Interval compaction: 21.30 GB write, 632.85 MB/s write, 14.69 GB read, 436.43 MB/s read, 80.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 22, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3083765 Average: 2.4090 StdDev: 13.31 Min: 1 Median: 1.4753 Max: 4652 Percentiles: P50: 1.48 P75: 1.85 P99: 5.87 P99.9: 103.07 P99.99: 222.52 ------------------------------------------------------ [ 0, 1 ] 568622 18.439% 18.439% #### ( 1, 2 ] 2047827 66.407% 84.846% ############# ( 2, 3 ] 294275 9.543% 94.389% ## ( 3, 4 ] 91784 2.976% 97.365% # ( 4, 6 ] 53865 1.747% 99.112% ( 6, 10 ] 19858 0.644% 99.756% ( 10, 15 ] 2142 0.069% 99.825% ( 15, 22 ] 251 0.008% 99.833% ( 22, 34 ] 38 0.001% 99.835% ( 34, 51 ] 19 0.001% 99.835% ( 51, 76 ] 22 0.001% 99.836% ( 76, 110 ] 2485 0.081% 99.916% ( 110, 170 ] 1964 0.064% 99.980% ( 170, 250 ] 464 0.015% 99.995% ( 250, 380 ] 345 0.011% 100.006% ( 380, 580 ] 245 0.008% 100.014% ( 580, 870 ] 124 0.004% 100.018% ( 870, 1300 ] 47 0.002% 100.020% ( 1300, 1900 ] 20 0.001% 100.020% ( 1900, 2900 ] 8 0.000% 100.021% ( 2900, 4400 ] 13 0.000% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 642923 Average: 2.6728 StdDev: 16.25 Min: 0 Median: 1.4742 Max: 2044 Percentiles: P50: 1.47 P75: 1.86 P99: 7.85 P99.9: 153.33 P99.99: 785.23 ------------------------------------------------------ [ 0, 1 ] 124280 19.330% 19.330% #### ( 1, 2 ] 415862 64.683% 84.013% ############# ( 2, 3 ] 61422 9.554% 93.567% ## ( 3, 4 ] 18888 2.938% 96.505% # ( 4, 6 ] 12671 1.971% 98.476% ( 6, 10 ] 7299 1.135% 99.611% ( 10, 15 ] 582 0.091% 99.702% ( 15, 22 ] 99 0.015% 99.717% ( 22, 34 ] 7 0.001% 99.718% ( 34, 51 ] 3 0.000% 99.718% ( 51, 76 ] 62 0.010% 99.728% ( 76, 110 ] 732 0.114% 99.842% ( 110, 170 ] 518 0.081% 99.923% ( 170, 250 ] 154 0.024% 99.946% ( 250, 380 ] 114 0.018% 99.964% ( 380, 580 ] 121 0.019% 99.983% ( 580, 870 ] 66 0.010% 99.993% ( 870, 1300 ] 28 0.004% 99.998% ( 1300, 1900 ] 16 0.002% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 48368 Average: 2.7895 StdDev: 34.25 Min: 1 Median: 1.4721 Max: 4432 Percentiles: P50: 1.47 P75: 1.84 P99: 5.66 P99.9: 166.72 P99.99: 1679.58 ------------------------------------------------------ [ 0, 1 ] 8465 17.501% 17.501% #### ( 1, 2 ] 33294 68.835% 86.336% ############## ( 2, 3 ] 4063 8.400% 94.736% ## ( 3, 4 ] 1399 2.892% 97.629% # ( 4, 6 ] 797 1.648% 99.276% ( 6, 10 ] 246 0.509% 99.785% ( 10, 15 ] 20 0.041% 99.826% ( 15, 22 ] 4 0.008% 99.835% ( 22, 34 ] 1 0.002% 99.837% ( 34, 51 ] 1 0.002% 99.839% ( 76, 110 ] 6 0.012% 99.851% ( 110, 170 ] 25 0.052% 99.903% ( 170, 250 ] 16 0.033% 99.936% ( 250, 380 ] 11 0.023% 99.959% ( 380, 580 ] 8 0.017% 99.975% ( 580, 870 ] 3 0.006% 99.981% ( 870, 1300 ] 1 0.002% 99.983% ( 1300, 1900 ] 5 0.010% 99.994% ( 1900, 2900 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 43279 Average: 6.3090 StdDev: 90.56 Min: 0 Median: 1.5877 Max: 6572 Percentiles: P50: 1.59 P75: 1.98 P99: 10.23 P99.9: 867.11 P99.99: 5013.10 ------------------------------------------------------ [ 0, 1 ] 5252 12.135% 12.135% ## ( 1, 2 ] 27886 64.433% 76.568% ############# ( 2, 3 ] 6545 15.123% 91.691% ### ( 3, 4 ] 1571 3.630% 95.321% # ( 4, 6 ] 1267 2.928% 98.249% # ( 6, 10 ] 321 0.742% 98.990% ( 10, 15 ] 91 0.210% 99.201% ( 15, 22 ] 18 0.042% 99.242% ( 22, 34 ] 6 0.014% 99.256% ( 34, 51 ] 13 0.030% 99.286% ( 51, 76 ] 18 0.042% 99.328% ( 76, 110 ] 16 0.037% 99.365% ( 110, 170 ] 57 0.132% 99.496% ( 170, 250 ] 58 0.134% 99.630% ( 250, 380 ] 53 0.122% 99.753% ( 380, 580 ] 36 0.083% 99.836% ( 580, 870 ] 28 0.065% 99.901% ( 870, 1300 ] 12 0.028% 99.928% ( 1300, 1900 ] 13 0.030% 99.958% ( 1900, 2900 ] 6 0.014% 99.972% ( 2900, 4400 ] 6 0.014% 99.986% ( 4400, 6600 ] 6 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 85 Average: 322.3765 StdDev: 955.25 Min: 0 Median: 1.3421 Max: 5814 Percentiles: P50: 1.34 P75: 7.22 P99: 4730.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ [ 0, 1 ] 36 42.353% 42.353% ######## ( 1, 2 ] 19 22.353% 64.706% #### ( 2, 3 ] 1 1.176% 65.882% ( 3, 4 ] 2 2.353% 68.235% ( 4, 6 ] 3 3.529% 71.765% # ( 6, 10 ] 9 10.588% 82.353% ## ( 250, 380 ] 1 1.176% 83.529% ( 380, 580 ] 3 3.529% 87.059% # ( 580, 870 ] 3 3.529% 90.588% # ( 870, 1300 ] 1 1.176% 91.765% ( 1300, 1900 ] 1 1.176% 92.941% ( 1900, 2900 ] 2 2.353% 95.294% ( 2900, 4400 ] 3 3.529% 98.824% # ( 4400, 6600 ] 1 1.176% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 709.5125 StdDev: 845.78 Min: 74 Median: 298.7500 Max: 3816 Percentiles: P50: 298.75 P75: 1031.25 P99: 3800.00 P99.9: 3816.00 P99.99: 3816.00 ------------------------------------------------------ ( 51, 76 ] 1 1.250% 1.250% ( 76, 110 ] 13 16.250% 17.500% ### ( 110, 170 ] 19 23.750% 41.250% ##### ( 170, 250 ] 4 5.000% 46.250% # ( 250, 380 ] 8 10.000% 56.250% ## ( 380, 580 ] 5 6.250% 62.500% # ( 580, 870 ] 7 8.750% 71.250% ## ( 870, 1300 ] 8 10.000% 81.250% ## ( 1300, 1900 ] 4 5.000% 86.250% # ( 1900, 2900 ] 9 11.250% 97.500% ## ( 2900, 4400 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 34.7 total, 14.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 198.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.784 H:M:S, 45.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 68.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.236 H:M:S, 78.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 0 2024/07/14-21:14:46 ... thread 0: (1000000,8000000) ops and (193506.6,201888.5) ops/second in (5.167783,39.625829) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/7 2.70 GB 56.7 7.3 0.0 7.3 14.9 7.6 0.0 1.9 141.9 290.7 52.39 47.54 129 0.406 7546K 15K 0.0 0.0 L1 14/14 1.63 GB 0.0 6.7 4.7 2.0 6.6 4.7 0.2 1.4 231.8 229.0 29.60 28.27 4 7.399 6965K 81K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 14/0 987.27 MB 1.0 2.8 1.4 1.3 2.8 1.4 1.9 1.9 171.6 170.8 16.55 12.51 9 1.839 2884K 13K 0.0 0.0 L4 169/0 9.52 GB 1.0 2.2 1.7 0.5 2.2 1.7 1.5 1.3 144.1 143.0 15.55 10.17 25 0.622 2228K 15K 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/21 103.64 GB 0.0 19.1 8.0 11.1 26.6 15.5 10.0 3.5 170.4 237.3 114.83 99.20 169 0.679 19M 126K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.1 8.0 11.1 26.6 15.5 9.6 3.5 170.4 237.3 114.83 99.20 169 0.679 19M 126K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.1 8.0 11.1 19.0 7.9 0.0 0.0 215.7 214.3 90.69 79.12 62 1.463 19M 126K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 323.6 24.14 20.08 107 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.8 total, 39.6 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.61 GB write, 683.85 MB/s write, 19.11 GB read, 491.02 MB/s read, 114.8 seconds Interval compaction: 26.61 GB write, 687.56 MB/s write, 19.11 GB read, 493.69 MB/s read, 114.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 48, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3462369 Average: 2.6321 StdDev: 27.53 Min: 1 Median: 1.5123 Max: 13448 Percentiles: P50: 1.51 P75: 1.90 P99: 6.43 P99.9: 102.00 P99.99: 256.19 ------------------------------------------------------ [ 0, 1 ] 580955 16.779% 16.779% ### ( 1, 2 ] 2245012 64.840% 81.619% ############# ( 2, 3 ] 381019 11.005% 92.624% ## ( 3, 4 ] 125830 3.634% 96.258% # ( 4, 6 ] 91917 2.655% 98.913% # ( 6, 10 ] 27948 0.807% 99.720% ( 10, 15 ] 3800 0.110% 99.830% ( 15, 22 ] 415 0.012% 99.842% ( 22, 34 ] 55 0.002% 99.844% ( 34, 51 ] 22 0.001% 99.844% ( 51, 76 ] 27 0.001% 99.845% ( 76, 110 ] 2497 0.072% 99.917% ( 110, 170 ] 2004 0.058% 99.975% ( 170, 250 ] 505 0.015% 99.990% ( 250, 380 ] 415 0.012% 100.002% ( 380, 580 ] 295 0.009% 100.010% ( 580, 870 ] 169 0.005% 100.015% ( 870, 1300 ] 88 0.003% 100.017% ( 1300, 1900 ] 48 0.001% 100.019% ( 1900, 2900 ] 34 0.001% 100.020% ( 2900, 4400 ] 74 0.002% 100.022% ( 4400, 6600 ] 15 0.000% 100.022% ( 6600, 9900 ] 5 0.000% 100.023% ( 9900, 14000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1098831 Average: 3.9546 StdDev: 58.34 Min: 0 Median: 1.6411 Max: 11524 Percentiles: P50: 1.64 P75: 2.26 P99: 8.83 P99.9: 133.24 P99.99: 471.28 ------------------------------------------------------ [ 0, 1 ] 133409 12.141% 12.141% ## ( 1, 2 ] 648860 59.050% 71.191% ############ ( 2, 3 ] 163858 14.912% 86.103% ### ( 3, 4 ] 67580 6.150% 92.253% # ( 4, 6 ] 61190 5.569% 97.822% # ( 6, 10 ] 18330 1.668% 99.490% ( 10, 15 ] 3083 0.281% 99.771% ( 15, 22 ] 366 0.033% 99.804% ( 22, 34 ] 15 0.001% 99.805% ( 34, 51 ] 7 0.001% 99.806% ( 51, 76 ] 69 0.006% 99.812% ( 76, 110 ] 744 0.068% 99.880% ( 110, 170 ] 571 0.052% 99.932% ( 170, 250 ] 233 0.021% 99.953% ( 250, 380 ] 266 0.024% 99.977% ( 380, 580 ] 307 0.028% 100.005% ( 580, 870 ] 250 0.023% 100.028% ( 870, 1300 ] 154 0.014% 100.042% ( 1300, 1900 ] 86 0.008% 100.050% ( 1900, 2900 ] 86 0.008% 100.058% ( 2900, 4400 ] 90 0.008% 100.066% ( 4400, 6600 ] 20 0.002% 100.068% ( 6600, 9900 ] 15 0.001% 100.069% ( 9900, 14000 ] 1 0.000% 100.069% ** Level 2 read latency histogram (micros): Count: 76990 Average: 6.4669 StdDev: 124.46 Min: 1 Median: 1.6407 Max: 11401 Percentiles: P50: 1.64 P75: 2.23 P99: 9.01 P99.9: 972.59 P99.99: 6087.40 ------------------------------------------------------ [ 0, 1 ] 8725 11.333% 11.333% ## ( 1, 2 ] 46465 60.352% 71.685% ############ ( 2, 3 ] 11160 14.495% 86.180% ### ( 3, 4 ] 4916 6.385% 92.565% # ( 4, 6 ] 4227 5.490% 98.056% # ( 6, 10 ] 966 1.255% 99.310% ( 10, 15 ] 221 0.287% 99.597% ( 15, 22 ] 21 0.027% 99.625% ( 22, 34 ] 2 0.003% 99.627% ( 34, 51 ] 1 0.001% 99.629% ( 51, 76 ] 1 0.001% 99.630% ( 76, 110 ] 10 0.013% 99.643% ( 110, 170 ] 43 0.056% 99.699% ( 170, 250 ] 37 0.048% 99.747% ( 250, 380 ] 34 0.044% 99.791% ( 380, 580 ] 41 0.053% 99.844% ( 580, 870 ] 38 0.049% 99.893% ( 870, 1300 ] 21 0.027% 99.921% ( 1300, 1900 ] 20 0.026% 99.947% ( 1900, 2900 ] 9 0.012% 99.958% ( 2900, 4400 ] 22 0.029% 99.987% ( 4400, 6600 ] 3 0.004% 99.991% ( 6600, 9900 ] 3 0.004% 99.995% ( 9900, 14000 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 622801 Average: 6.4345 StdDev: 85.42 Min: 0 Median: 1.9068 Max: 8132 Percentiles: P50: 1.91 P75: 2.91 P99: 9.29 P99.9: 341.40 P99.99: 557.75 ------------------------------------------------------ [ 0, 1 ] 17060 2.739% 2.739% # ( 1, 2 ] 324575 52.115% 54.855% ########## ( 2, 3 ] 137425 22.066% 76.920% #### ( 3, 4 ] 66680 10.706% 87.627% ## ( 4, 6 ] 61645 9.898% 97.525% ## ( 6, 10 ] 11176 1.794% 99.319% ( 10, 15 ] 2247 0.361% 99.680% ( 15, 22 ] 232 0.037% 99.717% ( 22, 34 ] 29 0.005% 99.722% ( 34, 51 ] 18 0.003% 99.725% ( 51, 76 ] 23 0.004% 99.728% ( 76, 110 ] 76 0.012% 99.741% ( 110, 170 ] 311 0.050% 99.791% ( 170, 250 ] 381 0.061% 99.852% ( 250, 380 ] 427 0.069% 99.920% ( 380, 580 ] 488 0.078% 99.999% ( 580, 870 ] 459 0.074% 100.072% ( 870, 1300 ] 278 0.045% 100.117% ( 1300, 1900 ] 121 0.019% 100.136% ( 1900, 2900 ] 94 0.015% 100.152% ( 2900, 4400 ] 127 0.020% 100.172% ( 4400, 6600 ] 43 0.007% 100.179% ( 6600, 9900 ] 4 0.001% 100.180% ** Level 4 read latency histogram (micros): Count: 365 Average: 240.6521 StdDev: 675.42 Min: 0 Median: 1.9860 Max: 5814 Percentiles: P50: 1.99 P75: 46.75 P99: 3905.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ [ 0, 1 ] 77 21.096% 21.096% #### ( 1, 2 ] 107 29.315% 50.411% ###### ( 2, 3 ] 28 7.671% 58.082% ## ( 3, 4 ] 10 2.740% 60.822% # ( 4, 6 ] 17 4.658% 65.479% # ( 6, 10 ] 13 3.562% 69.041% # ( 10, 15 ] 5 1.370% 70.411% ( 15, 22 ] 5 1.370% 71.781% ( 22, 34 ] 8 2.192% 73.973% ( 34, 51 ] 5 1.370% 75.342% ( 51, 76 ] 1 0.274% 75.616% ( 110, 170 ] 4 1.096% 76.712% ( 170, 250 ] 28 7.671% 84.384% ## ( 250, 380 ] 3 0.822% 85.205% ( 380, 580 ] 9 2.466% 87.671% ( 580, 870 ] 12 3.288% 90.959% # ( 870, 1300 ] 9 2.466% 93.425% ( 1300, 1900 ] 11 3.014% 96.438% # ( 1900, 2900 ] 6 1.644% 98.082% ( 2900, 4400 ] 5 1.370% 99.452% ( 4400, 6600 ] 2 0.548% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1263.1200 StdDev: 1625.84 Min: 74 Median: 609.0000 Max: 13118 Percentiles: P50: 609.00 P75: 1850.00 P99: 6600.00 P99.9: 13118.00 P99.99: 13118.00 ------------------------------------------------------ ( 51, 76 ] 3 1.500% 1.500% ( 76, 110 ] 19 9.500% 11.000% ## ( 110, 170 ] 26 13.000% 24.000% ### ( 170, 250 ] 11 5.500% 29.500% # ( 250, 380 ] 18 9.000% 38.500% ## ( 380, 580 ] 21 10.500% 49.000% ## ( 580, 870 ] 20 10.000% 59.000% ## ( 870, 1300 ] 21 10.500% 69.500% ## ( 1300, 1900 ] 12 6.000% 75.500% # ( 1900, 2900 ] 22 11.000% 86.500% ## ( 2900, 4400 ] 18 9.000% 95.500% ## ( 4400, 6600 ] 7 3.500% 99.000% # ( 6600, 9900 ] 1 0.500% 99.500% ( 9900, 14000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 39.8 total, 5.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 197.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.942 H:M:S, 45.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 190.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.158 H:M:S, 41.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-21:14:49 ... thread 0: (1000000,9000000) ops and (330880.0,211029.5) ops/second in (3.022244,42.648073) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 3.62 GB 163.6 8.2 0.0 8.2 16.7 8.5 0.0 2.0 142.3 290.8 58.86 53.52 145 0.406 8505K 16K 0.0 0.0 L1 14/14 1.63 GB 0.0 6.7 4.7 2.0 6.6 4.7 0.2 1.4 231.8 229.0 29.60 28.27 4 7.399 6965K 81K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 14/0 987.27 MB 1.0 2.8 1.4 1.3 2.8 1.4 1.9 1.9 171.6 170.8 16.55 12.51 9 1.839 2884K 13K 0.0 0.0 L4 169/0 9.52 GB 1.0 2.2 1.7 0.5 2.2 1.7 1.5 1.3 144.1 143.0 15.55 10.17 25 0.622 2228K 15K 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/21 104.56 GB 0.0 20.0 8.0 12.0 28.5 16.4 10.0 3.3 169.1 240.2 121.31 105.18 185 0.656 20M 128K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 8.0 12.0 28.5 16.4 9.6 3.3 169.1 240.2 121.31 105.18 185 0.656 20M 128K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 8.0 12.0 19.9 7.9 0.0 0.0 217.2 215.8 94.43 82.66 65 1.453 20M 128K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 325.8 26.88 22.52 120 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.9 total, 42.7 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.45 GB write, 679.69 MB/s write, 20.03 GB read, 478.44 MB/s read, 121.3 seconds Interval compaction: 28.45 GB write, 683.12 MB/s write, 20.03 GB read, 480.86 MB/s read, 121.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 52, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3784245 Average: 2.6124 StdDev: 26.60 Min: 1 Median: 1.5182 Max: 13448 Percentiles: P50: 1.52 P75: 1.90 P99: 6.34 P99.9: 97.49 P99.99: 236.58 ------------------------------------------------------ [ 0, 1 ] 618565 16.346% 16.346% ### ( 1, 2 ] 2457866 64.950% 81.296% ############# ( 2, 3 ] 428499 11.323% 92.619% ## ( 3, 4 ] 138050 3.648% 96.267% # ( 4, 6 ] 100877 2.666% 98.933% # ( 6, 10 ] 30297 0.801% 99.733% ( 10, 15 ] 4166 0.110% 99.843% ( 15, 22 ] 437 0.012% 99.855% ( 22, 34 ] 56 0.001% 99.856% ( 34, 51 ] 26 0.001% 99.857% ( 51, 76 ] 30 0.001% 99.858% ( 76, 110 ] 2521 0.067% 99.925% ( 110, 170 ] 2045 0.054% 99.979% ( 170, 250 ] 521 0.014% 99.992% ( 250, 380 ] 428 0.011% 100.004% ( 380, 580 ] 311 0.008% 100.012% ( 580, 870 ] 173 0.005% 100.016% ( 870, 1300 ] 92 0.002% 100.019% ( 1300, 1900 ] 53 0.001% 100.020% ( 1900, 2900 ] 36 0.001% 100.021% ( 2900, 4400 ] 76 0.002% 100.023% ( 4400, 6600 ] 15 0.000% 100.024% ( 6600, 9900 ] 5 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1171970 Average: 3.8742 StdDev: 56.58 Min: 0 Median: 1.6339 Max: 11524 Percentiles: P50: 1.63 P75: 2.22 P99: 8.81 P99.9: 133.75 P99.99: 472.57 ------------------------------------------------------ [ 0, 1 ] 143517 12.246% 12.246% ## ( 1, 2 ] 698025 59.560% 71.806% ############ ( 2, 3 ] 172605 14.728% 86.534% ### ( 3, 4 ] 69714 5.948% 92.482% # ( 4, 6 ] 62700 5.350% 97.832% # ( 6, 10 ] 19497 1.664% 99.496% ( 10, 15 ] 3190 0.272% 99.768% ( 15, 22 ] 370 0.032% 99.799% ( 22, 34 ] 15 0.001% 99.801% ( 34, 51 ] 8 0.001% 99.801% ( 51, 76 ] 74 0.006% 99.808% ( 76, 110 ] 838 0.072% 99.879% ( 110, 170 ] 619 0.053% 99.932% ( 170, 250 ] 259 0.022% 99.954% ( 250, 380 ] 276 0.024% 99.978% ( 380, 580 ] 315 0.027% 100.004% ( 580, 870 ] 252 0.022% 100.026% ( 870, 1300 ] 156 0.013% 100.039% ( 1300, 1900 ] 87 0.007% 100.047% ( 1900, 2900 ] 86 0.007% 100.054% ( 2900, 4400 ] 90 0.008% 100.062% ( 4400, 6600 ] 20 0.002% 100.063% ( 6600, 9900 ] 15 0.001% 100.065% ( 9900, 14000 ] 1 0.000% 100.065% ** Level 2 read latency histogram (micros): Count: 76990 Average: 6.4669 StdDev: 124.46 Min: 1 Median: 1.6407 Max: 11401 Percentiles: P50: 1.64 P75: 2.23 P99: 9.01 P99.9: 972.59 P99.99: 6087.40 ------------------------------------------------------ [ 0, 1 ] 8725 11.333% 11.333% ## ( 1, 2 ] 46465 60.352% 71.685% ############ ( 2, 3 ] 11160 14.495% 86.180% ### ( 3, 4 ] 4916 6.385% 92.565% # ( 4, 6 ] 4227 5.490% 98.056% # ( 6, 10 ] 966 1.255% 99.310% ( 10, 15 ] 221 0.287% 99.597% ( 15, 22 ] 21 0.027% 99.625% ( 22, 34 ] 2 0.003% 99.627% ( 34, 51 ] 1 0.001% 99.629% ( 51, 76 ] 1 0.001% 99.630% ( 76, 110 ] 10 0.013% 99.643% ( 110, 170 ] 43 0.056% 99.699% ( 170, 250 ] 37 0.048% 99.747% ( 250, 380 ] 34 0.044% 99.791% ( 380, 580 ] 41 0.053% 99.844% ( 580, 870 ] 38 0.049% 99.893% ( 870, 1300 ] 21 0.027% 99.921% ( 1300, 1900 ] 20 0.026% 99.947% ( 1900, 2900 ] 9 0.012% 99.958% ( 2900, 4400 ] 22 0.029% 99.987% ( 4400, 6600 ] 3 0.004% 99.991% ( 6600, 9900 ] 3 0.004% 99.995% ( 9900, 14000 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 622801 Average: 6.4345 StdDev: 85.42 Min: 0 Median: 1.9068 Max: 8132 Percentiles: P50: 1.91 P75: 2.91 P99: 9.29 P99.9: 341.40 P99.99: 557.75 ------------------------------------------------------ [ 0, 1 ] 17060 2.739% 2.739% # ( 1, 2 ] 324575 52.115% 54.855% ########## ( 2, 3 ] 137425 22.066% 76.920% #### ( 3, 4 ] 66680 10.706% 87.627% ## ( 4, 6 ] 61645 9.898% 97.525% ## ( 6, 10 ] 11176 1.794% 99.319% ( 10, 15 ] 2247 0.361% 99.680% ( 15, 22 ] 232 0.037% 99.717% ( 22, 34 ] 29 0.005% 99.722% ( 34, 51 ] 18 0.003% 99.725% ( 51, 76 ] 23 0.004% 99.728% ( 76, 110 ] 76 0.012% 99.741% ( 110, 170 ] 311 0.050% 99.791% ( 170, 250 ] 381 0.061% 99.852% ( 250, 380 ] 427 0.069% 99.920% ( 380, 580 ] 488 0.078% 99.999% ( 580, 870 ] 459 0.074% 100.072% ( 870, 1300 ] 278 0.045% 100.117% ( 1300, 1900 ] 121 0.019% 100.136% ( 1900, 2900 ] 94 0.015% 100.152% ( 2900, 4400 ] 127 0.020% 100.172% ( 4400, 6600 ] 43 0.007% 100.179% ( 6600, 9900 ] 4 0.001% 100.180% ** Level 4 read latency histogram (micros): Count: 365 Average: 240.6521 StdDev: 675.42 Min: 0 Median: 1.9860 Max: 5814 Percentiles: P50: 1.99 P75: 46.75 P99: 3905.00 P99.9: 5814.00 P99.99: 5814.00 ------------------------------------------------------ [ 0, 1 ] 77 21.096% 21.096% #### ( 1, 2 ] 107 29.315% 50.411% ###### ( 2, 3 ] 28 7.671% 58.082% ## ( 3, 4 ] 10 2.740% 60.822% # ( 4, 6 ] 17 4.658% 65.479% # ( 6, 10 ] 13 3.562% 69.041% # ( 10, 15 ] 5 1.370% 70.411% ( 15, 22 ] 5 1.370% 71.781% ( 22, 34 ] 8 2.192% 73.973% ( 34, 51 ] 5 1.370% 75.342% ( 51, 76 ] 1 0.274% 75.616% ( 110, 170 ] 4 1.096% 76.712% ( 170, 250 ] 28 7.671% 84.384% ## ( 250, 380 ] 3 0.822% 85.205% ( 380, 580 ] 9 2.466% 87.671% ( 580, 870 ] 12 3.288% 90.959% # ( 870, 1300 ] 9 2.466% 93.425% ( 1300, 1900 ] 11 3.014% 96.438% # ( 1900, 2900 ] 6 1.644% 98.082% ( 2900, 4400 ] 5 1.370% 99.452% ( 4400, 6600 ] 2 0.548% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1263.1200 StdDev: 1625.84 Min: 74 Median: 609.0000 Max: 13118 Percentiles: P50: 609.00 P75: 1850.00 P99: 6600.00 P99.9: 13118.00 P99.99: 13118.00 ------------------------------------------------------ ( 51, 76 ] 3 1.500% 1.500% ( 76, 110 ] 19 9.500% 11.000% ## ( 110, 170 ] 26 13.000% 24.000% ### ( 170, 250 ] 11 5.500% 29.500% # ( 250, 380 ] 18 9.000% 38.500% ## ( 380, 580 ] 21 10.500% 49.000% ## ( 580, 870 ] 20 10.000% 59.000% ## ( 870, 1300 ] 21 10.500% 69.500% ## ( 1300, 1900 ] 12 6.000% 75.500% # ( 1900, 2900 ] 22 11.000% 86.500% ## ( 2900, 4400 ] 18 9.000% 95.500% ## ( 4400, 6600 ] 7 3.500% 99.000% # ( 6600, 9900 ] 1 0.500% 99.500% ( 9900, 14000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 42.9 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 206.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.379 H:M:S, 42.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.437 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-21:15:00 ... thread 0: (1000000,10000000) ops and (88289.5,185272.9) ops/second in (11.326374,53.974447) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.77 GB 12.6 8.9 0.0 8.9 18.4 9.5 0.0 1.9 141.9 292.3 64.38 58.69 161 0.400 9273K 17K 0.0 0.0 L1 24/24 2.45 GB 0.0 10.1 6.5 3.6 10.0 6.4 0.2 1.5 226.2 223.6 45.76 42.79 5 9.151 9332K 81K 0.0 0.0 L2 1/0 58.41 MB 0.6 0.2 0.1 0.1 0.2 0.1 4.0 1.5 257.0 256.9 0.75 0.72 2 0.373 194K 73 0.0 0.0 L3 17/0 903.59 MB 0.9 3.5 1.7 1.8 3.5 1.7 2.5 2.0 176.0 174.9 20.33 15.83 13 1.564 3634K 22K 0.0 0.0 L4 165/0 9.46 GB 1.0 3.7 2.7 1.0 3.7 2.6 1.5 1.4 150.3 149.2 25.10 17.05 35 0.717 3768K 25K 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1315/38 105.43 GB 0.0 26.4 11.0 15.4 35.7 20.3 12.5 3.8 172.9 233.8 156.31 135.07 216 0.724 26M 146K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.4 11.0 15.4 35.7 20.3 12.1 3.8 172.9 233.8 156.31 135.07 216 0.724 26M 146K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.4 11.0 15.4 26.2 10.8 0.0 0.0 213.2 211.8 126.72 110.12 83 1.527 26M 146K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 327.8 29.59 24.95 133 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.2 total, 54.0 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.68 GB write, 674.25 MB/s write, 26.39 GB read, 498.65 MB/s read, 156.3 seconds Interval compaction: 35.68 GB write, 676.94 MB/s write, 26.39 GB read, 500.64 MB/s read, 156.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 55, interval: 102 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4208376 Average: 2.6761 StdDev: 26.89 Min: 1 Median: 1.5182 Max: 13448 Percentiles: P50: 1.52 P75: 1.90 P99: 6.61 P99.9: 103.28 P99.99: 341.27 ------------------------------------------------------ [ 0, 1 ] 691695 16.436% 16.436% ### ( 1, 2 ] 2725804 64.771% 81.207% ############# ( 2, 3 ] 473285 11.246% 92.453% ## ( 3, 4 ] 154756 3.677% 96.131% # ( 4, 6 ] 115335 2.741% 98.871% # ( 6, 10 ] 35521 0.844% 99.715% ( 10, 15 ] 4974 0.118% 99.834% ( 15, 22 ] 586 0.014% 99.847% ( 22, 34 ] 75 0.002% 99.849% ( 34, 51 ] 29 0.001% 99.850% ( 51, 76 ] 33 0.001% 99.851% ( 76, 110 ] 2587 0.061% 99.912% ( 110, 170 ] 2215 0.053% 99.965% ( 170, 250 ] 661 0.016% 99.981% ( 250, 380 ] 570 0.014% 99.994% ( 380, 580 ] 457 0.011% 100.005% ( 580, 870 ] 303 0.007% 100.012% ( 870, 1300 ] 173 0.004% 100.016% ( 1300, 1900 ] 92 0.002% 100.018% ( 1900, 2900 ] 44 0.001% 100.019% ( 2900, 4400 ] 78 0.002% 100.021% ( 4400, 6600 ] 15 0.000% 100.022% ( 6600, 9900 ] 5 0.000% 100.022% ( 9900, 14000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1790340 Average: 3.6203 StdDev: 49.07 Min: 0 Median: 1.5955 Max: 11524 Percentiles: P50: 1.60 P75: 2.09 P99: 8.81 P99.9: 126.68 P99.99: 382.63 ------------------------------------------------------ [ 0, 1 ] 268487 14.996% 14.996% ### ( 1, 2 ] 1052303 58.777% 73.773% ############ ( 2, 3 ] 241506 13.489% 87.263% ### ( 3, 4 ] 99912 5.581% 92.843% # ( 4, 6 ] 88877 4.964% 97.807% # ( 6, 10 ] 30402 1.698% 99.506% ( 10, 15 ] 4842 0.270% 99.776% ( 15, 22 ] 639 0.036% 99.812% ( 22, 34 ] 30 0.002% 99.813% ( 34, 51 ] 10 0.001% 99.814% ( 51, 76 ] 133 0.007% 99.821% ( 76, 110 ] 1122 0.063% 99.884% ( 110, 170 ] 1031 0.058% 99.942% ( 170, 250 ] 417 0.023% 99.965% ( 250, 380 ] 444 0.025% 99.990% ( 380, 580 ] 453 0.025% 100.015% ( 580, 870 ] 402 0.022% 100.037% ( 870, 1300 ] 215 0.012% 100.049% ( 1300, 1900 ] 113 0.006% 100.056% ( 1900, 2900 ] 102 0.006% 100.061% ( 2900, 4400 ] 102 0.006% 100.067% ( 4400, 6600 ] 22 0.001% 100.068% ( 6600, 9900 ] 15 0.001% 100.069% ( 9900, 14000 ] 1 0.000% 100.069% ** Level 2 read latency histogram (micros): Count: 76990 Average: 6.4669 StdDev: 124.46 Min: 1 Median: 1.6407 Max: 11401 Percentiles: P50: 1.64 P75: 2.23 P99: 9.01 P99.9: 972.59 P99.99: 6087.40 ------------------------------------------------------ [ 0, 1 ] 8725 11.333% 11.333% ## ( 1, 2 ] 46465 60.352% 71.685% ############ ( 2, 3 ] 11160 14.495% 86.180% ### ( 3, 4 ] 4916 6.385% 92.565% # ( 4, 6 ] 4227 5.490% 98.056% # ( 6, 10 ] 966 1.255% 99.310% ( 10, 15 ] 221 0.287% 99.597% ( 15, 22 ] 21 0.027% 99.625% ( 22, 34 ] 2 0.003% 99.627% ( 34, 51 ] 1 0.001% 99.629% ( 51, 76 ] 1 0.001% 99.630% ( 76, 110 ] 10 0.013% 99.643% ( 110, 170 ] 43 0.056% 99.699% ( 170, 250 ] 37 0.048% 99.747% ( 250, 380 ] 34 0.044% 99.791% ( 380, 580 ] 41 0.053% 99.844% ( 580, 870 ] 38 0.049% 99.893% ( 870, 1300 ] 21 0.027% 99.921% ( 1300, 1900 ] 20 0.026% 99.947% ( 1900, 2900 ] 9 0.012% 99.958% ( 2900, 4400 ] 22 0.029% 99.987% ( 4400, 6600 ] 3 0.004% 99.991% ( 6600, 9900 ] 3 0.004% 99.995% ( 9900, 14000 ] 4 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 819822 Average: 6.1777 StdDev: 81.80 Min: 0 Median: 1.9117 Max: 8132 Percentiles: P50: 1.91 P75: 2.93 P99: 9.19 P99.9: 319.19 P99.99: 541.51 ------------------------------------------------------ [ 0, 1 ] 21315 2.600% 2.600% # ( 1, 2 ] 426213 51.988% 54.588% ########## ( 2, 3 ] 179587 21.906% 76.494% #### ( 3, 4 ] 89739 10.946% 87.440% ## ( 4, 6 ] 83107 10.137% 97.577% ## ( 6, 10 ] 14613 1.782% 99.360% ( 10, 15 ] 2813 0.343% 99.703% ( 15, 22 ] 271 0.033% 99.736% ( 22, 34 ] 32 0.004% 99.740% ( 34, 51 ] 18 0.002% 99.742% ( 51, 76 ] 26 0.003% 99.745% ( 76, 110 ] 105 0.013% 99.758% ( 110, 170 ] 391 0.048% 99.806% ( 170, 250 ] 472 0.058% 99.863% ( 250, 380 ] 564 0.069% 99.932% ( 380, 580 ] 587 0.072% 100.004% ( 580, 870 ] 567 0.069% 100.073% ( 870, 1300 ] 341 0.042% 100.115% ( 1300, 1900 ] 145 0.018% 100.132% ( 1900, 2900 ] 113 0.014% 100.146% ( 2900, 4400 ] 151 0.018% 100.164% ( 4400, 6600 ] 51 0.006% 100.171% ( 6600, 9900 ] 5 0.001% 100.171% ** Level 4 read latency histogram (micros): Count: 111174 Average: 11.3184 StdDev: 139.11 Min: 0 Median: 1.9762 Max: 8195 Percentiles: P50: 1.98 P75: 3.17 P99: 14.83 P99.9: 869.66 P99.99: 1384.04 ------------------------------------------------------ [ 0, 1 ] 3080 2.770% 2.770% # ( 1, 2 ] 53789 48.383% 51.153% ########## ( 2, 3 ] 24416 21.962% 73.115% #### ( 3, 4 ] 12691 11.415% 84.531% ## ( 4, 6 ] 12478 11.224% 95.754% ## ( 6, 10 ] 2869 2.581% 98.335% # ( 10, 15 ] 766 0.689% 99.024% ( 15, 22 ] 70 0.063% 99.087% ( 22, 34 ] 11 0.010% 99.097% ( 34, 51 ] 7 0.006% 99.103% ( 51, 76 ] 28 0.025% 99.128% ( 76, 110 ] 66 0.059% 99.188% ( 110, 170 ] 106 0.095% 99.283% ( 170, 250 ] 194 0.175% 99.458% ( 250, 380 ] 153 0.138% 99.595% ( 380, 580 ] 192 0.173% 99.768% ( 580, 870 ] 147 0.132% 99.900% ( 870, 1300 ] 94 0.085% 99.985% ( 1300, 1900 ] 42 0.038% 100.022% ( 1900, 2900 ] 34 0.031% 100.053% ( 2900, 4400 ] 73 0.066% 100.119% ( 4400, 6600 ] 15 0.013% 100.132% ( 6600, 9900 ] 6 0.005% 100.138% ** Level 5 read latency histogram (micros): Count: 260 Average: 1142.4077 StdDev: 1513.70 Min: 74 Median: 536.5217 Max: 13118 Percentiles: P50: 536.52 P75: 1637.50 P99: 6411.43 P99.9: 12934.00 P99.99: 13118.00 ------------------------------------------------------ ( 51, 76 ] 3 1.154% 1.154% ( 76, 110 ] 33 12.692% 13.846% ### ( 110, 170 ] 41 15.769% 29.615% ### ( 170, 250 ] 16 6.154% 35.769% # ( 250, 380 ] 19 7.308% 43.077% # ( 380, 580 ] 23 8.846% 51.923% ## ( 580, 870 ] 26 10.000% 61.923% ## ( 870, 1300 ] 25 9.615% 71.538% ## ( 1300, 1900 ] 16 6.154% 77.692% # ( 1900, 2900 ] 28 10.769% 88.462% ## ( 2900, 4400 ] 21 8.077% 96.538% ## ( 4400, 6600 ] 7 2.692% 99.231% # ( 6600, 9900 ] 1 0.385% 99.615% ( 9900, 14000 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 54.2 total, 11.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 181.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.723 H:M:S, 49.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 86.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.344 H:M:S, 73.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.980 micros/op 167219 ops/sec 60.166 seconds 10060999 operations; 162.0 MB/s Microseconds per write: Count: 10060999 Average: 5.9802 StdDev: 387.34 Min: 1 Median: 1.7237 Max: 575342 Percentiles: P50: 1.72 P75: 2.69 P99: 9.80 P99.9: 1142.00 P99.99: 2489.70 ------------------------------------------------------ [ 0, 1 ] 1462445 14.536% 14.536% ### ( 1, 2 ] 4930478 49.006% 63.542% ########## ( 2, 3 ] 1680166 16.700% 80.241% ### ( 3, 4 ] 1290999 12.832% 93.073% ### ( 4, 6 ] 463991 4.612% 97.685% # ( 6, 10 ] 139246 1.384% 99.069% ( 10, 15 ] 48148 0.479% 99.548% ( 15, 22 ] 9643 0.096% 99.643% ( 22, 34 ] 2048 0.020% 99.664% ( 34, 51 ] 234 0.002% 99.666% ( 51, 76 ] 12 0.000% 99.666% ( 76, 110 ] 7293 0.072% 99.739% ( 110, 170 ] 2380 0.024% 99.762% ( 170, 250 ] 290 0.003% 99.765% ( 250, 380 ] 216 0.002% 99.767% ( 380, 580 ] 17 0.000% 99.767% ( 580, 870 ] 16 0.000% 99.768% ( 870, 1300 ] 21051 0.209% 99.977% ( 1300, 1900 ] 55 0.001% 99.977% ( 1900, 2900 ] 2145 0.021% 99.999% ( 2900, 4400 ] 74 0.001% 99.999% ( 4400, 6600 ] 13 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 215820 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10060999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10382950968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 527 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32488660 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30755856021 rocksdb.compact.write.bytes COUNT : 30540733758 rocksdb.flush.write.bytes COUNT : 10370747347 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 59 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 270 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10287414272 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4262912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30852955414 rocksdb.non.last.level.read.count COUNT : 7452385 rocksdb.block.checksum.compute.count COUNT : 7451390 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.360386 P95 : 3.893341 P99 : 8.485670 P100 : 575337.000000 COUNT : 10060999 SUM : 55397903 rocksdb.compaction.times.micros P50 : 987500.000000 P95 : 4160000.000000 P99 : 16565521.000000 P100 : 16565521.000000 COUNT : 84 SUM : 127629286 rocksdb.compaction.times.cpu_micros P50 : 880606.060606 P95 : 4020000.000000 P99 : 15665698.000000 P100 : 15665698.000000 COUNT : 84 SUM : 111022367 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 693.170732 P95 : 1214.000000 P99 : 20560.000000 P100 : 45499.000000 COUNT : 136 SUM : 170869 rocksdb.compaction.outfile.sync.micros P50 : 933.918919 P95 : 63611.111111 P99 : 105481.818182 P100 : 122097.000000 COUNT : 342 SUM : 2905550 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.192308 P95 : 369.979167 P99 : 3222.500000 P100 : 5756.000000 COUNT : 257 SUM : 48669 rocksdb.table.open.io.micros P50 : 1465.882353 P95 : 7407.631579 P99 : 12965.888889 P100 : 29300.000000 COUNT : 527 SUM : 1120761 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.621489 P95 : 7.444236 P99 : 10.840509 P100 : 14310.000000 COUNT : 7449829 SUM : 41166781 rocksdb.read.block.get.micros P50 : 491.578947 P95 : 3378.125000 P99 : 5624.235294 P100 : 13260.000000 COUNT : 1054 SUM : 906567 rocksdb.write.raw.block.micros P50 : 0.511921 P95 : 0.972650 P99 : 2.736607 P100 : 16774.000000 COUNT : 9908395 SUM : 19358558 rocksdb.numfiles.in.singlecompaction P50 : 3.216216 P95 : 5.280000 P99 : 29.680000 P100 : 38.000000 COUNT : 136 SUM : 521 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562102 P95 : 1129.085817 P99 : 1940.299205 P100 : 575125.000000 COUNT : 212080 SUM : 32512791 rocksdb.sst.read.micros P50 : 1.567072 P95 : 4.387068 P99 : 8.154734 P100 : 13448.000000 COUNT : 7452506 SUM : 25847356 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10060999 SUM : 10382950968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213636.363636 P95 : 375272.727273 P99 : 662800.000000 P100 : 750820.000000 COUNT : 136 SUM : 30121836 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 317 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0