[2024-11-20 18:49:07.607173] Starting SPDK v25.01-pre git sha1 bd9804982 / DPDK 24.03.0 initialization... [2024-11-20 18:49:07.607293] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid723087 ] Set seed to 1732124947604568 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 18:49:07.777180] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 18:49:07.921521] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 18:49:07.921583] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 723087' to capture a snapshot of events at runtime. [2024-11-20 18:49:07.921602] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 18:49:07.921621] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 18:49:07.921636] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid723087 for offline analysis/debug. [2024-11-20 18:49:07.923408] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 18:49:14 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-18:49:18 ... thread 0: (1000000,1000000) ops and (257205.2,257205.2) ops/second in (3.887947,3.887947) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.20 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 283.7 3.10 2.76 12 0.259 0 0 0.0 0.0 L1 4/0 250.45 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 222.1 221.0 1.13 1.09 1 1.133 255K 1195 0.0 0.0 L2 1/1 105.81 MB 0.0 0.4 0.2 0.3 0.4 0.2 0.0 2.4 251.9 251.1 1.77 1.71 2 0.887 453K 1359 0.0 0.0 L3 19/11 998.07 MB 0.2 0.2 0.2 0.0 0.2 0.2 0.0 1.0 213.7 213.7 0.84 0.77 1 0.838 181K 0 0.0 0.0 L4 140/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 128/0 8.61 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 298/16 20.08 GB 0.0 0.9 0.6 0.3 1.7 1.5 0.2 2.0 128.1 256.3 6.85 6.33 16 0.428 891K 2554 0.0 0.0 Int 0/0 0.00 KB 0.0 0.9 0.6 0.3 1.7 1.5 0.2 2.0 128.1 256.3 6.85 6.33 16 0.428 891K 2554 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.9 0.6 0.3 0.9 0.6 0.0 0.0 234.3 233.6 3.74 3.57 4 0.936 891K 2554 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 283.7 3.10 2.76 12 0.259 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.0 total, 3.9 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.71 GB write, 441.91 MB/s write, 0.86 GB read, 220.92 MB/s read, 6.8 seconds Interval compaction: 1.71 GB write, 451.37 MB/s write, 0.86 GB read, 225.65 MB/s read, 6.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 144156 Average: 2.3612 StdDev: 18.53 Min: 1 Median: 1.5407 Max: 3876 Percentiles: P50: 1.54 P75: 1.94 P99: 5.93 P99.9: 12.79 P99.99: 58.30 ------------------------------------------------------ [ 0, 1 ] 22827 15.835% 15.835% ### ( 1, 2 ] 91081 63.182% 79.017% ############# ( 2, 3 ] 20073 13.924% 92.942% ### ( 3, 4 ] 4770 3.309% 96.251% # ( 4, 6 ] 4102 2.846% 99.096% # ( 6, 10 ] 1033 0.717% 99.813% ( 10, 15 ] 229 0.159% 99.972% ( 15, 22 ] 26 0.018% 99.990% ( 22, 34 ] 1 0.001% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 2 0.001% 99.992% ( 170, 250 ] 4 0.003% 99.995% ( 250, 380 ] 6 0.004% 99.999% ( 380, 580 ] 5 0.003% 100.003% ( 580, 870 ] 2 0.001% 100.004% ( 870, 1300 ] 2 0.001% 100.006% ( 1300, 1900 ] 1 0.001% 100.006% ( 1900, 2900 ] 2 0.001% 100.008% ( 2900, 4400 ] 2 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 20 Average: 309.1000 StdDev: 862.00 Min: 1 Median: 1.7500 Max: 3809 Percentiles: P50: 1.75 P75: 22.00 P99: 3809.00 P99.9: 3809.00 P99.99: 3809.00 ------------------------------------------------------ [ 0, 1 ] 7 35.000% 35.000% ####### ( 1, 2 ] 4 20.000% 55.000% #### ( 2, 3 ] 1 5.000% 60.000% # ( 6, 10 ] 1 5.000% 65.000% # ( 15, 22 ] 2 10.000% 75.000% ## ( 110, 170 ] 1 5.000% 80.000% # ( 250, 380 ] 1 5.000% 85.000% # ( 380, 580 ] 1 5.000% 90.000% # ( 1300, 1900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 111742 Average: 2.5245 StdDev: 38.32 Min: 1 Median: 1.4531 Max: 6951 Percentiles: P50: 1.45 P75: 1.85 P99: 6.28 P99.9: 61.67 P99.99: 575.02 ------------------------------------------------------ [ 0, 1 ] 24049 21.522% 21.522% #### ( 1, 2 ] 70226 62.847% 84.368% ############# ( 2, 3 ] 10612 9.497% 93.865% ## ( 3, 4 ] 3312 2.964% 96.829% # ( 4, 6 ] 2369 2.120% 98.949% ( 6, 10 ] 819 0.733% 99.682% ( 10, 15 ] 180 0.161% 99.843% ( 15, 22 ] 21 0.019% 99.862% ( 22, 34 ] 2 0.002% 99.864% ( 34, 51 ] 1 0.001% 99.865% ( 51, 76 ] 92 0.082% 99.947% ( 76, 110 ] 14 0.013% 99.960% ( 110, 170 ] 9 0.008% 99.968% ( 170, 250 ] 14 0.013% 99.980% ( 250, 380 ] 4 0.004% 99.984% ( 380, 580 ] 7 0.006% 99.990% ( 580, 870 ] 1 0.001% 99.991% ( 870, 1300 ] 1 0.001% 99.992% ( 1300, 1900 ] 5 0.004% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 4400, 6600 ] 2 0.002% 99.999% ( 6600, 9900 ] 2 0.002% 100.001% ** Level 3 read latency histogram (micros): Count: 68266 Average: 7.0951 StdDev: 139.92 Min: 1 Median: 2.2699 Max: 10341 Percentiles: P50: 2.27 P75: 2.81 P99: 13.58 P99.9: 528.33 P99.99: 8572.66 ------------------------------------------------------ [ 0, 1 ] 75 0.110% 0.110% ( 1, 2 ] 25540 37.412% 37.522% ####### ( 2, 3 ] 31556 46.225% 83.747% ######### ( 3, 4 ] 3864 5.660% 89.408% # ( 4, 6 ] 4669 6.839% 96.247% # ( 6, 10 ] 1474 2.159% 98.406% ( 10, 15 ] 568 0.832% 99.238% ( 15, 22 ] 181 0.265% 99.503% ( 22, 34 ] 20 0.029% 99.533% ( 76, 110 ] 36 0.053% 99.585% ( 110, 170 ] 99 0.145% 99.730% ( 170, 250 ] 71 0.104% 99.834% ( 250, 380 ] 22 0.032% 99.867% ( 380, 580 ] 32 0.047% 99.914% ( 580, 870 ] 6 0.009% 99.922% ( 870, 1300 ] 10 0.015% 99.937% ( 1300, 1900 ] 13 0.019% 99.956% ( 1900, 2900 ] 6 0.009% 99.965% ( 2900, 4400 ] 1 0.001% 99.966% ( 4400, 6600 ] 10 0.015% 99.981% ( 6600, 9900 ] 12 0.018% 99.999% ( 9900, 14000 ] 2 0.003% 100.001% ** Level 4 read latency histogram (micros): Count: 15 Average: 5032.0667 StdDev: 2612.07 Min: 1060 Median: 4950.0000 Max: 8982 Percentiles: P50: 4950.00 P75: 6325.00 P99: 8982.00 P99.9: 8982.00 P99.99: 8982.00 ------------------------------------------------------ ( 870, 1300 ] 2 13.333% 13.333% ### ( 1900, 2900 ] 2 13.333% 26.667% ### ( 2900, 4400 ] 2 13.333% 40.000% ### ( 4400, 6600 ] 6 40.000% 80.000% ######## ( 6600, 9900 ] 3 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 4.0 total, 3.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 247.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.698 H:M:S, 17.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.698 H:M:S, 17.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-18:49:22 ... thread 0: (1000000,2000000) ops and (251519.9,254330.8) ops/second in (3.975828,7.863775) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 1.41 GB 43.9 0.5 0.0 0.5 2.3 1.8 0.0 1.3 58.9 279.3 8.55 7.69 30 0.285 511K 2445 0.0 0.0 L1 4/4 250.45 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 222.1 221.0 1.13 1.09 1 1.133 255K 1195 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.3 0.4 0.2 0.0 2.4 251.9 251.1 1.77 1.71 2 0.887 453K 1359 0.0 0.0 L3 18/0 754.10 MB 0.8 1.1 0.3 0.8 1.1 0.3 0.0 3.8 194.3 192.9 5.68 5.26 2 2.840 1121K 8129 0.0 0.0 L4 146/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 168.9 168.9 0.50 0.41 1 0.498 85K 0 0.0 0.0 L5 132/0 8.92 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 316/16 21.06 GB 0.0 2.3 0.8 1.5 4.2 2.6 0.7 2.3 135.5 241.8 17.64 16.16 36 0.490 2427K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.8 1.5 4.2 2.6 0.7 2.3 135.5 241.8 17.64 16.16 36 0.490 2427K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.8 1.5 2.3 0.8 0.0 0.0 215.6 214.4 11.08 10.41 8 1.386 2427K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 288.1 6.55 5.75 28 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.9 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.16 GB write, 536.47 MB/s write, 2.33 GB read, 300.68 MB/s read, 17.6 seconds Interval compaction: 4.16 GB write, 542.14 MB/s write, 2.33 GB read, 303.87 MB/s read, 17.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 409566 Average: 2.9395 StdDev: 20.96 Min: 1 Median: 1.6420 Max: 3876 Percentiles: P50: 1.64 P75: 2.14 P99: 7.68 P99.9: 143.79 P99.99: 384.92 ------------------------------------------------------ [ 0, 1 ] 40285 9.836% 9.836% ## ( 1, 2 ] 256224 62.560% 72.396% ############# ( 2, 3 ] 76978 18.795% 91.191% #### ( 3, 4 ] 16608 4.055% 95.246% # ( 4, 6 ] 13563 3.312% 98.557% # ( 6, 10 ] 4309 1.052% 99.610% ( 10, 15 ] 792 0.193% 99.803% ( 15, 22 ] 78 0.019% 99.822% ( 22, 34 ] 7 0.002% 99.824% ( 34, 51 ] 2 0.000% 99.824% ( 51, 76 ] 91 0.022% 99.846% ( 76, 110 ] 113 0.028% 99.874% ( 110, 170 ] 189 0.046% 99.920% ( 170, 250 ] 177 0.043% 99.963% ( 250, 380 ] 107 0.026% 99.990% ( 380, 580 ] 83 0.020% 100.010% ( 580, 870 ] 30 0.007% 100.017% ( 870, 1300 ] 22 0.005% 100.022% ( 1300, 1900 ] 11 0.003% 100.025% ( 1900, 2900 ] 6 0.001% 100.027% ( 2900, 4400 ] 3 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 39373 Average: 3.2937 StdDev: 25.76 Min: 1 Median: 1.7115 Max: 3809 Percentiles: P50: 1.71 P75: 2.33 P99: 8.96 P99.9: 227.31 P99.99: 807.58 ------------------------------------------------------ [ 0, 1 ] 2393 6.078% 6.078% # ( 1, 2 ] 24307 61.735% 67.813% ############ ( 2, 3 ] 8689 22.068% 89.881% #### ( 3, 4 ] 1711 4.346% 94.227% # ( 4, 6 ] 1376 3.495% 97.722% # ( 6, 10 ] 679 1.725% 99.446% ( 10, 15 ] 99 0.251% 99.698% ( 15, 22 ] 16 0.041% 99.738% ( 22, 34 ] 4 0.010% 99.749% ( 110, 170 ] 41 0.104% 99.853% ( 170, 250 ] 26 0.066% 99.919% ( 250, 380 ] 10 0.025% 99.944% ( 380, 580 ] 11 0.028% 99.972% ( 580, 870 ] 9 0.023% 99.995% ( 1300, 1900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 137954 Average: 2.8449 StdDev: 35.61 Min: 1 Median: 1.5720 Max: 6951 Percentiles: P50: 1.57 P75: 2.04 P99: 7.94 P99.9: 131.61 P99.99: 793.11 ------------------------------------------------------ [ 0, 1 ] 24064 17.443% 17.443% ### ( 1, 2 ] 78517 56.915% 74.359% ########### ( 2, 3 ] 24068 17.446% 91.805% ### ( 3, 4 ] 4981 3.611% 95.416% # ( 4, 6 ] 4264 3.091% 98.507% # ( 6, 10 ] 1403 1.017% 99.524% ( 10, 15 ] 347 0.252% 99.775% ( 15, 22 ] 32 0.023% 99.798% ( 22, 34 ] 3 0.002% 99.801% ( 34, 51 ] 1 0.001% 99.801% ( 51, 76 ] 94 0.068% 99.870% ( 76, 110 ] 19 0.014% 99.883% ( 110, 170 ] 64 0.046% 99.930% ( 170, 250 ] 38 0.028% 99.957% ( 250, 380 ] 22 0.016% 99.973% ( 380, 580 ] 21 0.015% 99.988% ( 580, 870 ] 3 0.002% 99.991% ( 870, 1300 ] 4 0.003% 99.993% ( 1300, 1900 ] 5 0.004% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 4400, 6600 ] 2 0.001% 99.999% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 229520 Average: 4.7750 StdDev: 78.51 Min: 1 Median: 2.1287 Max: 10341 Percentiles: P50: 2.13 P75: 2.73 P99: 11.24 P99.9: 313.08 P99.99: 4630.56 ------------------------------------------------------ [ 0, 1 ] 1138 0.496% 0.496% ( 1, 2 ] 101293 44.133% 44.628% ######### ( 2, 3 ] 95771 41.727% 86.355% ######## ( 3, 4 ] 11360 4.949% 91.304% # ( 4, 6 ] 12661 5.516% 96.821% # ( 6, 10 ] 4651 2.026% 98.847% ( 10, 15 ] 1415 0.617% 99.464% ( 15, 22 ] 283 0.123% 99.587% ( 22, 34 ] 28 0.012% 99.599% ( 34, 51 ] 4 0.002% 99.601% ( 76, 110 ] 91 0.040% 99.641% ( 110, 170 ] 386 0.168% 99.809% ( 170, 250 ] 176 0.077% 99.885% ( 250, 380 ] 69 0.030% 99.915% ( 380, 580 ] 92 0.040% 99.956% ( 580, 870 ] 28 0.012% 99.968% ( 870, 1300 ] 25 0.011% 99.979% ( 1300, 1900 ] 15 0.007% 99.985% ( 1900, 2900 ] 9 0.004% 99.989% ( 2900, 4400 ] 1 0.000% 99.990% ( 4400, 6600 ] 10 0.004% 99.994% ( 6600, 9900 ] 12 0.005% 99.999% ( 9900, 14000 ] 2 0.001% 100.000% ** Level 4 read latency histogram (micros): Count: 45 Average: 1710.5111 StdDev: 2795.65 Min: 1 Median: 14.3750 Max: 8982 Percentiles: P50: 14.38 P75: 2775.00 P99: 8982.00 P99.9: 8982.00 P99.99: 8982.00 ------------------------------------------------------ [ 0, 1 ] 11 24.444% 24.444% ##### ( 1, 2 ] 3 6.667% 31.111% # ( 2, 3 ] 3 6.667% 37.778% # ( 3, 4 ] 1 2.222% 40.000% ( 6, 10 ] 1 2.222% 42.222% ( 10, 15 ] 4 8.889% 51.111% ## ( 22, 34 ] 1 2.222% 53.333% ( 34, 51 ] 1 2.222% 55.556% ( 51, 76 ] 4 8.889% 64.444% ## ( 870, 1300 ] 3 6.667% 71.111% # ( 1900, 2900 ] 2 4.444% 75.556% # ( 2900, 4400 ] 2 4.444% 80.000% # ( 4400, 6600 ] 6 13.333% 93.333% ### ( 6600, 9900 ] 3 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1354.5500 StdDev: 1280.29 Min: 164 Median: 977.5000 Max: 4210 Percentiles: P50: 977.50 P75: 1900.00 P99: 4210.00 P99.9: 4210.00 P99.99: 4210.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 2 10.000% 30.000% ## ( 380, 580 ] 2 10.000% 40.000% ## ( 580, 870 ] 1 5.000% 45.000% # ( 870, 1300 ] 4 20.000% 65.000% #### ( 1300, 1900 ] 2 10.000% 75.000% ## ( 2900, 4400 ] 5 25.000% 100.000% ##### ** DB Stats ** Uptime(secs): 7.9 total, 4.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 247.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.698 H:M:S, 8.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 247.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-18:49:26 ... thread 0: (1000000,3000000) ops and (252966.0,253874.2) ops/second in (3.953100,11.816875) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.59 GB 137.8 1.5 0.0 1.5 4.2 2.8 0.0 1.5 92.4 265.1 16.35 14.89 49 0.334 1533K 7152 0.0 0.0 L1 4/0 467.33 MB 46.7 1.2 1.0 0.2 1.2 1.0 0.2 1.2 214.3 210.4 5.86 5.47 2 2.930 1275K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.3 0.4 0.2 0.5 2.4 251.9 251.1 1.77 1.71 2 0.887 453K 1359 0.0 0.0 L3 15/0 753.34 MB 0.8 1.2 0.4 0.8 1.2 0.4 0.4 3.0 196.8 195.4 6.34 5.88 3 2.113 1267K 8889 0.0 0.0 L4 146/0 9.70 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 168.9 168.9 0.50 0.41 1 0.498 85K 0 0.0 0.0 L5 140/0 9.47 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 316/4 21.95 GB 0.0 4.4 1.7 2.8 7.2 4.4 2.7 2.6 147.5 238.0 30.82 28.37 57 0.541 4615K 40K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 1.7 2.8 7.2 4.4 2.7 2.6 147.5 238.0 30.82 28.37 57 0.541 4615K 40K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 1.7 2.8 4.4 1.6 0.0 0.0 218.3 216.3 20.82 19.58 14 1.487 4615K 40K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 283.1 10.00 8.79 43 0.233 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.9 total, 11.8 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.16 GB write, 616.33 MB/s write, 4.44 GB read, 381.85 MB/s read, 30.8 seconds Interval compaction: 7.16 GB write, 620.67 MB/s write, 4.44 GB read, 384.54 MB/s read, 30.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 732527 Average: 2.7585 StdDev: 17.93 Min: 0 Median: 1.6267 Max: 3876 Percentiles: P50: 1.63 P75: 2.06 P99: 6.92 P99.9: 103.12 P99.99: 303.72 ------------------------------------------------------ [ 0, 1 ] 71746 9.794% 9.794% ## ( 1, 2 ] 469965 64.157% 73.951% ############# ( 2, 3 ] 135446 18.490% 92.441% #### ( 3, 4 ] 26501 3.618% 96.059% # ( 4, 6 ] 19987 2.729% 98.787% # ( 6, 10 ] 6751 0.922% 99.709% ( 10, 15 ] 1069 0.146% 99.855% ( 15, 22 ] 98 0.013% 99.868% ( 22, 34 ] 13 0.002% 99.870% ( 34, 51 ] 3 0.000% 99.871% ( 51, 76 ] 103 0.014% 99.885% ( 76, 110 ] 141 0.019% 99.904% ( 110, 170 ] 348 0.048% 99.951% ( 170, 250 ] 222 0.030% 99.982% ( 250, 380 ] 147 0.020% 100.002% ( 380, 580 ] 105 0.014% 100.016% ( 580, 870 ] 45 0.006% 100.022% ( 870, 1300 ] 28 0.004% 100.026% ( 1300, 1900 ] 14 0.002% 100.028% ( 1900, 2900 ] 8 0.001% 100.029% ( 2900, 4400 ] 4 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 96358 Average: 3.1830 StdDev: 24.90 Min: 1 Median: 1.6672 Max: 3809 Percentiles: P50: 1.67 P75: 2.18 P99: 8.53 P99.9: 214.40 P99.99: 967.77 ------------------------------------------------------ [ 0, 1 ] 7081 7.349% 7.349% # ( 1, 2 ] 61595 63.923% 71.272% ############# ( 2, 3 ] 19523 20.261% 91.533% #### ( 3, 4 ] 3592 3.728% 95.260% # ( 4, 6 ] 2751 2.855% 98.115% # ( 6, 10 ] 1347 1.398% 99.513% ( 10, 15 ] 196 0.203% 99.717% ( 15, 22 ] 19 0.020% 99.736% ( 22, 34 ] 6 0.006% 99.743% ( 51, 76 ] 2 0.002% 99.745% ( 76, 110 ] 2 0.002% 99.747% ( 110, 170 ] 121 0.126% 99.872% ( 170, 250 ] 48 0.050% 99.922% ( 250, 380 ] 22 0.023% 99.945% ( 380, 580 ] 31 0.032% 99.977% ( 580, 870 ] 11 0.011% 99.989% ( 870, 1300 ] 6 0.006% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 137954 Average: 2.8449 StdDev: 35.61 Min: 1 Median: 1.5720 Max: 6951 Percentiles: P50: 1.57 P75: 2.04 P99: 7.94 P99.9: 131.61 P99.99: 793.11 ------------------------------------------------------ [ 0, 1 ] 24064 17.443% 17.443% ### ( 1, 2 ] 78517 56.915% 74.359% ########### ( 2, 3 ] 24068 17.446% 91.805% ### ( 3, 4 ] 4981 3.611% 95.416% # ( 4, 6 ] 4264 3.091% 98.507% # ( 6, 10 ] 1403 1.017% 99.524% ( 10, 15 ] 347 0.252% 99.775% ( 15, 22 ] 32 0.023% 99.798% ( 22, 34 ] 3 0.002% 99.801% ( 34, 51 ] 1 0.001% 99.801% ( 51, 76 ] 94 0.068% 99.870% ( 76, 110 ] 19 0.014% 99.883% ( 110, 170 ] 64 0.046% 99.930% ( 170, 250 ] 38 0.028% 99.957% ( 250, 380 ] 22 0.016% 99.973% ( 380, 580 ] 21 0.015% 99.988% ( 580, 870 ] 3 0.002% 99.991% ( 870, 1300 ] 4 0.003% 99.993% ( 1300, 1900 ] 5 0.004% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 4400, 6600 ] 2 0.001% 99.999% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 233381 Average: 4.7879 StdDev: 77.94 Min: 1 Median: 2.1176 Max: 10341 Percentiles: P50: 2.12 P75: 2.72 P99: 11.45 P99.9: 321.19 P99.99: 4545.62 ------------------------------------------------------ [ 0, 1 ] 1632 0.699% 0.699% ( 1, 2 ] 103723 44.444% 45.143% ######### ( 2, 3 ] 96364 41.290% 86.433% ######## ( 3, 4 ] 11495 4.925% 91.359% # ( 4, 6 ] 12711 5.446% 96.805% # ( 6, 10 ] 4703 2.015% 98.820% ( 10, 15 ] 1445 0.619% 99.440% ( 15, 22 ] 290 0.124% 99.564% ( 22, 34 ] 29 0.012% 99.576% ( 34, 51 ] 4 0.002% 99.578% ( 76, 110 ] 110 0.047% 99.625% ( 110, 170 ] 414 0.177% 99.802% ( 170, 250 ] 186 0.080% 99.882% ( 250, 380 ] 76 0.033% 99.915% ( 380, 580 ] 97 0.042% 99.956% ( 580, 870 ] 28 0.012% 99.968% ( 870, 1300 ] 25 0.011% 99.979% ( 1300, 1900 ] 15 0.006% 99.985% ( 1900, 2900 ] 9 0.004% 99.989% ( 2900, 4400 ] 1 0.000% 99.990% ( 4400, 6600 ] 10 0.004% 99.994% ( 6600, 9900 ] 12 0.005% 99.999% ( 9900, 14000 ] 2 0.001% 100.000% ** Level 4 read latency histogram (micros): Count: 45 Average: 1710.5111 StdDev: 2795.65 Min: 1 Median: 14.3750 Max: 8982 Percentiles: P50: 14.38 P75: 2775.00 P99: 8982.00 P99.9: 8982.00 P99.99: 8982.00 ------------------------------------------------------ [ 0, 1 ] 11 24.444% 24.444% ##### ( 1, 2 ] 3 6.667% 31.111% # ( 2, 3 ] 3 6.667% 37.778% # ( 3, 4 ] 1 2.222% 40.000% ( 6, 10 ] 1 2.222% 42.222% ( 10, 15 ] 4 8.889% 51.111% ## ( 22, 34 ] 1 2.222% 53.333% ( 34, 51 ] 1 2.222% 55.556% ( 51, 76 ] 4 8.889% 64.444% ## ( 870, 1300 ] 3 6.667% 71.111% # ( 1900, 2900 ] 2 4.444% 75.556% # ( 2900, 4400 ] 2 4.444% 80.000% # ( 4400, 6600 ] 6 13.333% 93.333% ### ( 6600, 9900 ] 3 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 1137.8667 StdDev: 1180.70 Min: 91 Median: 725.0000 Max: 4242 Percentiles: P50: 725.00 P75: 1600.00 P99: 4242.00 P99.9: 4242.00 P99.99: 4242.00 ------------------------------------------------------ ( 76, 110 ] 3 5.000% 5.000% # ( 110, 170 ] 6 10.000% 15.000% ## ( 170, 250 ] 11 18.333% 33.333% #### ( 250, 380 ] 3 5.000% 38.333% # ( 380, 580 ] 5 8.333% 46.667% ## ( 580, 870 ] 4 6.667% 53.333% # ( 870, 1300 ] 10 16.667% 70.000% ### ( 1300, 1900 ] 6 10.000% 80.000% ## ( 1900, 2900 ] 2 3.333% 83.333% # ( 2900, 4400 ] 10 16.667% 100.000% ### ** DB Stats ** Uptime(secs): 11.9 total, 4.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 248.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.698 H:M:S, 5.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 248.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-18:49:30 ... thread 0: (1000000,4000000) ops and (253324.4,253736.6) ops/second in (3.947507,15.764382) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 2.57 GB 69.0 2.2 0.0 2.2 5.9 3.7 0.0 1.6 99.3 267.2 22.80 20.87 68 0.335 2299K 10K 0.0 0.0 L1 4/4 467.33 MB 0.0 1.2 1.0 0.2 1.2 1.0 0.2 1.2 214.3 210.4 5.86 5.47 2 2.930 1275K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.3 0.4 0.2 0.5 2.4 251.9 251.1 1.77 1.71 2 0.887 453K 1359 0.0 0.0 L3 15/0 753.34 MB 0.8 1.2 0.4 0.8 1.2 0.4 0.4 3.0 196.8 195.4 6.34 5.88 3 2.113 1267K 8889 0.0 0.0 L4 146/0 9.70 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 168.9 168.9 0.50 0.41 1 0.498 85K 0 0.0 0.0 L5 140/0 9.47 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 323/17 22.93 GB 0.0 5.2 1.7 3.5 8.9 5.4 2.7 2.4 142.2 244.0 37.27 34.34 76 0.490 5381K 43K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 1.7 3.5 8.9 5.4 2.7 2.4 142.2 244.0 37.27 34.34 76 0.490 5381K 43K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 1.7 3.5 5.1 1.6 0.0 0.0 223.6 221.8 23.70 22.39 17 1.394 5381K 43K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 282.7 13.57 11.95 59 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.8 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.88 GB write, 573.73 MB/s write, 5.18 GB read, 334.37 MB/s read, 37.3 seconds Interval compaction: 8.88 GB write, 576.76 MB/s write, 5.18 GB read, 336.14 MB/s read, 37.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1128229 Average: 2.6900 StdDev: 16.71 Min: 0 Median: 1.6103 Max: 3876 Percentiles: P50: 1.61 P75: 2.00 P99: 6.82 P99.9: 94.79 P99.99: 251.41 ------------------------------------------------------ [ 0, 1 ] 116845 10.356% 10.356% ## ( 1, 2 ] 732842 64.955% 75.312% ############# ( 2, 3 ] 198560 17.599% 92.911% #### ( 3, 4 ] 38671 3.428% 96.338% # ( 4, 6 ] 27942 2.477% 98.815% ( 6, 10 ] 10223 0.906% 99.721% ( 10, 15 ] 1615 0.143% 99.864% ( 15, 22 ] 165 0.015% 99.879% ( 22, 34 ] 25 0.002% 99.881% ( 34, 51 ] 6 0.001% 99.882% ( 51, 76 ] 106 0.009% 99.891% ( 76, 110 ] 186 0.016% 99.908% ( 110, 170 ] 622 0.055% 99.963% ( 170, 250 ] 308 0.027% 99.990% ( 250, 380 ] 201 0.018% 100.008% ( 380, 580 ] 137 0.012% 100.020% ( 580, 870 ] 57 0.005% 100.025% ( 870, 1300 ] 38 0.003% 100.028% ( 1300, 1900 ] 21 0.002% 100.030% ( 1900, 2900 ] 9 0.001% 100.031% ( 2900, 4400 ] 6 0.001% 100.032% ** Level 1 read latency histogram (micros): Count: 96359 Average: 3.1890 StdDev: 24.97 Min: 1 Median: 1.6672 Max: 3809 Percentiles: P50: 1.67 P75: 2.18 P99: 8.53 P99.9: 216.07 P99.99: 967.76 ------------------------------------------------------ [ 0, 1 ] 7081 7.349% 7.349% # ( 1, 2 ] 61595 63.922% 71.271% ############# ( 2, 3 ] 19523 20.261% 91.532% #### ( 3, 4 ] 3592 3.728% 95.259% # ( 4, 6 ] 2751 2.855% 98.114% # ( 6, 10 ] 1347 1.398% 99.512% ( 10, 15 ] 196 0.203% 99.716% ( 15, 22 ] 19 0.020% 99.735% ( 22, 34 ] 6 0.006% 99.742% ( 51, 76 ] 2 0.002% 99.744% ( 76, 110 ] 2 0.002% 99.746% ( 110, 170 ] 121 0.126% 99.871% ( 170, 250 ] 48 0.050% 99.921% ( 250, 380 ] 22 0.023% 99.944% ( 380, 580 ] 32 0.033% 99.977% ( 580, 870 ] 11 0.011% 99.989% ( 870, 1300 ] 6 0.006% 99.995% ( 1300, 1900 ] 3 0.003% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 137954 Average: 2.8449 StdDev: 35.61 Min: 1 Median: 1.5720 Max: 6951 Percentiles: P50: 1.57 P75: 2.04 P99: 7.94 P99.9: 131.61 P99.99: 793.11 ------------------------------------------------------ [ 0, 1 ] 24064 17.443% 17.443% ### ( 1, 2 ] 78517 56.915% 74.359% ########### ( 2, 3 ] 24068 17.446% 91.805% ### ( 3, 4 ] 4981 3.611% 95.416% # ( 4, 6 ] 4264 3.091% 98.507% # ( 6, 10 ] 1403 1.017% 99.524% ( 10, 15 ] 347 0.252% 99.775% ( 15, 22 ] 32 0.023% 99.798% ( 22, 34 ] 3 0.002% 99.801% ( 34, 51 ] 1 0.001% 99.801% ( 51, 76 ] 94 0.068% 99.870% ( 76, 110 ] 19 0.014% 99.883% ( 110, 170 ] 64 0.046% 99.930% ( 170, 250 ] 38 0.028% 99.957% ( 250, 380 ] 22 0.016% 99.973% ( 380, 580 ] 21 0.015% 99.988% ( 580, 870 ] 3 0.002% 99.991% ( 870, 1300 ] 4 0.003% 99.993% ( 1300, 1900 ] 5 0.004% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 4400, 6600 ] 2 0.001% 99.999% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 3 read latency histogram (micros): Count: 233381 Average: 4.7879 StdDev: 77.94 Min: 1 Median: 2.1176 Max: 10341 Percentiles: P50: 2.12 P75: 2.72 P99: 11.45 P99.9: 321.19 P99.99: 4545.62 ------------------------------------------------------ [ 0, 1 ] 1632 0.699% 0.699% ( 1, 2 ] 103723 44.444% 45.143% ######### ( 2, 3 ] 96364 41.290% 86.433% ######## ( 3, 4 ] 11495 4.925% 91.359% # ( 4, 6 ] 12711 5.446% 96.805% # ( 6, 10 ] 4703 2.015% 98.820% ( 10, 15 ] 1445 0.619% 99.440% ( 15, 22 ] 290 0.124% 99.564% ( 22, 34 ] 29 0.012% 99.576% ( 34, 51 ] 4 0.002% 99.578% ( 76, 110 ] 110 0.047% 99.625% ( 110, 170 ] 414 0.177% 99.802% ( 170, 250 ] 186 0.080% 99.882% ( 250, 380 ] 76 0.033% 99.915% ( 380, 580 ] 97 0.042% 99.956% ( 580, 870 ] 28 0.012% 99.968% ( 870, 1300 ] 25 0.011% 99.979% ( 1300, 1900 ] 15 0.006% 99.985% ( 1900, 2900 ] 9 0.004% 99.989% ( 2900, 4400 ] 1 0.000% 99.990% ( 4400, 6600 ] 10 0.004% 99.994% ( 6600, 9900 ] 12 0.005% 99.999% ( 9900, 14000 ] 2 0.001% 100.000% ** Level 4 read latency histogram (micros): Count: 45 Average: 1710.5111 StdDev: 2795.65 Min: 1 Median: 14.3750 Max: 8982 Percentiles: P50: 14.38 P75: 2775.00 P99: 8982.00 P99.9: 8982.00 P99.99: 8982.00 ------------------------------------------------------ [ 0, 1 ] 11 24.444% 24.444% ##### ( 1, 2 ] 3 6.667% 31.111% # ( 2, 3 ] 3 6.667% 37.778% # ( 3, 4 ] 1 2.222% 40.000% ( 6, 10 ] 1 2.222% 42.222% ( 10, 15 ] 4 8.889% 51.111% ## ( 22, 34 ] 1 2.222% 53.333% ( 34, 51 ] 1 2.222% 55.556% ( 51, 76 ] 4 8.889% 64.444% ## ( 870, 1300 ] 3 6.667% 71.111% # ( 1900, 2900 ] 2 4.444% 75.556% # ( 2900, 4400 ] 2 4.444% 80.000% # ( 4400, 6600 ] 6 13.333% 93.333% ### ( 6600, 9900 ] 3 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 1137.8667 StdDev: 1180.70 Min: 91 Median: 725.0000 Max: 4242 Percentiles: P50: 725.00 P75: 1600.00 P99: 4242.00 P99.9: 4242.00 P99.99: 4242.00 ------------------------------------------------------ ( 76, 110 ] 3 5.000% 5.000% # ( 110, 170 ] 6 10.000% 15.000% ## ( 170, 250 ] 11 18.333% 33.333% #### ( 250, 380 ] 3 5.000% 38.333% # ( 380, 580 ] 5 8.333% 46.667% ## ( 580, 870 ] 4 6.667% 53.333% # ( 870, 1300 ] 10 16.667% 70.000% ### ( 1300, 1900 ] 6 10.000% 80.000% ## ( 1900, 2900 ] 2 3.333% 83.333% # ( 2900, 4400 ] 10 16.667% 100.000% ### ** DB Stats ** Uptime(secs): 15.8 total, 3.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 248.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.698 H:M:S, 4.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 249.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.128 micros/op 242235 ops/sec 20.071 seconds 4861999 operations; 234.7 MB/s Microseconds per write: Count: 4861999 Average: 4.1282 StdDev: 182.13 Min: 1 Median: 2.5937 Max: 312368 Percentiles: P50: 2.59 P75: 4.06 P99: 9.86 P99.9: 137.61 P99.99: 1040.54 ------------------------------------------------------ [ 0, 1 ] 117968 2.426% 2.426% ( 1, 2 ] 1297696 26.691% 29.117% ##### ( 2, 3 ] 1710075 35.172% 64.289% ####### ( 3, 4 ] 495340 10.188% 74.477% ## ( 4, 6 ] 875967 18.017% 92.494% #### ( 6, 10 ] 328043 6.747% 99.241% # ( 10, 15 ] 24053 0.495% 99.736% ( 15, 22 ] 4933 0.101% 99.837% ( 22, 34 ] 1757 0.036% 99.873% ( 34, 51 ] 388 0.008% 99.881% ( 51, 76 ] 47 0.001% 99.882% ( 76, 110 ] 4 0.000% 99.882% ( 110, 170 ] 1882 0.039% 99.921% ( 170, 250 ] 2878 0.059% 99.980% ( 250, 380 ] 163 0.003% 99.983% ( 380, 580 ] 12 0.000% 99.984% ( 580, 870 ] 3 0.000% 99.984% ( 870, 1300 ] 766 0.016% 100.000% ( 1300, 1900 ] 2 0.000% 100.000% ( 1900, 2900 ] 17 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 115988 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4861999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5017582968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 163 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 1549154 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 8312923968 rocksdb.compact.write.bytes COUNT : 8200442196 rocksdb.flush.write.bytes COUNT : 4947372463 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 19 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 68 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4914341888 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8173568 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 8356563630 rocksdb.non.last.level.read.count COUNT : 2016575 rocksdb.block.checksum.compute.count COUNT : 2016268 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.864561 P95 : 5.955213 P99 : 9.572799 P100 : 312366.000000 COUNT : 4861999 SUM : 16988470 rocksdb.compaction.times.micros P50 : 1017857.142857 P95 : 4842206.000000 P99 : 4842206.000000 P100 : 4842206.000000 COUNT : 21 SUM : 27715606 rocksdb.compaction.times.cpu_micros P50 : 1017857.142857 P95 : 4490686.000000 P99 : 4490686.000000 P100 : 4490686.000000 COUNT : 21 SUM : 26337578 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 775.000000 P95 : 1777.692308 P99 : 2170.000000 P100 : 2178.000000 COUNT : 73 SUM : 65762 rocksdb.compaction.outfile.sync.micros P50 : 861.212121 P95 : 1330.000000 P99 : 1717.000000 P100 : 1717.000000 COUNT : 76 SUM : 65205 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 137.073171 P95 : 327.187500 P99 : 570.000000 P100 : 614.000000 COUNT : 105 SUM : 16376 rocksdb.table.open.io.micros P50 : 1737.142857 P95 : 21828.571429 P99 : 26153.000000 P100 : 26153.000000 COUNT : 163 SUM : 631610 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.923861 P95 : 7.419112 P99 : 12.321932 P100 : 19165.000000 COUNT : 2015903 SUM : 10307943 rocksdb.read.block.get.micros P50 : 650.731707 P95 : 6754.000000 P99 : 9622.800000 P100 : 10490.000000 COUNT : 326 SUM : 459377 rocksdb.write.raw.block.micros P50 : 0.519977 P95 : 0.987957 P99 : 4.211637 P100 : 4092.000000 COUNT : 3185322 SUM : 7107901 rocksdb.numfiles.in.singlecompaction P50 : 3.386364 P95 : 12.250000 P99 : 13.000000 P100 : 13.000000 COUNT : 33 SUM : 141 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559745 P95 : 1101.687827 P99 : 1269.793063 P100 : 312168.000000 COUNT : 7467 SUM : 1550061 rocksdb.sst.read.micros P50 : 1.687366 P95 : 3.884193 P99 : 8.055984 P100 : 10341.000000 COUNT : 2016793 SUM : 6201817 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4861999 SUM : 5017582968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212941.176471 P95 : 308500.000000 P99 : 468343.000000 P100 : 468343.000000 COUNT : 73 SUM : 16774807 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 92 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0