[2024-11-04 15:27:56.530123] Starting SPDK v25.01-pre git sha1 8ee9fa114 / DPDK 24.03.0 initialization... [2024-11-04 15:27:56.530221] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2109808 ] Set seed to 1730730476527759 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-04 15:27:56.640963] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-04 15:27:56.747981] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-04 15:27:56.748035] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2109808' to capture a snapshot of events at runtime. [2024-11-04 15:27:56.748045] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-04 15:27:56.748055] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-04 15:27:56.748063] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2109808 for offline analysis/debug. [2024-11-04 15:27:56.749470] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 4 15:28:02 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/04-15:28:05 ... thread 0: (1000000,1000000) ops and (336561.5,336561.5) ops/second in (2.971225,2.971225) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 503.12 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.4 2.51 2.25 12 0.209 0 0 0.0 0.0 L1 2/0 239.55 MB 24.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.0 254.0 0.99 0.96 1 0.986 255K 1007 0.0 0.0 L2 1/0 50.33 MB 0.5 0.3 0.1 0.2 0.3 0.1 0.0 2.3 251.5 250.7 1.23 1.17 3 0.410 314K 949 0.0 0.0 L3 17/0 939.19 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 218.2 218.2 0.55 0.50 1 0.551 122K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 251/5 20.09 GB 0.0 0.7 0.5 0.2 1.5 1.4 0.1 1.8 129.0 295.4 5.28 4.88 17 0.311 691K 1956 0.0 0.0 Int 0/0 0.00 KB 0.0 0.7 0.5 0.2 1.5 1.4 0.1 1.8 129.0 295.4 5.28 4.88 17 0.311 691K 1956 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.7 0.5 0.2 0.7 0.5 0.0 0.0 246.1 245.4 2.77 2.63 5 0.553 691K 1956 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.4 2.51 2.25 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.52 GB write, 501.81 MB/s write, 0.66 GB read, 219.14 MB/s read, 5.3 seconds Interval compaction: 1.52 GB write, 524.22 MB/s write, 0.66 GB read, 228.92 MB/s read, 5.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 140191 Average: 2.0038 StdDev: 13.38 Min: 1 Median: 1.3410 Max: 3165 Percentiles: P50: 1.34 P75: 1.75 P99: 5.37 P99.9: 9.96 P99.99: 75.52 ------------------------------------------------------ [ 0, 1 ] 41066 29.293% 29.293% ###### ( 1, 2 ] 85142 60.733% 90.026% ############ ( 2, 3 ] 8083 5.766% 95.791% # ( 3, 4 ] 3011 2.148% 97.939% ( 4, 6 ] 2167 1.546% 99.485% ( 6, 10 ] 588 0.419% 99.904% ( 10, 15 ] 108 0.077% 99.981% ( 15, 22 ] 10 0.007% 99.989% ( 22, 34 ] 1 0.001% 99.989% ( 34, 51 ] 1 0.001% 99.990% ( 51, 76 ] 1 0.001% 99.991% ( 76, 110 ] 1 0.001% 99.991% ( 110, 170 ] 4 0.003% 99.994% ( 170, 250 ] 6 0.004% 99.999% ( 250, 380 ] 2 0.001% 100.000% ( 380, 580 ] 6 0.004% 100.004% ( 580, 870 ] 2 0.001% 100.006% ( 1300, 1900 ] 1 0.001% 100.006% ( 1900, 2900 ] 2 0.001% 100.008% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 2770 Average: 3.6653 StdDev: 29.02 Min: 1 Median: 1.7450 Max: 1077 Percentiles: P50: 1.75 P75: 2.63 P99: 9.13 P99.9: 426.00 P99.99: 1077.00 ------------------------------------------------------ [ 0, 1 ] 222 8.014% 8.014% ## ( 1, 2 ] 1561 56.354% 64.368% ########### ( 2, 3 ] 470 16.968% 81.336% ### ( 3, 4 ] 264 9.531% 90.866% ## ( 4, 6 ] 183 6.606% 97.473% # ( 6, 10 ] 54 1.949% 99.422% ( 10, 15 ] 7 0.253% 99.675% ( 15, 22 ] 3 0.108% 99.783% ( 22, 34 ] 2 0.072% 99.856% ( 250, 380 ] 1 0.036% 99.892% ( 380, 580 ] 1 0.036% 99.928% ( 870, 1300 ] 2 0.072% 100.000% ** Level 2 read latency histogram (micros): Count: 74373 Average: 2.3411 StdDev: 12.46 Min: 1 Median: 1.4545 Max: 1999 Percentiles: P50: 1.45 P75: 1.85 P99: 5.98 P99.9: 52.45 P99.99: 355.63 ------------------------------------------------------ [ 0, 1 ] 16043 21.571% 21.571% #### ( 1, 2 ] 46520 62.550% 84.121% ############# ( 2, 3 ] 6940 9.331% 93.452% ## ( 3, 4 ] 2234 3.004% 96.456% # ( 4, 6 ] 1910 2.568% 99.024% # ( 6, 10 ] 550 0.740% 99.763% ( 10, 15 ] 84 0.113% 99.876% ( 15, 22 ] 14 0.019% 99.895% ( 22, 34 ] 1 0.001% 99.896% ( 34, 51 ] 1 0.001% 99.898% ( 51, 76 ] 28 0.038% 99.935% ( 76, 110 ] 6 0.008% 99.944% ( 110, 170 ] 6 0.008% 99.952% ( 170, 250 ] 18 0.024% 99.976% ( 250, 380 ] 13 0.017% 99.993% ( 380, 580 ] 2 0.003% 99.996% ( 580, 870 ] 5 0.007% 100.003% ( 870, 1300 ] 2 0.003% 100.005% ( 1900, 2900 ] 1 0.001% 100.007% ** Level 3 read latency histogram (micros): Count: 85 Average: 1792.9882 StdDev: 2799.89 Min: 1 Median: 451.4286 Max: 10754 Percentiles: P50: 451.43 P75: 1870.00 P99: 10754.00 P99.9: 10754.00 P99.99: 10754.00 ------------------------------------------------------ [ 0, 1 ] 7 8.235% 8.235% ## ( 1, 2 ] 17 20.000% 28.235% #### ( 2, 3 ] 1 1.176% 29.412% ( 6, 10 ] 5 5.882% 35.294% # ( 10, 15 ] 3 3.529% 38.824% # ( 15, 22 ] 3 3.529% 42.353% # ( 170, 250 ] 2 2.353% 44.706% ( 250, 380 ] 2 2.353% 47.059% ( 380, 580 ] 7 8.235% 55.294% ## ( 580, 870 ] 7 8.235% 63.529% ## ( 870, 1300 ] 5 5.882% 69.412% # ( 1300, 1900 ] 5 5.882% 75.294% # ( 1900, 2900 ] 1 1.176% 76.471% ( 2900, 4400 ] 5 5.882% 82.353% # ( 4400, 6600 ] 7 8.235% 90.588% ## ( 6600, 9900 ] 6 7.059% 97.647% # ( 9900, 14000 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 3454.7000 StdDev: 2591.25 Min: 244 Median: 3200.0000 Max: 10360 Percentiles: P50: 3200.00 P75: 5500.00 P99: 10360.00 P99.9: 10360.00 P99.99: 10360.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 2 6.667% 26.667% # ( 1300, 1900 ] 4 13.333% 40.000% ### ( 1900, 2900 ] 2 6.667% 46.667% # ( 2900, 4400 ] 5 16.667% 63.333% ### ( 4400, 6600 ] 7 23.333% 86.667% ##### ( 6600, 9900 ] 3 10.000% 96.667% ## ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 316.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.364 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.364 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/04-15:28:08 ... thread 0: (1000000,2000000) ops and (323093.8,329690.2) ops/second in (3.095076,6.066301) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.47 GB 87.5 0.9 0.0 0.9 2.7 1.8 0.0 1.5 99.8 313.0 8.82 8.16 29 0.304 894K 5211 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.0 254.0 0.99 0.96 1 0.986 255K 1007 0.0 0.0 L2 1/1 50.33 MB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 251.5 250.7 1.23 1.17 3 0.410 314K 949 0.0 0.0 L3 18/9 1.15 GB 0.4 0.5 0.4 0.1 0.5 0.3 0.0 1.4 225.8 225.1 2.23 2.09 3 0.742 510K 1523 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 254/18 21.06 GB 0.0 1.9 0.7 1.2 3.7 2.6 0.4 2.0 146.6 288.1 13.27 12.39 36 0.369 1974K 8690 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.7 1.2 3.7 2.6 0.4 2.0 146.6 288.1 13.27 12.39 36 0.369 1974K 8690 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.7 1.2 1.9 0.7 0.0 0.0 247.6 246.4 7.85 7.58 10 0.785 1974K 8690 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.5 5.41 4.81 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.1 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.73 GB write, 616.20 MB/s write, 1.90 GB read, 313.47 MB/s read, 13.3 seconds Interval compaction: 3.73 GB write, 629.69 MB/s write, 1.90 GB read, 320.33 MB/s read, 13.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 391046 Average: 2.3112 StdDev: 12.02 Min: 1 Median: 1.5418 Max: 3371 Percentiles: P50: 1.54 P75: 1.94 P99: 5.87 P99.9: 10.54 P99.99: 17.93 ------------------------------------------------------ [ 0, 1 ] 62908 16.087% 16.087% ### ( 1, 2 ] 244785 62.597% 78.685% ############# ( 2, 3 ] 51021 13.047% 91.732% ### ( 3, 4 ] 16013 4.095% 95.827% # ( 4, 6 ] 13248 3.388% 99.215% # ( 6, 10 ] 2642 0.676% 99.890% ( 10, 15 ] 368 0.094% 99.984% ( 15, 22 ] 57 0.015% 99.999% ( 22, 34 ] 10 0.003% 100.002% ( 34, 51 ] 1 0.000% 100.002% ( 51, 76 ] 3 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.003% ( 110, 170 ] 4 0.001% 100.004% ( 170, 250 ] 18 0.005% 100.008% ( 250, 380 ] 6 0.002% 100.010% ( 380, 580 ] 11 0.003% 100.013% ( 580, 870 ] 8 0.002% 100.015% ( 870, 1300 ] 5 0.001% 100.016% ( 1300, 1900 ] 2 0.001% 100.017% ( 1900, 2900 ] 3 0.001% 100.017% ( 2900, 4400 ] 2 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 63596 Average: 2.7653 StdDev: 9.92 Min: 1 Median: 1.7814 Max: 1682 Percentiles: P50: 1.78 P75: 2.52 P99: 8.26 P99.9: 15.08 P99.99: 412.02 ------------------------------------------------------ [ 0, 1 ] 2018 3.173% 3.173% # ( 1, 2 ] 38111 59.927% 63.100% ############ ( 2, 3 ] 14637 23.016% 86.115% ##### ( 3, 4 ] 3796 5.969% 92.084% # ( 4, 6 ] 3910 6.148% 98.233% # ( 6, 10 ] 865 1.360% 99.593% ( 10, 15 ] 195 0.307% 99.899% ( 15, 22 ] 34 0.053% 99.953% ( 22, 34 ] 3 0.005% 99.958% ( 76, 110 ] 12 0.019% 99.976% ( 110, 170 ] 5 0.008% 99.984% ( 170, 250 ] 1 0.002% 99.986% ( 250, 380 ] 2 0.003% 99.989% ( 380, 580 ] 4 0.006% 99.995% ( 870, 1300 ] 2 0.003% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 77427 Average: 2.4412 StdDev: 13.53 Min: 1 Median: 1.4688 Max: 1999 Percentiles: P50: 1.47 P75: 1.87 P99: 6.10 P99.9: 70.26 P99.99: 470.29 ------------------------------------------------------ [ 0, 1 ] 16119 20.818% 20.818% #### ( 1, 2 ] 48193 62.243% 83.061% ############ ( 2, 3 ] 7842 10.128% 93.190% ## ( 3, 4 ] 2421 3.127% 96.317% # ( 4, 6 ] 2063 2.664% 98.981% # ( 6, 10 ] 584 0.754% 99.735% ( 10, 15 ] 90 0.116% 99.851% ( 15, 22 ] 14 0.018% 99.870% ( 22, 34 ] 1 0.001% 99.871% ( 34, 51 ] 1 0.001% 99.872% ( 51, 76 ] 28 0.036% 99.908% ( 76, 110 ] 6 0.008% 99.916% ( 110, 170 ] 12 0.015% 99.932% ( 170, 250 ] 24 0.031% 99.963% ( 250, 380 ] 19 0.025% 99.987% ( 380, 580 ] 5 0.006% 99.994% ( 580, 870 ] 7 0.009% 100.003% ( 870, 1300 ] 2 0.003% 100.005% ( 1900, 2900 ] 1 0.001% 100.006% ** Level 3 read latency histogram (micros): Count: 199036 Average: 3.9643 StdDev: 70.66 Min: 1 Median: 1.7269 Max: 10754 Percentiles: P50: 1.73 P75: 2.38 P99: 8.93 P99.9: 228.46 P99.99: 945.12 ------------------------------------------------------ [ 0, 1 ] 9327 4.686% 4.686% # ( 1, 2 ] 124084 62.342% 67.029% ############ ( 2, 3 ] 41602 20.902% 87.930% #### ( 3, 4 ] 9892 4.970% 92.900% # ( 4, 6 ] 9569 4.808% 97.708% # ( 6, 10 ] 3510 1.764% 99.471% ( 10, 15 ] 372 0.187% 99.658% ( 15, 22 ] 65 0.033% 99.691% ( 22, 34 ] 2 0.001% 99.692% ( 34, 51 ] 1 0.001% 99.693% ( 76, 110 ] 87 0.044% 99.736% ( 110, 170 ] 258 0.130% 99.866% ( 170, 250 ] 93 0.047% 99.913% ( 250, 380 ] 73 0.037% 99.949% ( 380, 580 ] 53 0.027% 99.976% ( 580, 870 ] 26 0.013% 99.989% ( 870, 1300 ] 12 0.006% 99.995% ( 1300, 1900 ] 6 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 6 0.003% 100.002% ( 4400, 6600 ] 7 0.004% 100.005% ( 6600, 9900 ] 6 0.003% 100.008% ( 9900, 14000 ] 2 0.001% 100.009% ** Level 4 read latency histogram (micros): Count: 30 Average: 3454.7000 StdDev: 2591.25 Min: 244 Median: 3200.0000 Max: 10360 Percentiles: P50: 3200.00 P75: 5500.00 P99: 10360.00 P99.9: 10360.00 P99.99: 10360.00 ------------------------------------------------------ ( 170, 250 ] 1 3.333% 3.333% # ( 250, 380 ] 1 3.333% 6.667% # ( 380, 580 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 2 6.667% 26.667% # ( 1300, 1900 ] 4 13.333% 40.000% ### ( 1900, 2900 ] 2 6.667% 46.667% # ( 2900, 4400 ] 5 16.667% 63.333% ### ( 4400, 6600 ] 7 23.333% 86.667% ##### ( 6600, 9900 ] 3 10.000% 96.667% ## ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 317.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.780 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/04-15:28:11 ... thread 0: (1000000,3000000) ops and (354214.5,337478.7) ops/second in (2.823148,8.889449) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.32 GB 181.4 1.7 0.0 1.7 4.4 2.7 0.0 1.6 119.8 307.3 14.70 13.68 45 0.327 1788K 10K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.0 254.0 0.99 0.96 1 0.986 255K 1007 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 251.5 250.7 1.23 1.17 3 0.410 314K 949 0.0 0.0 L3 10/0 524.14 MB 0.5 1.3 0.4 0.9 1.3 0.4 0.0 3.3 228.9 226.0 6.00 5.62 4 1.499 1393K 17K 0.0 0.0 L4 118/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 208.9 208.9 0.83 0.74 1 0.827 175K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 259/8 21.90 GB 0.0 3.8 0.9 2.8 6.4 3.6 1.5 2.4 162.9 278.2 23.74 22.17 54 0.440 3926K 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 0.9 2.8 6.4 3.6 1.5 2.4 162.9 278.2 23.74 22.17 54 0.440 3926K 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 0.9 2.8 3.7 0.9 0.0 0.0 243.9 242.1 15.85 15.16 15 1.057 3926K 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 350.9 7.89 7.01 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.702, interval 2.702 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.45 GB write, 731.77 MB/s write, 3.78 GB read, 428.41 MB/s read, 23.7 seconds Interval compaction: 6.45 GB write, 742.70 MB/s write, 3.78 GB read, 434.81 MB/s read, 23.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 641733 Average: 2.2799 StdDev: 11.43 Min: 1 Median: 1.5365 Max: 3371 Percentiles: P50: 1.54 P75: 1.93 P99: 5.77 P99.9: 9.98 P99.99: 16.27 ------------------------------------------------------ [ 0, 1 ] 99746 15.543% 15.543% ### ( 1, 2 ] 412184 64.230% 79.773% ############# ( 2, 3 ] 83212 12.967% 92.740% ### ( 3, 4 ] 23649 3.685% 96.425% # ( 4, 6 ] 18679 2.911% 99.336% # ( 6, 10 ] 3643 0.568% 99.903% ( 10, 15 ] 545 0.085% 99.988% ( 15, 22 ] 76 0.012% 100.000% ( 22, 34 ] 13 0.002% 100.002% ( 34, 51 ] 4 0.001% 100.003% ( 51, 76 ] 5 0.001% 100.004% ( 76, 110 ] 2 0.000% 100.004% ( 110, 170 ] 4 0.001% 100.005% ( 170, 250 ] 30 0.005% 100.009% ( 250, 380 ] 8 0.001% 100.010% ( 380, 580 ] 17 0.003% 100.013% ( 580, 870 ] 10 0.002% 100.015% ( 870, 1300 ] 9 0.001% 100.016% ( 1300, 1900 ] 6 0.001% 100.017% ( 1900, 2900 ] 5 0.001% 100.018% ( 2900, 4400 ] 2 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 63596 Average: 2.7653 StdDev: 9.92 Min: 1 Median: 1.7814 Max: 1682 Percentiles: P50: 1.78 P75: 2.52 P99: 8.26 P99.9: 15.08 P99.99: 412.02 ------------------------------------------------------ [ 0, 1 ] 2018 3.173% 3.173% # ( 1, 2 ] 38111 59.927% 63.100% ############ ( 2, 3 ] 14637 23.016% 86.115% ##### ( 3, 4 ] 3796 5.969% 92.084% # ( 4, 6 ] 3910 6.148% 98.233% # ( 6, 10 ] 865 1.360% 99.593% ( 10, 15 ] 195 0.307% 99.899% ( 15, 22 ] 34 0.053% 99.953% ( 22, 34 ] 3 0.005% 99.958% ( 76, 110 ] 12 0.019% 99.976% ( 110, 170 ] 5 0.008% 99.984% ( 170, 250 ] 1 0.002% 99.986% ( 250, 380 ] 2 0.003% 99.989% ( 380, 580 ] 4 0.006% 99.995% ( 870, 1300 ] 2 0.003% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 87155 Average: 2.5133 StdDev: 13.60 Min: 1 Median: 1.5023 Max: 1999 Percentiles: P50: 1.50 P75: 1.90 P99: 6.71 P99.9: 93.90 P99.99: 502.41 ------------------------------------------------------ [ 0, 1 ] 16351 18.761% 18.761% #### ( 1, 2 ] 54209 62.198% 80.959% ############ ( 2, 3 ] 10140 11.634% 92.594% ## ( 3, 4 ] 2888 3.314% 95.907% # ( 4, 6 ] 2557 2.934% 98.841% # ( 6, 10 ] 775 0.889% 99.730% ( 10, 15 ] 97 0.111% 99.842% ( 15, 22 ] 14 0.016% 99.858% ( 22, 34 ] 1 0.001% 99.859% ( 34, 51 ] 1 0.001% 99.860% ( 51, 76 ] 28 0.032% 99.892% ( 76, 110 ] 13 0.015% 99.907% ( 110, 170 ] 22 0.025% 99.932% ( 170, 250 ] 25 0.029% 99.961% ( 250, 380 ] 21 0.024% 99.985% ( 380, 580 ] 7 0.008% 99.993% ( 580, 870 ] 7 0.008% 100.001% ( 870, 1300 ] 3 0.003% 100.005% ( 1900, 2900 ] 1 0.001% 100.006% ** Level 3 read latency histogram (micros): Count: 288312 Average: 3.7609 StdDev: 60.32 Min: 1 Median: 1.7121 Max: 10754 Percentiles: P50: 1.71 P75: 2.33 P99: 8.97 P99.9: 239.39 P99.99: 1067.13 ------------------------------------------------------ [ 0, 1 ] 14678 5.091% 5.091% # ( 1, 2 ] 181832 63.068% 68.159% ############# ( 2, 3 ] 59662 20.694% 88.852% #### ( 3, 4 ] 13043 4.524% 93.376% # ( 4, 6 ] 12412 4.305% 97.681% # ( 6, 10 ] 5129 1.779% 99.460% ( 10, 15 ] 608 0.211% 99.671% ( 15, 22 ] 101 0.035% 99.706% ( 22, 34 ] 4 0.001% 99.708% ( 34, 51 ] 1 0.000% 99.708% ( 76, 110 ] 120 0.042% 99.750% ( 110, 170 ] 327 0.113% 99.863% ( 170, 250 ] 123 0.043% 99.906% ( 250, 380 ] 112 0.039% 99.945% ( 380, 580 ] 82 0.028% 99.973% ( 580, 870 ] 40 0.014% 99.987% ( 870, 1300 ] 20 0.007% 99.994% ( 1300, 1900 ] 13 0.005% 99.998% ( 1900, 2900 ] 1 0.000% 99.999% ( 2900, 4400 ] 7 0.002% 100.001% ( 4400, 6600 ] 7 0.002% 100.003% ( 6600, 9900 ] 6 0.002% 100.006% ( 9900, 14000 ] 2 0.001% 100.006% ** Level 4 read latency histogram (micros): Count: 60 Average: 1777.6000 StdDev: 2487.36 Min: 0 Median: 580.0000 Max: 10360 Percentiles: P50: 580.00 P75: 3200.00 P99: 10360.00 P99.9: 10360.00 P99.99: 10360.00 ------------------------------------------------------ [ 0, 1 ] 11 18.333% 18.333% #### ( 1, 2 ] 7 11.667% 30.000% ## ( 15, 22 ] 1 1.667% 31.667% ( 76, 110 ] 6 10.000% 41.667% ## ( 170, 250 ] 1 1.667% 43.333% ( 250, 380 ] 3 5.000% 48.333% # ( 380, 580 ] 1 1.667% 50.000% ( 580, 870 ] 6 10.000% 60.000% ## ( 870, 1300 ] 2 3.333% 63.333% # ( 1300, 1900 ] 4 6.667% 70.000% # ( 1900, 2900 ] 2 3.333% 73.333% # ( 2900, 4400 ] 5 8.333% 81.667% ## ( 4400, 6600 ] 7 11.667% 93.333% ## ( 6600, 9900 ] 3 5.000% 98.333% # ( 9900, 14000 ] 1 1.667% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1048.6250 StdDev: 1198.44 Min: 92 Median: 500.0000 Max: 4679 Percentiles: P50: 500.00 P75: 1500.00 P99: 4679.00 P99.9: 4679.00 P99.99: 4679.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 10 25.000% 32.500% ##### ( 170, 250 ] 2 5.000% 37.500% # ( 250, 380 ] 2 5.000% 42.500% # ( 380, 580 ] 5 12.500% 55.000% ### ( 580, 870 ] 3 7.500% 62.500% ## ( 870, 1300 ] 4 10.000% 72.500% ## ( 1300, 1900 ] 3 7.500% 80.000% ## ( 1900, 2900 ] 4 10.000% 90.000% ## ( 2900, 4400 ] 3 7.500% 97.500% ## ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.974 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.194 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/04-15:28:14 ... thread 0: (1000000,4000000) ops and (293916.6,325420.9) ops/second in (3.402326,12.291775) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.42 GB 94.1 2.8 0.0 2.8 6.6 3.8 0.0 1.7 128.4 304.5 22.05 20.53 64 0.345 2874K 15K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.0 254.0 0.99 0.96 1 0.986 255K 1007 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 251.5 250.7 1.23 1.17 3 0.410 314K 949 0.0 0.0 L3 10/0 524.14 MB 0.5 1.3 0.4 0.9 1.3 0.4 0.0 3.3 228.9 226.0 6.00 5.62 4 1.499 1393K 17K 0.0 0.0 L4 118/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 208.9 208.9 0.83 0.74 1 0.827 175K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 262/11 23.00 GB 0.0 4.8 0.9 3.9 8.6 4.7 1.5 2.3 158.8 283.1 31.09 29.02 73 0.426 5012K 34K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 0.9 3.9 8.6 4.7 1.5 2.3 158.8 283.1 31.09 29.02 73 0.426 5012K 34K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 0.9 3.9 4.8 0.9 0.0 0.0 247.7 246.0 19.93 19.13 19 1.049 5012K 34K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 349.3 11.16 9.89 54 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.3 interval Flush(GB): cumulative 3.808, interval 3.808 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.59 GB write, 708.09 MB/s write, 4.82 GB read, 397.17 MB/s read, 31.1 seconds Interval compaction: 8.59 GB write, 715.74 MB/s write, 4.82 GB read, 401.46 MB/s read, 31.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 17, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 974381 Average: 2.3746 StdDev: 16.18 Min: 0 Median: 1.5291 Max: 4363 Percentiles: P50: 1.53 P75: 1.91 P99: 5.79 P99.9: 12.32 P99.99: 166.38 ------------------------------------------------------ [ 0, 1 ] 150270 15.422% 15.422% ### ( 1, 2 ] 636749 65.349% 80.771% ############# ( 2, 3 ] 123159 12.640% 93.411% ### ( 3, 4 ] 32643 3.350% 96.761% # ( 4, 6 ] 24389 2.503% 99.264% # ( 6, 10 ] 5869 0.602% 99.866% ( 10, 15 ] 707 0.073% 99.939% ( 15, 22 ] 101 0.010% 99.949% ( 22, 34 ] 15 0.002% 99.951% ( 34, 51 ] 6 0.001% 99.951% ( 51, 76 ] 5 0.001% 99.952% ( 76, 110 ] 161 0.017% 99.968% ( 110, 170 ] 223 0.023% 99.991% ( 170, 250 ] 101 0.010% 100.002% ( 250, 380 ] 49 0.005% 100.007% ( 380, 580 ] 54 0.006% 100.012% ( 580, 870 ] 21 0.002% 100.014% ( 870, 1300 ] 19 0.002% 100.016% ( 1300, 1900 ] 7 0.001% 100.017% ( 1900, 2900 ] 8 0.001% 100.018% ( 2900, 4400 ] 9 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 63596 Average: 2.7653 StdDev: 9.92 Min: 1 Median: 1.7814 Max: 1682 Percentiles: P50: 1.78 P75: 2.52 P99: 8.26 P99.9: 15.08 P99.99: 412.02 ------------------------------------------------------ [ 0, 1 ] 2018 3.173% 3.173% # ( 1, 2 ] 38111 59.927% 63.100% ############ ( 2, 3 ] 14637 23.016% 86.115% ##### ( 3, 4 ] 3796 5.969% 92.084% # ( 4, 6 ] 3910 6.148% 98.233% # ( 6, 10 ] 865 1.360% 99.593% ( 10, 15 ] 195 0.307% 99.899% ( 15, 22 ] 34 0.053% 99.953% ( 22, 34 ] 3 0.005% 99.958% ( 76, 110 ] 12 0.019% 99.976% ( 110, 170 ] 5 0.008% 99.984% ( 170, 250 ] 1 0.002% 99.986% ( 250, 380 ] 2 0.003% 99.989% ( 380, 580 ] 4 0.006% 99.995% ( 870, 1300 ] 2 0.003% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 87155 Average: 2.5133 StdDev: 13.60 Min: 1 Median: 1.5023 Max: 1999 Percentiles: P50: 1.50 P75: 1.90 P99: 6.71 P99.9: 93.90 P99.99: 502.41 ------------------------------------------------------ [ 0, 1 ] 16351 18.761% 18.761% #### ( 1, 2 ] 54209 62.198% 80.959% ############ ( 2, 3 ] 10140 11.634% 92.594% ## ( 3, 4 ] 2888 3.314% 95.907% # ( 4, 6 ] 2557 2.934% 98.841% # ( 6, 10 ] 775 0.889% 99.730% ( 10, 15 ] 97 0.111% 99.842% ( 15, 22 ] 14 0.016% 99.858% ( 22, 34 ] 1 0.001% 99.859% ( 34, 51 ] 1 0.001% 99.860% ( 51, 76 ] 28 0.032% 99.892% ( 76, 110 ] 13 0.015% 99.907% ( 110, 170 ] 22 0.025% 99.932% ( 170, 250 ] 25 0.029% 99.961% ( 250, 380 ] 21 0.024% 99.985% ( 380, 580 ] 7 0.008% 99.993% ( 580, 870 ] 7 0.008% 100.001% ( 870, 1300 ] 3 0.003% 100.005% ( 1900, 2900 ] 1 0.001% 100.006% ** Level 3 read latency histogram (micros): Count: 288312 Average: 3.7609 StdDev: 60.32 Min: 1 Median: 1.7121 Max: 10754 Percentiles: P50: 1.71 P75: 2.33 P99: 8.97 P99.9: 239.39 P99.99: 1067.13 ------------------------------------------------------ [ 0, 1 ] 14678 5.091% 5.091% # ( 1, 2 ] 181832 63.068% 68.159% ############# ( 2, 3 ] 59662 20.694% 88.852% #### ( 3, 4 ] 13043 4.524% 93.376% # ( 4, 6 ] 12412 4.305% 97.681% # ( 6, 10 ] 5129 1.779% 99.460% ( 10, 15 ] 608 0.211% 99.671% ( 15, 22 ] 101 0.035% 99.706% ( 22, 34 ] 4 0.001% 99.708% ( 34, 51 ] 1 0.000% 99.708% ( 76, 110 ] 120 0.042% 99.750% ( 110, 170 ] 327 0.113% 99.863% ( 170, 250 ] 123 0.043% 99.906% ( 250, 380 ] 112 0.039% 99.945% ( 380, 580 ] 82 0.028% 99.973% ( 580, 870 ] 40 0.014% 99.987% ( 870, 1300 ] 20 0.007% 99.994% ( 1300, 1900 ] 13 0.005% 99.998% ( 1900, 2900 ] 1 0.000% 99.999% ( 2900, 4400 ] 7 0.002% 100.001% ( 4400, 6600 ] 7 0.002% 100.003% ( 6600, 9900 ] 6 0.002% 100.006% ( 9900, 14000 ] 2 0.001% 100.006% ** Level 4 read latency histogram (micros): Count: 60 Average: 1777.6000 StdDev: 2487.36 Min: 0 Median: 580.0000 Max: 10360 Percentiles: P50: 580.00 P75: 3200.00 P99: 10360.00 P99.9: 10360.00 P99.99: 10360.00 ------------------------------------------------------ [ 0, 1 ] 11 18.333% 18.333% #### ( 1, 2 ] 7 11.667% 30.000% ## ( 15, 22 ] 1 1.667% 31.667% ( 76, 110 ] 6 10.000% 41.667% ## ( 170, 250 ] 1 1.667% 43.333% ( 250, 380 ] 3 5.000% 48.333% # ( 380, 580 ] 1 1.667% 50.000% ( 580, 870 ] 6 10.000% 60.000% ## ( 870, 1300 ] 2 3.333% 63.333% # ( 1300, 1900 ] 4 6.667% 70.000% # ( 1900, 2900 ] 2 3.333% 73.333% # ( 2900, 4400 ] 5 8.333% 81.667% ## ( 4400, 6600 ] 7 11.667% 93.333% ## ( 6600, 9900 ] 3 5.000% 98.333% # ( 9900, 14000 ] 1 1.667% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 1048.6250 StdDev: 1198.44 Min: 92 Median: 500.0000 Max: 4679 Percentiles: P50: 500.00 P75: 1500.00 P99: 4679.00 P99.9: 4679.00 P99.99: 4679.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 10 25.000% 32.500% ##### ( 170, 250 ] 2 5.000% 37.500% # ( 250, 380 ] 2 5.000% 42.500% # ( 380, 580 ] 5 12.500% 55.000% ### ( 580, 870 ] 3 7.500% 62.500% ## ( 870, 1300 ] 4 10.000% 72.500% ## ( 1300, 1900 ] 3 7.500% 80.000% ## ( 1900, 2900 ] 4 10.000% 90.000% ## ( 2900, 4400 ] 3 7.500% 97.500% ## ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 316.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.718 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.745 H:M:S, 21.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.055 micros/op 246616 ops/sec 20.072 seconds 4949999 operations; 239.0 MB/s Microseconds per write: Count: 4949999 Average: 4.0549 StdDev: 240.99 Min: 0 Median: 1.7162 Max: 206118 Percentiles: P50: 1.72 P75: 2.71 P99: 8.13 P99.9: 140.50 P99.99: 2389.93 ------------------------------------------------------ [ 0, 1 ] 693877 14.018% 14.018% ### ( 1, 2 ] 2487018 50.243% 64.261% ########## ( 2, 3 ] 745959 15.070% 79.330% ### ( 3, 4 ] 686193 13.862% 93.193% ### ( 4, 6 ] 263250 5.318% 98.511% # ( 6, 10 ] 45509 0.919% 99.430% ( 10, 15 ] 14425 0.291% 99.722% ( 15, 22 ] 3903 0.079% 99.801% ( 22, 34 ] 768 0.016% 99.816% ( 34, 51 ] 90 0.002% 99.818% ( 51, 76 ] 9 0.000% 99.818% ( 76, 110 ] 3256 0.066% 99.884% ( 110, 170 ] 1558 0.031% 99.915% ( 170, 250 ] 148 0.003% 99.918% ( 250, 380 ] 46 0.001% 99.919% ( 380, 580 ] 9 0.000% 99.920% ( 580, 870 ] 3 0.000% 99.920% ( 870, 1300 ] 3018 0.061% 99.981% ( 1300, 1900 ] 3 0.000% 99.981% ( 1900, 2900 ] 943 0.019% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 6 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 179438 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4949999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5108398968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 146 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6760850 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9234613334 rocksdb.compact.write.bytes COUNT : 9061308521 rocksdb.flush.write.bytes COUNT : 5077872407 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 18 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 68 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5045420032 rocksdb.memtable.garbage.bytes.at.flush COUNT : 9764864 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9278838524 rocksdb.non.last.level.read.count COUNT : 2240717 rocksdb.block.checksum.compute.count COUNT : 2240443 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.354772 P95 : 3.863233 P99 : 6.050478 P100 : 206115.000000 COUNT : 4949999 SUM : 17793681 rocksdb.compaction.times.micros P50 : 987500.000000 P95 : 3495000.000000 P99 : 3768550.000000 P100 : 3768550.000000 COUNT : 23 SUM : 25685249 rocksdb.compaction.times.cpu_micros P50 : 969285.714286 P95 : 2750000.000000 P99 : 3524293.000000 P100 : 3524293.000000 COUNT : 23 SUM : 24525823 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 770.312500 P95 : 1486.000000 P99 : 1817.200000 P100 : 1878.000000 COUNT : 69 SUM : 56803 rocksdb.compaction.outfile.sync.micros P50 : 808.375000 P95 : 2016.666667 P99 : 3305.000000 P100 : 3846.000000 COUNT : 73 SUM : 69899 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 88.853659 P95 : 240.500000 P99 : 334.000000 P100 : 334.000000 COUNT : 99 SUM : 10625 rocksdb.table.open.io.micros P50 : 1666.666667 P95 : 17507.692308 P99 : 21101.538462 P100 : 21950.000000 COUNT : 146 SUM : 515370 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.591700 P95 : 6.477951 P99 : 9.907789 P100 : 15893.000000 COUNT : 2240435 SUM : 10975443 rocksdb.read.block.get.micros P50 : 556.190476 P95 : 6028.000000 P99 : 10009.333333 P100 : 10903.000000 COUNT : 292 SUM : 402703 rocksdb.write.raw.block.micros P50 : 0.510889 P95 : 0.970688 P99 : 2.659215 P100 : 4302.000000 COUNT : 3425641 SUM : 6256597 rocksdb.numfiles.in.singlecompaction P50 : 3.323529 P95 : 8.900000 P99 : 11.000000 P100 : 11.000000 COUNT : 31 SUM : 122 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558964 P95 : 1165.354470 P99 : 2509.819915 P100 : 205890.000000 COUNT : 38033 SUM : 6765022 rocksdb.sst.read.micros P50 : 1.567167 P95 : 3.771959 P99 : 7.756434 P100 : 10754.000000 COUNT : 2241428 SUM : 6732012 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4949999 SUM : 5108398968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210000.000000 P95 : 335150.000000 P99 : 365036.000000 P100 : 365036.000000 COUNT : 69 SUM : 13838252 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 91 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0