[2024-11-18 14:24:21.140485] Starting SPDK v25.01-pre git sha1 d47eb51c9 / DPDK 24.03.0 initialization... [2024-11-18 14:24:21.140803] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3576696 ] Set seed to 1731936261133260 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 14:24:21.293938] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 14:24:21.398028] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 14:24:21.398088] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3576696' to capture a snapshot of events at runtime. [2024-11-18 14:24:21.398101] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 14:24:21.398115] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 14:24:21.398124] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3576696 for offline analysis/debug. [2024-11-18 14:24:21.399370] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 14:24:24 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/18-14:24:27 ... thread 0: (1000000,1000000) ops and (340195.5,340195.5) ops/second in (2.939486,2.939486) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 503.30 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 348.3 2.53 2.36 13 0.194 0 0 0.0 0.0 L1 1/0 11.75 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 257.7 256.6 0.98 0.95 1 0.976 255K 1050 0.0 0.0 L2 3/2 279.03 MB 1.3 0.3 0.1 0.1 0.3 0.1 0.2 2.0 256.4 256.0 1.01 0.98 2 0.503 262K 390 0.0 0.0 L3 18/18 1001.70 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 224.3 224.3 0.53 0.51 1 0.534 121K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.80 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 254/25 20.09 GB 0.0 0.6 0.5 0.1 1.5 1.3 0.4 1.7 124.8 299.0 5.04 4.80 17 0.297 639K 1440 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.5 0.1 1.5 1.3 0.4 1.7 124.8 299.0 5.04 4.80 17 0.297 639K 1440 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 0.0 250.1 249.5 2.52 2.45 4 0.629 639K 1440 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 348.3 2.53 2.36 13 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.9 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.47 GB write, 499.09 MB/s write, 0.61 GB read, 208.24 MB/s read, 5.0 seconds Interval compaction: 1.47 GB write, 512.87 MB/s write, 0.61 GB read, 213.98 MB/s read, 5.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 136678 Average: 1.9862 StdDev: 5.27 Min: 0 Median: 1.3594 Max: 1183 Percentiles: P50: 1.36 P75: 1.77 P99: 5.64 P99.9: 12.36 P99.99: 31.33 ------------------------------------------------------ [ 0, 1 ] 38149 27.912% 27.912% ###### ( 1, 2 ] 84005 61.462% 89.374% ############ ( 2, 3 ] 8544 6.251% 95.625% # ( 3, 4 ] 3193 2.336% 97.961% ( 4, 6 ] 1728 1.264% 99.225% ( 6, 10 ] 829 0.607% 99.832% ( 10, 15 ] 200 0.146% 99.978% ( 15, 22 ] 15 0.011% 99.989% ( 22, 34 ] 3 0.002% 99.991% ( 76, 110 ] 1 0.001% 99.992% ( 170, 250 ] 12 0.009% 100.001% ( 250, 380 ] 9 0.007% 100.007% ( 380, 580 ] 4 0.003% 100.010% ( 870, 1300 ] 1 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 174 Average: 16.0115 StdDev: 83.91 Min: 1 Median: 1.7524 Max: 675 Percentiles: P50: 1.75 P75: 2.58 P99: 617.70 P99.9: 675.00 P99.99: 675.00 ------------------------------------------------------ [ 0, 1 ] 8 4.598% 4.598% # ( 1, 2 ] 105 60.345% 64.943% ############ ( 2, 3 ] 31 17.816% 82.759% #### ( 3, 4 ] 17 9.770% 92.529% ## ( 4, 6 ] 3 1.724% 94.253% ( 6, 10 ] 4 2.299% 96.552% ( 15, 22 ] 2 1.149% 97.701% ( 110, 170 ] 1 0.575% 98.276% ( 380, 580 ] 2 1.149% 99.425% ( 580, 870 ] 2 1.149% 100.575% ** Level 2 read latency histogram (micros): Count: 64051 Average: 2.2293 StdDev: 14.06 Min: 1 Median: 1.3887 Max: 2966 Percentiles: P50: 1.39 P75: 1.79 P99: 7.12 P99.9: 91.18 P99.99: 275.78 ------------------------------------------------------ [ 0, 1 ] 16525 25.800% 25.800% ##### ( 1, 2 ] 39879 62.261% 88.061% ############ ( 2, 3 ] 4281 6.684% 94.745% # ( 3, 4 ] 1524 2.379% 97.124% ( 4, 6 ] 1032 1.611% 98.735% ( 6, 10 ] 603 0.941% 99.677% ( 10, 15 ] 107 0.167% 99.844% ( 15, 22 ] 13 0.020% 99.864% ( 22, 34 ] 7 0.011% 99.875% ( 34, 51 ] 1 0.002% 99.877% ( 51, 76 ] 2 0.003% 99.880% ( 76, 110 ] 29 0.045% 99.925% ( 110, 170 ] 29 0.045% 99.970% ( 170, 250 ] 12 0.019% 99.989% ( 250, 380 ] 3 0.005% 99.994% ( 380, 580 ] 1 0.002% 99.995% ( 580, 870 ] 1 0.002% 99.997% ( 870, 1300 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 5084 Average: 28.5578 StdDev: 305.89 Min: 0 Median: 1.8952 Max: 8062 Percentiles: P50: 1.90 P75: 2.86 P99: 187.28 P99.9: 3379.00 P99.99: 4670.38 ------------------------------------------------------ [ 0, 1 ] 211 4.150% 4.150% # ( 1, 2 ] 2604 51.220% 55.370% ########## ( 2, 3 ] 1166 22.935% 78.304% ##### ( 3, 4 ] 393 7.730% 86.035% ## ( 4, 6 ] 429 8.438% 94.473% ## ( 6, 10 ] 124 2.439% 96.912% ( 10, 15 ] 36 0.708% 97.620% ( 15, 22 ] 4 0.079% 97.699% ( 22, 34 ] 7 0.138% 97.836% ( 76, 110 ] 1 0.020% 97.856% ( 110, 170 ] 56 1.101% 98.958% ( 170, 250 ] 10 0.197% 99.154% ( 250, 380 ] 4 0.079% 99.233% ( 380, 580 ] 1 0.020% 99.253% ( 580, 870 ] 1 0.020% 99.272% ( 870, 1300 ] 5 0.098% 99.371% ( 1300, 1900 ] 16 0.315% 99.685% ( 1900, 2900 ] 9 0.177% 99.862% ( 2900, 4400 ] 6 0.118% 99.980% ( 4400, 6600 ] 4 0.079% 100.059% ( 6600, 9900 ] 3 0.059% 100.118% ** Level 4 read latency histogram (micros): Count: 25 Average: 2740.0000 StdDev: 2162.28 Min: 100 Median: 2025.0000 Max: 7079 Percentiles: P50: 2025.00 P75: 3931.25 P99: 7079.00 P99.9: 7079.00 P99.99: 7079.00 ------------------------------------------------------ ( 76, 110 ] 3 12.000% 12.000% ## ( 380, 580 ] 2 8.000% 20.000% ## ( 870, 1300 ] 2 8.000% 28.000% ## ( 1300, 1900 ] 5 20.000% 48.000% #### ( 1900, 2900 ] 4 16.000% 64.000% ### ( 2900, 4400 ] 4 16.000% 80.000% ### ( 4400, 6600 ] 2 8.000% 88.000% ## ( 6600, 9900 ] 3 12.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 325.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.164 H:M:S, 5.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.164 H:M:S, 5.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/18-14:24:30 ... thread 0: (1000000,2000000) ops and (344106.1,342139.7) ops/second in (2.906080,5.845566) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.41 GB 119.0 1.0 0.0 1.0 2.8 1.8 0.0 1.6 113.9 307.5 9.39 8.93 32 0.294 1086K 5636 0.0 0.0 L1 1/0 11.75 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 257.7 256.6 0.98 0.95 1 0.976 255K 1050 0.0 0.0 L2 1/1 40.41 MB 0.0 0.3 0.1 0.1 0.3 0.1 0.2 2.0 256.4 256.0 1.01 0.98 2 0.503 262K 390 0.0 0.0 L3 19/10 1.15 GB 0.3 0.4 0.4 0.1 0.4 0.3 0.0 1.2 219.8 219.4 1.98 1.92 3 0.661 442K 784 0.0 0.0 L4 122/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 202.1 202.1 0.28 0.27 1 0.284 58K 0 0.0 0.0 L5 108/0 8.80 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 261/15 21.00 GB 0.0 2.0 0.8 1.2 3.8 2.5 0.4 2.1 151.9 285.0 13.64 13.05 39 0.350 2104K 7860 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.8 2.5 0.4 2.1 151.9 285.0 13.64 13.05 39 0.350 2104K 7860 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 2.0 0.8 0.0 0.0 244.6 243.7 8.47 8.26 11 0.770 2104K 7860 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.8 5.17 4.79 28 0.185 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.782, interval 1.782 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.80 GB write, 655.89 MB/s write, 2.02 GB read, 349.52 MB/s read, 13.6 seconds Interval compaction: 3.80 GB write, 665.00 MB/s write, 2.02 GB read, 354.37 MB/s read, 13.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 396251 Average: 2.3318 StdDev: 5.69 Min: 0 Median: 1.5687 Max: 1183 Percentiles: P50: 1.57 P75: 1.96 P99: 6.36 P99.9: 13.40 P99.99: 18.34 ------------------------------------------------------ [ 0, 1 ] 54773 13.823% 13.823% ### ( 1, 2 ] 252052 63.609% 77.432% ############# ( 2, 3 ] 53977 13.622% 91.054% ### ( 3, 4 ] 18873 4.763% 95.817% # ( 4, 6 ] 12329 3.111% 98.928% # ( 6, 10 ] 3187 0.804% 99.732% ( 10, 15 ] 977 0.247% 99.979% ( 15, 22 ] 91 0.023% 100.002% ( 22, 34 ] 13 0.003% 100.005% ( 34, 51 ] 2 0.001% 100.006% ( 51, 76 ] 1 0.000% 100.006% ( 76, 110 ] 2 0.001% 100.007% ( 170, 250 ] 27 0.007% 100.013% ( 250, 380 ] 11 0.003% 100.016% ( 380, 580 ] 19 0.005% 100.021% ( 580, 870 ] 2 0.001% 100.021% ( 870, 1300 ] 5 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 60606 Average: 2.8115 StdDev: 6.73 Min: 1 Median: 1.7821 Max: 692 Percentiles: P50: 1.78 P75: 2.55 P99: 8.82 P99.9: 20.96 P99.99: 249.31 ------------------------------------------------------ [ 0, 1 ] 1612 2.660% 2.660% # ( 1, 2 ] 36684 60.529% 63.188% ############ ( 2, 3 ] 13085 21.590% 84.779% #### ( 3, 4 ] 4535 7.483% 92.261% # ( 4, 6 ] 3503 5.780% 98.041% # ( 6, 10 ] 824 1.360% 99.401% ( 10, 15 ] 276 0.455% 99.856% ( 15, 22 ] 31 0.051% 99.908% ( 22, 34 ] 5 0.008% 99.916% ( 34, 51 ] 4 0.007% 99.922% ( 51, 76 ] 1 0.002% 99.924% ( 76, 110 ] 9 0.015% 99.939% ( 110, 170 ] 24 0.040% 99.979% ( 170, 250 ] 7 0.012% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 2 0.003% 99.995% ( 580, 870 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 65236 Average: 2.3549 StdDev: 15.15 Min: 1 Median: 1.3982 Max: 2966 Percentiles: P50: 1.40 P75: 1.80 P99: 7.38 P99.9: 133.07 P99.99: 370.28 ------------------------------------------------------ [ 0, 1 ] 16533 25.343% 25.343% ##### ( 1, 2 ] 40391 61.915% 87.259% ############ ( 2, 3 ] 4736 7.260% 94.518% # ( 3, 4 ] 1617 2.479% 96.997% ( 4, 6 ] 1093 1.675% 98.673% ( 6, 10 ] 618 0.947% 99.620% ( 10, 15 ] 110 0.169% 99.788% ( 15, 22 ] 13 0.020% 99.808% ( 22, 34 ] 7 0.011% 99.819% ( 34, 51 ] 1 0.002% 99.821% ( 51, 76 ] 2 0.003% 99.824% ( 76, 110 ] 29 0.044% 99.868% ( 110, 170 ] 54 0.083% 99.951% ( 170, 250 ] 19 0.029% 99.980% ( 250, 380 ] 7 0.011% 99.991% ( 380, 580 ] 2 0.003% 99.994% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 2 0.003% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 220160 Average: 3.3449 StdDev: 47.05 Min: 0 Median: 1.6678 Max: 8062 Percentiles: P50: 1.67 P75: 2.23 P99: 9.38 P99.9: 127.87 P99.99: 244.05 ------------------------------------------------------ [ 0, 1 ] 15354 6.974% 6.974% # ( 1, 2 ] 141855 64.433% 71.407% ############# ( 2, 3 ] 35043 15.917% 87.324% ### ( 3, 4 ] 12838 5.831% 93.155% # ( 4, 6 ] 9056 4.113% 97.268% # ( 6, 10 ] 4515 2.051% 99.319% ( 10, 15 ] 788 0.358% 99.677% ( 15, 22 ] 86 0.039% 99.716% ( 22, 34 ] 11 0.005% 99.721% ( 34, 51 ] 176 0.080% 99.801% ( 51, 76 ] 94 0.043% 99.844% ( 76, 110 ] 61 0.028% 99.871% ( 110, 170 ] 211 0.096% 99.967% ( 170, 250 ] 54 0.025% 99.992% ( 250, 380 ] 17 0.008% 100.000% ( 380, 580 ] 6 0.003% 100.002% ( 580, 870 ] 1 0.000% 100.003% ( 870, 1300 ] 5 0.002% 100.005% ( 1300, 1900 ] 16 0.007% 100.012% ( 1900, 2900 ] 9 0.004% 100.016% ( 2900, 4400 ] 6 0.003% 100.019% ( 4400, 6600 ] 4 0.002% 100.021% ( 6600, 9900 ] 3 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 55 Average: 1258.1091 StdDev: 1989.17 Min: 1 Median: 46.7500 Max: 7079 Percentiles: P50: 46.75 P75: 1810.00 P99: 7079.00 P99.9: 7079.00 P99.99: 7079.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 8 14.545% 29.091% ### ( 4, 6 ] 1 1.818% 30.909% ( 6, 10 ] 4 7.273% 38.182% # ( 10, 15 ] 2 3.636% 41.818% # ( 15, 22 ] 1 1.818% 43.636% ( 22, 34 ] 2 3.636% 47.273% # ( 34, 51 ] 2 3.636% 50.909% # ( 76, 110 ] 3 5.455% 56.364% # ( 170, 250 ] 2 3.636% 60.000% # ( 380, 580 ] 2 3.636% 63.636% # ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 5 9.091% 76.364% ## ( 1900, 2900 ] 4 7.273% 83.636% # ( 2900, 4400 ] 4 7.273% 90.909% # ( 4400, 6600 ] 2 3.636% 94.545% # ( 6600, 9900 ] 3 5.455% 100.000% # ** DB Stats ** Uptime(secs): 5.9 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 332.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.164 H:M:S, 2.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 338.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-14:24:33 ... thread 0: (1000000,3000000) ops and (336018.9,340074.8) ops/second in (2.976023,8.821589) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.39 GB 194.0 1.8 0.0 1.8 4.6 2.8 0.0 1.7 123.2 307.3 15.32 14.59 50 0.306 1916K 9945 0.0 0.0 L1 1/0 11.75 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 257.7 256.6 0.98 0.95 1 0.976 255K 1050 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.2 2.0 256.4 256.0 1.01 0.98 2 0.503 262K 390 0.0 0.0 L3 20/0 959.39 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.4 241.3 240.2 5.63 5.42 4 1.407 1379K 6520 0.0 0.0 L4 122/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 202.1 202.1 0.28 0.27 1 0.284 58K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 271/8 21.97 GB 0.0 3.7 0.8 2.9 6.5 3.6 1.0 2.3 164.2 285.4 23.21 22.21 58 0.400 3871K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.8 2.9 6.5 3.6 1.0 2.3 164.2 285.4 23.21 22.21 58 0.400 3871K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.8 2.9 3.7 0.8 0.0 0.0 249.2 248.0 15.30 14.88 15 1.020 3871K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 357.6 7.92 7.33 43 0.184 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.47 GB write, 744.00 MB/s write, 3.72 GB read, 428.11 MB/s read, 23.2 seconds Interval compaction: 6.47 GB write, 750.84 MB/s write, 3.72 GB read, 432.05 MB/s read, 23.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 652053 Average: 2.2421 StdDev: 5.75 Min: 0 Median: 1.5241 Max: 1321 Percentiles: P50: 1.52 P75: 1.91 P99: 5.96 P99.9: 13.19 P99.99: 19.23 ------------------------------------------------------ [ 0, 1 ] 103768 15.914% 15.914% ### ( 1, 2 ] 424103 65.041% 80.955% ############# ( 2, 3 ] 76955 11.802% 92.757% ## ( 3, 4 ] 25325 3.884% 96.641% # ( 4, 6 ] 15682 2.405% 99.046% ( 6, 10 ] 4666 0.716% 99.762% ( 10, 15 ] 1415 0.217% 99.979% ( 15, 22 ] 122 0.019% 99.997% ( 22, 34 ] 27 0.004% 100.002% ( 34, 51 ] 3 0.000% 100.002% ( 51, 76 ] 3 0.000% 100.002% ( 76, 110 ] 4 0.001% 100.003% ( 170, 250 ] 41 0.006% 100.009% ( 250, 380 ] 22 0.003% 100.013% ( 380, 580 ] 24 0.004% 100.016% ( 580, 870 ] 4 0.001% 100.017% ( 870, 1300 ] 8 0.001% 100.018% ( 1300, 1900 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 60606 Average: 2.8115 StdDev: 6.73 Min: 1 Median: 1.7821 Max: 692 Percentiles: P50: 1.78 P75: 2.55 P99: 8.82 P99.9: 20.96 P99.99: 249.31 ------------------------------------------------------ [ 0, 1 ] 1612 2.660% 2.660% # ( 1, 2 ] 36684 60.529% 63.188% ############ ( 2, 3 ] 13085 21.590% 84.779% #### ( 3, 4 ] 4535 7.483% 92.261% # ( 4, 6 ] 3503 5.780% 98.041% # ( 6, 10 ] 824 1.360% 99.401% ( 10, 15 ] 276 0.455% 99.856% ( 15, 22 ] 31 0.051% 99.908% ( 22, 34 ] 5 0.008% 99.916% ( 34, 51 ] 4 0.007% 99.922% ( 51, 76 ] 1 0.002% 99.924% ( 76, 110 ] 9 0.015% 99.939% ( 110, 170 ] 24 0.040% 99.979% ( 170, 250 ] 7 0.012% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 2 0.003% 99.995% ( 580, 870 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 74303 Average: 2.4164 StdDev: 14.76 Min: 1 Median: 1.4153 Max: 2966 Percentiles: P50: 1.42 P75: 1.81 P99: 7.71 P99.9: 146.07 P99.99: 374.41 ------------------------------------------------------ [ 0, 1 ] 17713 23.839% 23.839% ##### ( 1, 2 ] 46804 62.991% 86.830% ############# ( 2, 3 ] 5616 7.558% 94.388% ## ( 3, 4 ] 1853 2.494% 96.882% ( 4, 6 ] 1235 1.662% 98.544% ( 6, 10 ] 793 1.067% 99.611% ( 10, 15 ] 113 0.152% 99.763% ( 15, 22 ] 14 0.019% 99.782% ( 22, 34 ] 7 0.009% 99.791% ( 34, 51 ] 1 0.001% 99.793% ( 51, 76 ] 2 0.003% 99.795% ( 76, 110 ] 29 0.039% 99.834% ( 110, 170 ] 81 0.109% 99.943% ( 170, 250 ] 25 0.034% 99.977% ( 250, 380 ] 10 0.013% 99.991% ( 380, 580 ] 3 0.004% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 258233 Average: 3.2246 StdDev: 43.57 Min: 0 Median: 1.6481 Max: 8062 Percentiles: P50: 1.65 P75: 2.14 P99: 9.26 P99.9: 125.29 P99.99: 297.26 ------------------------------------------------------ [ 0, 1 ] 20160 7.807% 7.807% ## ( 1, 2 ] 168123 65.105% 72.912% ############# ( 2, 3 ] 39355 15.240% 88.152% ### ( 3, 4 ] 14014 5.427% 93.579% # ( 4, 6 ] 9744 3.773% 97.352% # ( 6, 10 ] 5218 2.021% 99.373% ( 10, 15 ] 813 0.315% 99.688% ( 15, 22 ] 88 0.034% 99.722% ( 22, 34 ] 12 0.005% 99.727% ( 34, 51 ] 220 0.085% 99.812% ( 51, 76 ] 112 0.043% 99.855% ( 76, 110 ] 62 0.024% 99.879% ( 110, 170 ] 211 0.082% 99.961% ( 170, 250 ] 61 0.024% 99.985% ( 250, 380 ] 39 0.015% 100.000% ( 380, 580 ] 6 0.002% 100.002% ( 580, 870 ] 1 0.000% 100.002% ( 870, 1300 ] 5 0.002% 100.004% ( 1300, 1900 ] 16 0.006% 100.010% ( 1900, 2900 ] 9 0.003% 100.014% ( 2900, 4400 ] 6 0.002% 100.016% ( 4400, 6600 ] 4 0.002% 100.018% ( 6600, 9900 ] 3 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 55 Average: 1258.1091 StdDev: 1989.17 Min: 1 Median: 46.7500 Max: 7079 Percentiles: P50: 46.75 P75: 1810.00 P99: 7079.00 P99.9: 7079.00 P99.99: 7079.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 8 14.545% 29.091% ### ( 4, 6 ] 1 1.818% 30.909% ( 6, 10 ] 4 7.273% 38.182% # ( 10, 15 ] 2 3.636% 41.818% # ( 15, 22 ] 1 1.818% 43.636% ( 22, 34 ] 2 3.636% 47.273% # ( 34, 51 ] 2 3.636% 50.909% # ( 76, 110 ] 3 5.455% 56.364% # ( 170, 250 ] 2 3.636% 60.000% # ( 380, 580 ] 2 3.636% 63.636% # ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 5 9.091% 76.364% ## ( 1900, 2900 ] 4 7.273% 83.636% # ( 2900, 4400 ] 4 7.273% 90.909% # ( 4400, 6600 ] 2 3.636% 94.545% # ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 516.2000 StdDev: 576.23 Min: 98 Median: 230.0000 Max: 2045 Percentiles: P50: 230.00 P75: 870.00 P99: 2045.00 P99.9: 2045.00 P99.99: 2045.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 5 25.000% 35.000% ##### ( 170, 250 ] 4 20.000% 55.000% #### ( 250, 380 ] 2 10.000% 65.000% ## ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 8.9 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 331.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.329 H:M:S, 3.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.165 H:M:S, 5.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-14:24:36 ... thread 0: (1000000,4000000) ops and (339280.2,339875.8) ops/second in (2.947416,11.769005) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 3.30 GB 0.0 2.8 0.0 2.8 6.5 3.7 0.0 1.8 133.3 306.4 21.71 20.74 68 0.319 2938K 14K 0.0 0.0 L1 1/1 11.75 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 257.7 256.6 0.98 0.95 1 0.976 255K 1050 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.2 2.0 256.4 256.0 1.01 0.98 2 0.503 262K 390 0.0 0.0 L3 20/0 959.39 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.4 241.3 240.2 5.63 5.42 4 1.407 1379K 6520 0.0 0.0 L4 122/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 202.1 202.1 0.28 0.27 1 0.284 58K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 273/19 22.89 GB 0.0 4.7 0.8 3.9 8.4 4.5 1.0 2.3 162.8 289.4 29.61 28.36 76 0.390 4893K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 0.8 3.9 8.4 4.5 1.0 2.3 162.8 289.4 29.61 28.36 76 0.390 4893K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 0.8 3.9 4.7 0.8 0.0 0.0 252.0 250.8 19.12 18.64 19 1.007 4893K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 360.0 10.48 9.72 57 0.184 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.9 total, 11.8 interval Flush(GB): cumulative 3.686, interval 3.686 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.37 GB write, 723.10 MB/s write, 4.71 GB read, 406.59 MB/s read, 29.6 seconds Interval compaction: 8.37 GB write, 728.08 MB/s write, 4.71 GB read, 409.39 MB/s read, 29.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 884199 Average: 2.2527 StdDev: 7.07 Min: 0 Median: 1.4910 Max: 1630 Percentiles: P50: 1.49 P75: 1.87 P99: 5.93 P99.9: 14.37 P99.99: 160.43 ------------------------------------------------------ [ 0, 1 ] 157899 17.858% 17.858% #### ( 1, 2 ] 578836 65.464% 83.322% ############# ( 2, 3 ] 91766 10.378% 93.701% ## ( 3, 4 ] 29862 3.377% 97.078% # ( 4, 6 ] 17628 1.994% 99.072% ( 6, 10 ] 5790 0.655% 99.727% ( 10, 15 ] 1755 0.198% 99.925% ( 15, 22 ] 167 0.019% 99.944% ( 22, 34 ] 34 0.004% 99.948% ( 34, 51 ] 4 0.000% 99.948% ( 51, 76 ] 4 0.000% 99.949% ( 76, 110 ] 101 0.011% 99.960% ( 110, 170 ] 316 0.036% 99.996% ( 170, 250 ] 79 0.009% 100.005% ( 250, 380 ] 45 0.005% 100.010% ( 380, 580 ] 32 0.004% 100.013% ( 580, 870 ] 8 0.001% 100.014% ( 870, 1300 ] 13 0.001% 100.016% ( 1300, 1900 ] 3 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 60607 Average: 2.8144 StdDev: 6.77 Min: 1 Median: 1.7821 Max: 692 Percentiles: P50: 1.78 P75: 2.55 P99: 8.82 P99.9: 21.19 P99.99: 249.39 ------------------------------------------------------ [ 0, 1 ] 1612 2.660% 2.660% # ( 1, 2 ] 36684 60.528% 63.187% ############ ( 2, 3 ] 13085 21.590% 84.777% #### ( 3, 4 ] 4535 7.483% 92.260% # ( 4, 6 ] 3503 5.780% 98.040% # ( 6, 10 ] 824 1.360% 99.399% ( 10, 15 ] 276 0.455% 99.855% ( 15, 22 ] 31 0.051% 99.906% ( 22, 34 ] 5 0.008% 99.914% ( 34, 51 ] 4 0.007% 99.921% ( 51, 76 ] 1 0.002% 99.922% ( 76, 110 ] 9 0.015% 99.937% ( 110, 170 ] 24 0.040% 99.977% ( 170, 250 ] 8 0.013% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 2 0.003% 99.995% ( 580, 870 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 74303 Average: 2.4164 StdDev: 14.76 Min: 1 Median: 1.4153 Max: 2966 Percentiles: P50: 1.42 P75: 1.81 P99: 7.71 P99.9: 146.07 P99.99: 374.41 ------------------------------------------------------ [ 0, 1 ] 17713 23.839% 23.839% ##### ( 1, 2 ] 46804 62.991% 86.830% ############# ( 2, 3 ] 5616 7.558% 94.388% ## ( 3, 4 ] 1853 2.494% 96.882% ( 4, 6 ] 1235 1.662% 98.544% ( 6, 10 ] 793 1.067% 99.611% ( 10, 15 ] 113 0.152% 99.763% ( 15, 22 ] 14 0.019% 99.782% ( 22, 34 ] 7 0.009% 99.791% ( 34, 51 ] 1 0.001% 99.793% ( 51, 76 ] 2 0.003% 99.795% ( 76, 110 ] 29 0.039% 99.834% ( 110, 170 ] 81 0.109% 99.943% ( 170, 250 ] 25 0.034% 99.977% ( 250, 380 ] 10 0.013% 99.991% ( 380, 580 ] 3 0.004% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 2 0.003% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 258233 Average: 3.2246 StdDev: 43.57 Min: 0 Median: 1.6481 Max: 8062 Percentiles: P50: 1.65 P75: 2.14 P99: 9.26 P99.9: 125.29 P99.99: 297.26 ------------------------------------------------------ [ 0, 1 ] 20160 7.807% 7.807% ## ( 1, 2 ] 168123 65.105% 72.912% ############# ( 2, 3 ] 39355 15.240% 88.152% ### ( 3, 4 ] 14014 5.427% 93.579% # ( 4, 6 ] 9744 3.773% 97.352% # ( 6, 10 ] 5218 2.021% 99.373% ( 10, 15 ] 813 0.315% 99.688% ( 15, 22 ] 88 0.034% 99.722% ( 22, 34 ] 12 0.005% 99.727% ( 34, 51 ] 220 0.085% 99.812% ( 51, 76 ] 112 0.043% 99.855% ( 76, 110 ] 62 0.024% 99.879% ( 110, 170 ] 211 0.082% 99.961% ( 170, 250 ] 61 0.024% 99.985% ( 250, 380 ] 39 0.015% 100.000% ( 380, 580 ] 6 0.002% 100.002% ( 580, 870 ] 1 0.000% 100.002% ( 870, 1300 ] 5 0.002% 100.004% ( 1300, 1900 ] 16 0.006% 100.010% ( 1900, 2900 ] 9 0.003% 100.014% ( 2900, 4400 ] 6 0.002% 100.016% ( 4400, 6600 ] 4 0.002% 100.018% ( 6600, 9900 ] 3 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 55 Average: 1258.1091 StdDev: 1989.17 Min: 1 Median: 46.7500 Max: 7079 Percentiles: P50: 46.75 P75: 1810.00 P99: 7079.00 P99.9: 7079.00 P99.99: 7079.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 8 14.545% 29.091% ### ( 4, 6 ] 1 1.818% 30.909% ( 6, 10 ] 4 7.273% 38.182% # ( 10, 15 ] 2 3.636% 41.818% # ( 15, 22 ] 1 1.818% 43.636% ( 22, 34 ] 2 3.636% 47.273% # ( 34, 51 ] 2 3.636% 50.909% # ( 76, 110 ] 3 5.455% 56.364% # ( 170, 250 ] 2 3.636% 60.000% # ( 380, 580 ] 2 3.636% 63.636% # ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 5 9.091% 76.364% ## ( 1900, 2900 ] 4 7.273% 83.636% # ( 2900, 4400 ] 4 7.273% 90.909% # ( 4400, 6600 ] 2 3.636% 94.545% # ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 516.2000 StdDev: 576.23 Min: 98 Median: 230.0000 Max: 2045 Percentiles: P50: 230.00 P75: 870.00 P99: 2045.00 P99.9: 2045.00 P99.99: 2045.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 5 25.000% 35.000% ##### ( 170, 250 ] 4 20.000% 55.000% #### ( 250, 380 ] 2 10.000% 65.000% ## ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 11.9 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 332.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.505 H:M:S, 4.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.176 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.050 micros/op 246887 ops/sec 20.001 seconds 4937999 operations; 239.2 MB/s Microseconds per write: Count: 4937999 Average: 4.0504 StdDev: 134.70 Min: 1 Median: 1.7528 Max: 176322 Percentiles: P50: 1.75 P75: 3.02 P99: 8.09 P99.9: 164.05 P99.99: 2468.20 ------------------------------------------------------ [ 0, 1 ] 674910 13.668% 13.668% ### ( 1, 2 ] 2383134 48.261% 61.929% ########## ( 2, 3 ] 632249 12.804% 74.733% ### ( 3, 4 ] 691629 14.006% 88.739% ### ( 4, 6 ] 477622 9.672% 98.411% ## ( 6, 10 ] 55693 1.128% 99.539% ( 10, 15 ] 9733 0.197% 99.736% ( 15, 22 ] 2919 0.059% 99.795% ( 22, 34 ] 850 0.017% 99.812% ( 34, 51 ] 143 0.003% 99.815% ( 51, 76 ] 35 0.001% 99.816% ( 76, 110 ] 2 0.000% 99.816% ( 110, 170 ] 4598 0.093% 99.909% ( 170, 250 ] 362 0.007% 99.917% ( 250, 380 ] 48 0.001% 99.918% ( 380, 580 ] 5 0.000% 99.918% ( 580, 870 ] 4 0.000% 99.918% ( 870, 1300 ] 2926 0.059% 99.977% ( 1900, 2900 ] 1132 0.023% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 179552 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4937999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5096014968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 155 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6001459 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9016000391 rocksdb.compact.write.bytes COUNT : 8840219675 rocksdb.flush.write.bytes COUNT : 5013249170 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 13 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 77 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4979961856 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8455168 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9057830735 rocksdb.non.last.level.read.count COUNT : 2187084 rocksdb.block.checksum.compute.count COUNT : 2186787 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.412484 P95 : 4.685422 P99 : 6.489572 P100 : 176319.000000 COUNT : 4937999 SUM : 17839689 rocksdb.compaction.times.micros P50 : 1005714.285714 P95 : 3460000.000000 P99 : 3645353.000000 P100 : 3645353.000000 COUNT : 24 SUM : 26152441 rocksdb.compaction.times.cpu_micros P50 : 996000.000000 P95 : 3460000.000000 P99 : 3504454.000000 P100 : 3504454.000000 COUNT : 24 SUM : 25380247 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 512.653061 P95 : 1167.000000 P99 : 1167.000000 P100 : 1167.000000 COUNT : 73 SUM : 40873 rocksdb.compaction.outfile.sync.micros P50 : 707.424242 P95 : 1278.500000 P99 : 2038.000000 P100 : 2038.000000 COUNT : 77 SUM : 56611 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 81.843750 P95 : 296.312500 P99 : 332.000000 P100 : 332.000000 COUNT : 103 SUM : 11189 rocksdb.table.open.io.micros P50 : 778.910256 P95 : 15111.111111 P99 : 17986.000000 P100 : 17986.000000 COUNT : 155 SUM : 342171 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.606182 P95 : 6.439766 P99 : 11.203479 P100 : 1909.000000 COUNT : 2186419 SUM : 10555916 rocksdb.read.block.get.micros P50 : 354.000000 P95 : 3816.666667 P99 : 8174.000000 P100 : 8174.000000 COUNT : 310 SUM : 246930 rocksdb.write.raw.block.micros P50 : 0.512407 P95 : 0.973573 P99 : 2.968327 P100 : 4716.000000 COUNT : 3356940 SUM : 6359846 rocksdb.numfiles.in.singlecompaction P50 : 3.352941 P95 : 11.250000 P99 : 14.250000 P100 : 15.000000 COUNT : 30 SUM : 123 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559065 P95 : 1182.484792 P99 : 2561.545936 P100 : 176090.000000 COUNT : 38713 SUM : 6004068 rocksdb.sst.read.micros P50 : 1.528075 P95 : 3.661056 P99 : 8.175315 P100 : 8062.000000 COUNT : 2187256 SUM : 6078238 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4937999 SUM : 5096014968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 189534.883721 P95 : 261375.000000 P99 : 352875.000000 P100 : 352875.000000 COUNT : 73 SUM : 13370538 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 96 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0