[2024-07-15 17:11:02.010369] Starting SPDK v24.09-pre git sha1 33d82c0da / DPDK 24.03.0 initialization... [2024-07-15 17:11:02.010703] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2256106 ] Set seed to 1721056262002864 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 17:11:02.320650] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 17:11:02.630840] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 17:11:02.630899] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2256106' to capture a snapshot of events at runtime. [2024-07-15 17:11:02.630924] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 17:11:02.630953] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 17:11:02.630974] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2256106 for offline analysis/debug. [2024-07-15 17:11:02.631148] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 17:11:10 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-17:11:18 ... thread 0: (1000000,1000000) ops and (121794.2,121794.2) ops/second in (8.210573,8.210573) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 566.24 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 261.1 3.61 3.27 15 0.241 0 0 0.0 0.0 L1 3/3 250.35 MB 0.0 0.4 0.2 0.1 0.4 0.2 0.1 1.5 101.2 100.9 3.73 3.62 2 1.864 383K 1250 0.0 0.0 L2 2/1 125.62 MB 0.1 0.1 0.1 0.1 0.1 0.1 0.1 2.0 98.2 98.1 1.28 1.25 1 1.281 127K 212 0.0 0.0 L3 12/0 979.72 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 124/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 8.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 262/13 20.15 GB 0.0 0.5 0.3 0.2 1.4 1.2 0.3 1.5 58.3 167.6 8.62 8.13 18 0.479 510K 1462 0.0 0.0 Int 0/0 0.00 KB 0.0 0.5 0.3 0.2 1.4 1.2 0.3 1.5 58.3 167.6 8.62 8.13 18 0.479 510K 1462 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.5 0.3 0.2 0.5 0.3 0.0 0.0 100.4 100.1 5.01 4.87 3 1.669 510K 1462 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 261.1 3.61 3.27 15 0.241 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.3 total, 8.2 interval Flush(GB): cumulative 0.922, interval 0.922 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.41 GB write, 173.36 MB/s write, 0.49 GB read, 60.34 MB/s read, 8.6 seconds Interval compaction: 1.41 GB write, 175.95 MB/s write, 0.49 GB read, 61.25 MB/s read, 8.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 124932 Average: 4.6736 StdDev: 22.29 Min: 1 Median: 3.6366 Max: 3966 Percentiles: P50: 3.64 P75: 4.02 P99: 12.70 P99.9: 28.42 P99.99: 430.22 ------------------------------------------------------ [ 0, 1 ] 12 0.010% 0.010% ( 1, 2 ] 750 0.600% 0.610% ( 2, 3 ] 7535 6.031% 6.641% # ( 3, 4 ] 85089 68.108% 74.749% ############## ( 4, 6 ] 25572 20.469% 95.218% #### ( 6, 10 ] 4018 3.216% 98.434% # ( 10, 15 ] 1315 1.053% 99.487% ( 15, 22 ] 427 0.342% 99.829% ( 22, 34 ] 174 0.139% 99.968% ( 34, 51 ] 14 0.011% 99.979% ( 76, 110 ] 1 0.001% 99.980% ( 250, 380 ] 15 0.012% 99.992% ( 380, 580 ] 6 0.005% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 3 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ( 2900, 4400 ] 4 0.003% 100.004% ** Level 1 read latency histogram (micros): Count: 51462 Average: 4.6836 StdDev: 13.59 Min: 2 Median: 3.6817 Max: 1556 Percentiles: P50: 3.68 P75: 4.31 P99: 12.41 P99.9: 25.84 P99.99: 961.78 ------------------------------------------------------ ( 1, 2 ] 5 0.010% 0.010% ( 2, 3 ] 2216 4.306% 4.316% # ( 3, 4 ] 34488 67.016% 71.332% ############# ( 4, 6 ] 12150 23.610% 94.942% ##### ( 6, 10 ] 1807 3.511% 98.453% # ( 10, 15 ] 585 1.137% 99.590% ( 15, 22 ] 141 0.274% 99.864% ( 22, 34 ] 61 0.119% 99.983% ( 34, 51 ] 3 0.006% 99.988% ( 580, 870 ] 1 0.002% 99.990% ( 870, 1300 ] 4 0.008% 99.998% ( 1300, 1900 ] 2 0.004% 100.002% ** Level 2 read latency histogram (micros): Count: 15400 Average: 7.0715 StdDev: 72.98 Min: 2 Median: 4.4112 Max: 4276 Percentiles: P50: 4.41 P75: 5.45 P99: 17.67 P99.9: 71.00 P99.99: 4015.00 ------------------------------------------------------ ( 1, 2 ] 1 0.006% 0.006% ( 2, 3 ] 181 1.175% 1.182% ( 3, 4 ] 5999 38.955% 40.136% ######## ( 4, 6 ] 7393 48.006% 88.143% ########## ( 6, 10 ] 1102 7.156% 95.299% # ( 10, 15 ] 513 3.331% 98.630% # ( 15, 22 ] 152 0.987% 99.617% ( 22, 34 ] 41 0.266% 99.883% ( 34, 51 ] 2 0.013% 99.896% ( 51, 76 ] 2 0.013% 99.909% ( 76, 110 ] 1 0.006% 99.916% ( 110, 170 ] 1 0.006% 99.922% ( 170, 250 ] 2 0.013% 99.935% ( 380, 580 ] 1 0.006% 99.942% ( 580, 870 ] 1 0.006% 99.948% ( 870, 1300 ] 2 0.013% 99.961% ( 1900, 2900 ] 1 0.006% 99.968% ( 2900, 4400 ] 6 0.039% 100.006% ** Level 3 read latency histogram (micros): Count: 50 Average: 3881.5200 StdDev: 3714.87 Min: 68 Median: 2823.0769 Max: 14330 Percentiles: P50: 2823.08 P75: 4337.50 P99: 14330.00 P99.9: 14330.00 P99.99: 14330.00 ------------------------------------------------------ ( 51, 76 ] 1 2.000% 2.000% ( 76, 110 ] 2 4.000% 6.000% # ( 110, 170 ] 3 6.000% 12.000% # ( 250, 380 ] 2 4.000% 16.000% # ( 580, 870 ] 3 6.000% 22.000% # ( 1300, 1900 ] 2 4.000% 26.000% # ( 1900, 2900 ] 13 26.000% 52.000% ##### ( 2900, 4400 ] 12 24.000% 76.000% ##### ( 4400, 6600 ] 4 8.000% 84.000% ## ( 6600, 9900 ] 2 4.000% 88.000% # ( 9900, 14000 ] 5 10.000% 98.000% ## ( 14000, 22000 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 4953.4500 StdDev: 4026.76 Min: 114 Median: 3400.0000 Max: 14449 Percentiles: P50: 3400.00 P75: 7700.00 P99: 14449.00 P99.9: 14449.00 P99.99: 14449.00 ------------------------------------------------------ ( 110, 170 ] 2 10.000% 10.000% ## ( 870, 1300 ] 1 5.000% 15.000% # ( 1300, 1900 ] 1 5.000% 20.000% # ( 1900, 2900 ] 5 25.000% 45.000% ##### ( 2900, 4400 ] 3 15.000% 60.000% ### ( 4400, 6600 ] 2 10.000% 70.000% ## ( 6600, 9900 ] 3 15.000% 85.000% ### ( 9900, 14000 ] 2 10.000% 95.000% ## ( 14000, 22000 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.3 total, 8.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 118.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 119.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 0 2024/07/15-17:11:26 ... thread 0: (1000000,2000000) ops and (121558.7,121676.3) ops/second in (8.226481,16.437054) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 1.16 GB 25.0 0.7 0.0 0.7 2.6 1.8 0.0 1.4 62.2 217.5 12.13 11.27 33 0.368 766K 3654 0.0 0.0 L1 6/6 558.82 MB 0.0 0.9 0.6 0.4 0.9 0.5 0.1 1.7 97.8 97.1 9.63 9.35 3 3.210 956K 7337 0.0 0.0 L2 1/0 6.25 MB 0.1 0.1 0.1 0.1 0.1 0.1 0.1 2.0 98.2 98.1 1.28 1.25 1 1.281 127K 212 0.0 0.0 L3 15/0 728.42 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.2 1.0 90.2 90.2 1.32 1.24 1 1.324 121K 0 0.0 0.0 L4 126/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 160.9 160.9 0.35 0.31 1 0.346 56K 0 0.0 0.0 L5 120/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 278/15 21.06 GB 0.0 2.0 0.8 1.2 3.8 2.6 1.3 2.1 80.9 156.8 24.71 23.41 39 0.634 2029K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.8 2.6 1.3 2.1 80.9 156.8 24.71 23.41 39 0.634 2029K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 1.9 0.8 0.0 0.0 113.8 113.2 17.56 16.97 9 1.951 2029K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 263.8 7.15 6.45 30 0.238 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.6 total, 16.4 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 233.90 MB/s write, 1.95 GB read, 120.63 MB/s read, 24.7 seconds Interval compaction: 3.78 GB write, 235.65 MB/s write, 1.95 GB read, 121.53 MB/s read, 24.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 442461 Average: 4.3794 StdDev: 17.49 Min: 1 Median: 3.5350 Max: 3966 Percentiles: P50: 3.54 P75: 4.52 P99: 12.04 P99.9: 22.04 P99.99: 33.13 ------------------------------------------------------ [ 0, 1 ] 527 0.119% 0.119% ( 1, 2 ] 53635 12.122% 12.241% ## ( 2, 3 ] 73741 16.666% 28.907% ### ( 3, 4 ] 174439 39.425% 68.332% ######## ( 4, 6 ] 113909 25.744% 94.076% ##### ( 6, 10 ] 19905 4.499% 98.575% # ( 10, 15 ] 4609 1.042% 99.617% ( 15, 22 ] 1255 0.284% 99.900% ( 22, 34 ] 431 0.097% 99.998% ( 34, 51 ] 32 0.007% 100.005% ( 51, 76 ] 2 0.000% 100.005% ( 76, 110 ] 1 0.000% 100.006% ( 110, 170 ] 37 0.008% 100.014% ( 170, 250 ] 5 0.001% 100.015% ( 250, 380 ] 32 0.007% 100.022% ( 380, 580 ] 17 0.004% 100.026% ( 580, 870 ] 3 0.001% 100.027% ( 870, 1300 ] 7 0.002% 100.028% ( 1300, 1900 ] 3 0.001% 100.029% ( 1900, 2900 ] 3 0.001% 100.030% ( 2900, 4400 ] 8 0.002% 100.032% ** Level 1 read latency histogram (micros): Count: 140405 Average: 5.0380 StdDev: 12.73 Min: 2 Median: 3.8820 Max: 1556 Percentiles: P50: 3.88 P75: 5.04 P99: 14.08 P99.9: 31.31 P99.99: 858.25 ------------------------------------------------------ ( 1, 2 ] 13 0.009% 0.009% ( 2, 3 ] 3880 2.763% 2.773% # ( 3, 4 ] 75183 53.547% 56.320% ########### ( 4, 6 ] 50652 36.076% 92.396% ####### ( 6, 10 ] 7581 5.399% 97.795% # ( 10, 15 ] 2074 1.477% 99.272% ( 15, 22 ] 736 0.524% 99.796% ( 22, 34 ] 189 0.135% 99.931% ( 34, 51 ] 13 0.009% 99.940% ( 51, 76 ] 1 0.001% 99.941% ( 76, 110 ] 1 0.001% 99.942% ( 110, 170 ] 53 0.038% 99.979% ( 170, 250 ] 7 0.005% 99.984% ( 250, 380 ] 4 0.003% 99.987% ( 380, 580 ] 4 0.003% 99.990% ( 580, 870 ] 1 0.001% 99.991% ( 870, 1300 ] 11 0.008% 99.999% ( 1300, 1900 ] 3 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 30329 Average: 6.3581 StdDev: 52.04 Min: 2 Median: 4.6377 Max: 4276 Percentiles: P50: 4.64 P75: 5.59 P99: 16.19 P99.9: 33.61 P99.99: 3641.77 ------------------------------------------------------ ( 1, 2 ] 1 0.003% 0.003% ( 2, 3 ] 191 0.630% 0.633% ( 3, 4 ] 9894 32.622% 33.255% ####### ( 4, 6 ] 15927 52.514% 85.769% ########### ( 6, 10 ] 2988 9.852% 95.621% ## ( 10, 15 ] 983 3.241% 98.862% # ( 15, 22 ] 246 0.811% 99.674% ( 22, 34 ] 71 0.234% 99.908% ( 34, 51 ] 10 0.033% 99.941% ( 51, 76 ] 2 0.007% 99.947% ( 76, 110 ] 2 0.007% 99.954% ( 110, 170 ] 1 0.003% 99.957% ( 170, 250 ] 2 0.007% 99.964% ( 380, 580 ] 1 0.003% 99.967% ( 580, 870 ] 1 0.003% 99.970% ( 870, 1300 ] 2 0.007% 99.977% ( 1900, 2900 ] 1 0.003% 99.980% ( 2900, 4400 ] 6 0.020% 100.000% ** Level 3 read latency histogram (micros): Count: 14236 Average: 16.8999 StdDev: 318.08 Min: 1 Median: 2.3347 Max: 14330 Percentiles: P50: 2.33 P75: 2.90 P99: 9.97 P99.9: 4120.50 P99.99: 13652.65 ------------------------------------------------------ [ 0, 1 ] 32 0.225% 0.225% ( 1, 2 ] 4985 35.017% 35.242% ####### ( 2, 3 ] 6278 44.099% 79.341% ######### ( 3, 4 ] 1124 7.895% 87.237% ## ( 4, 6 ] 1173 8.240% 95.476% ## ( 6, 10 ] 505 3.547% 99.024% # ( 10, 15 ] 65 0.457% 99.480% ( 15, 22 ] 16 0.112% 99.593% ( 22, 34 ] 2 0.014% 99.607% ( 34, 51 ] 1 0.007% 99.614% ( 51, 76 ] 2 0.014% 99.628% ( 76, 110 ] 2 0.014% 99.642% ( 110, 170 ] 3 0.021% 99.663% ( 170, 250 ] 2 0.014% 99.677% ( 250, 380 ] 2 0.014% 99.691% ( 380, 580 ] 1 0.007% 99.698% ( 580, 870 ] 4 0.028% 99.726% ( 1300, 1900 ] 2 0.014% 99.740% ( 1900, 2900 ] 13 0.091% 99.831% ( 2900, 4400 ] 12 0.084% 99.916% ( 4400, 6600 ] 4 0.028% 99.944% ( 6600, 9900 ] 2 0.014% 99.958% ( 9900, 14000 ] 5 0.035% 99.993% ( 14000, 22000 ] 1 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 50 Average: 2000.8200 StdDev: 3507.67 Min: 1 Median: 18.5000 Max: 14449 Percentiles: P50: 18.50 P75: 2600.00 P99: 14449.00 P99.9: 14449.00 P99.99: 14449.00 ------------------------------------------------------ [ 0, 1 ] 5 10.000% 10.000% ## ( 1, 2 ] 10 20.000% 30.000% #### ( 2, 3 ] 2 4.000% 34.000% # ( 4, 6 ] 2 4.000% 38.000% # ( 6, 10 ] 3 6.000% 44.000% # ( 10, 15 ] 2 4.000% 48.000% # ( 15, 22 ] 2 4.000% 52.000% # ( 34, 51 ] 2 4.000% 56.000% # ( 110, 170 ] 2 4.000% 60.000% # ( 250, 380 ] 1 2.000% 62.000% ( 380, 580 ] 1 2.000% 64.000% ( 870, 1300 ] 1 2.000% 66.000% ( 1300, 1900 ] 1 2.000% 68.000% ( 1900, 2900 ] 5 10.000% 78.000% ## ( 2900, 4400 ] 3 6.000% 84.000% # ( 4400, 6600 ] 2 4.000% 88.000% # ( 6600, 9900 ] 3 6.000% 94.000% # ( 9900, 14000 ] 2 4.000% 98.000% # ( 14000, 22000 ] 1 2.000% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 763.6250 StdDev: 977.15 Min: 100 Median: 218.0000 Max: 3216 Percentiles: P50: 218.00 P75: 1013.33 P99: 3216.00 P99.9: 3216.00 P99.99: 3216.00 ------------------------------------------------------ ( 76, 110 ] 10 25.000% 25.000% ##### ( 110, 170 ] 7 17.500% 42.500% #### ( 170, 250 ] 5 12.500% 55.000% ### ( 250, 380 ] 2 5.000% 60.000% # ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 3 7.500% 72.500% ## ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 1 2.500% 82.500% # ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 16.6 total, 8.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 118.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 119.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 8.214 micros/op 121740 ops/sec 20.002 seconds 2434999 operations; 118.0 MB/s Microseconds per write: Count: 2434999 Average: 8.2141 StdDev: 25.43 Min: 3 Median: 5.7806 Max: 35244 Percentiles: P50: 5.78 P75: 9.90 P99: 21.37 P99.9: 252.40 P99.99: 377.63 ------------------------------------------------------ ( 2, 3 ] 316 0.013% 0.013% ( 3, 4 ] 57255 2.351% 2.364% ( 4, 6 ] 1302833 53.504% 55.869% ########### ( 6, 10 ] 478377 19.646% 75.515% #### ( 10, 15 ] 502036 20.618% 96.132% #### ( 15, 22 ] 76681 3.149% 99.281% # ( 22, 34 ] 12883 0.529% 99.810% ( 34, 51 ] 1868 0.077% 99.887% ( 51, 76 ] 194 0.008% 99.895% ( 76, 110 ] 76 0.003% 99.898% ( 110, 170 ] 3 0.000% 99.898% ( 250, 380 ] 2275 0.093% 99.992% ( 380, 580 ] 173 0.007% 99.999% ( 580, 870 ] 25 0.001% 100.000% ( 870, 1300 ] 1 0.000% 100.000% ( 1300, 1900 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 30409 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 2434999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 2512918968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 93 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 0 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 3390614175 rocksdb.compact.write.bytes COUNT : 3362066425 rocksdb.flush.write.bytes COUNT : 2440905423 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 16 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 27 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 2424448000 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3885056 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 3417369166 rocksdb.non.last.level.read.count COUNT : 822553 rocksdb.block.checksum.compute.count COUNT : 822384 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 4.693884 P95 : 13.506008 P99 : 19.379889 P100 : 878.000000 COUNT : 2434999 SUM : 16387372 rocksdb.compaction.times.micros P50 : 1650000.000000 P95 : 5290000.000000 P99 : 5903702.000000 P100 : 5903702.000000 COUNT : 11 SUM : 20061302 rocksdb.compaction.times.cpu_micros P50 : 1462500.000000 P95 : 5290000.000000 P99 : 5730950.000000 P100 : 5730950.000000 COUNT : 11 SUM : 19424429 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 556.190476 P95 : 1530.000000 P99 : 1615.000000 P100 : 1615.000000 COUNT : 37 SUM : 28465 rocksdb.compaction.outfile.sync.micros P50 : 797.500000 P95 : 1243.178571 P99 : 1248.000000 P100 : 1248.000000 COUNT : 37 SUM : 29595 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 145.744681 P95 : 354.000000 P99 : 436.000000 P100 : 436.000000 COUNT : 56 SUM : 9004 rocksdb.table.open.io.micros P50 : 2358.333333 P95 : 27125.000000 P99 : 27125.000000 P100 : 27125.000000 COUNT : 93 SUM : 496223 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 7.354395 P95 : 12.915507 P99 : 21.348107 P100 : 17877.000000 COUNT : 822178 SUM : 6833790 rocksdb.read.block.get.micros P50 : 725.000000 P95 : 9702.000000 P99 : 14560.000000 P100 : 14766.000000 COUNT : 186 SUM : 370653 rocksdb.write.raw.block.micros P50 : 0.787909 P95 : 2.354883 P99 : 8.465331 P100 : 3118.000000 COUNT : 1407079 SUM : 4211142 rocksdb.numfiles.in.singlecompaction P50 : 3.166667 P95 : 10.250000 P99 : 11.000000 P100 : 11.000000 COUNT : 19 SUM : 66 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.sst.read.micros P50 : 3.551205 P95 : 7.129448 P99 : 13.124889 P100 : 14449.000000 COUNT : 822696 SUM : 3994601 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 2434999 SUM : 2512918968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221034.482759 P95 : 364214.285714 P99 : 481370.000000 P100 : 481370.000000 COUNT : 37 SUM : 8755531 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 40 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0