[2024-11-20 15:18:40.813999] Starting SPDK v25.01-pre git sha1 ede20dc4e / DPDK 24.03.0 initialization... [2024-11-20 15:18:40.814120] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3192158 ] Set seed to 1732112320811342 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 15:18:40.951660] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 15:18:41.057674] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 15:18:41.057729] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3192158' to capture a snapshot of events at runtime. [2024-11-20 15:18:41.057758] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 15:18:41.057772] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 15:18:41.057782] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3192158 for offline analysis/debug. [2024-11-20 15:18:41.059018] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 15:18:44 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-15:18:47 ... thread 0: (1000000,1000000) ops and (333383.3,333383.3) ops/second in (2.999550,2.999550) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 503.32 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 344.6 2.56 2.39 13 0.197 0 0 0.0 0.0 L1 1/0 11.75 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 252.7 251.6 1.00 0.98 1 0.995 255K 1019 0.0 0.0 L2 3/2 279.31 MB 1.3 0.3 0.1 0.1 0.3 0.1 0.2 2.1 255.2 254.7 1.01 0.99 2 0.507 262K 441 0.0 0.0 L3 18/18 1001.55 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 219.3 219.3 0.55 0.53 1 0.546 121K 0 0.0 0.0 L4 120/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 8.74 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 262/25 20.09 GB 0.0 0.6 0.5 0.1 1.5 1.3 0.4 1.7 123.2 295.3 5.11 4.88 17 0.301 639K 1460 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.5 0.1 1.5 1.3 0.4 1.7 123.2 295.3 5.11 4.88 17 0.301 639K 1460 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 0.0 0.0 246.5 246.0 2.55 2.49 4 0.638 639K 1460 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 344.6 2.56 2.39 13 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.47 GB write, 491.54 MB/s write, 0.61 GB read, 205.13 MB/s read, 5.1 seconds Interval compaction: 1.47 GB write, 502.66 MB/s write, 0.61 GB read, 209.77 MB/s read, 5.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 135284 Average: 2.0235 StdDev: 5.83 Min: 1 Median: 1.3813 Max: 1358 Percentiles: P50: 1.38 P75: 1.78 P99: 5.74 P99.9: 11.83 P99.99: 62.79 ------------------------------------------------------ [ 0, 1 ] 35487 26.231% 26.231% ##### ( 1, 2 ] 84322 62.330% 88.561% ############ ( 2, 3 ] 9128 6.747% 95.308% # ( 3, 4 ] 3207 2.371% 97.679% ( 4, 6 ] 2053 1.518% 99.197% ( 6, 10 ] 901 0.666% 99.863% ( 10, 15 ] 141 0.104% 99.967% ( 15, 22 ] 22 0.016% 99.983% ( 22, 34 ] 8 0.006% 99.989% ( 34, 51 ] 2 0.001% 99.990% ( 51, 76 ] 1 0.001% 99.991% ( 170, 250 ] 12 0.009% 100.000% ( 250, 380 ] 6 0.004% 100.004% ( 380, 580 ] 7 0.005% 100.010% ( 1300, 1900 ] 1 0.001% 100.010% ** Level 1 read latency histogram (micros): Count: 1168 Average: 4.8116 StdDev: 32.90 Min: 1 Median: 1.7985 Max: 677 Percentiles: P50: 1.80 P75: 2.67 P99: 11.10 P99.9: 677.00 P99.99: 677.00 ------------------------------------------------------ [ 0, 1 ] 41 3.510% 3.510% # ( 1, 2 ] 680 58.219% 61.729% ############ ( 2, 3 ] 232 19.863% 81.592% #### ( 3, 4 ] 86 7.363% 88.955% # ( 4, 6 ] 88 7.534% 96.490% ## ( 6, 10 ] 29 2.483% 98.973% ( 10, 15 ] 6 0.514% 99.486% ( 15, 22 ] 1 0.086% 99.572% ( 22, 34 ] 1 0.086% 99.658% ( 110, 170 ] 1 0.086% 99.743% ( 380, 580 ] 2 0.171% 99.914% ( 580, 870 ] 2 0.171% 100.086% ** Level 2 read latency histogram (micros): Count: 64116 Average: 2.2175 StdDev: 8.46 Min: 1 Median: 1.4035 Max: 1287 Percentiles: P50: 1.40 P75: 1.80 P99: 7.14 P99.9: 94.88 P99.99: 334.12 ------------------------------------------------------ [ 0, 1 ] 15762 24.584% 24.584% ##### ( 1, 2 ] 40390 62.995% 87.579% ############# ( 2, 3 ] 4675 7.291% 94.870% # ( 3, 4 ] 1452 2.265% 97.135% ( 4, 6 ] 1040 1.622% 98.757% ( 6, 10 ] 545 0.850% 99.607% ( 10, 15 ] 137 0.214% 99.821% ( 15, 22 ] 28 0.044% 99.864% ( 22, 34 ] 6 0.009% 99.874% ( 34, 51 ] 3 0.005% 99.878% ( 76, 110 ] 25 0.039% 99.917% ( 110, 170 ] 36 0.056% 99.973% ( 170, 250 ] 8 0.012% 99.986% ( 250, 380 ] 4 0.006% 99.992% ( 380, 580 ] 3 0.005% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 8281 Average: 19.2526 StdDev: 243.35 Min: 0 Median: 1.8696 Max: 6641 Percentiles: P50: 1.87 P75: 2.88 P99: 132.27 P99.9: 1989.88 P99.99: 2942.97 ------------------------------------------------------ [ 0, 1 ] 297 3.587% 3.587% # ( 1, 2 ] 4421 53.387% 56.974% ########### ( 2, 3 ] 1707 20.613% 77.587% #### ( 3, 4 ] 711 8.586% 86.173% ## ( 4, 6 ] 706 8.526% 94.699% ## ( 6, 10 ] 257 3.103% 97.802% # ( 10, 15 ] 64 0.773% 98.575% ( 15, 22 ] 12 0.145% 98.720% ( 22, 34 ] 6 0.072% 98.792% ( 110, 170 ] 49 0.592% 99.384% ( 170, 250 ] 14 0.169% 99.553% ( 250, 380 ] 5 0.060% 99.614% ( 380, 580 ] 8 0.097% 99.710% ( 580, 870 ] 3 0.036% 99.746% ( 870, 1300 ] 4 0.048% 99.795% ( 1300, 1900 ] 9 0.109% 99.903% ( 1900, 2900 ] 8 0.097% 100.000% ( 2900, 4400 ] 6 0.072% 100.072% ( 4400, 6600 ] 9 0.109% 100.181% ( 6600, 9900 ] 1 0.012% 100.193% ** Level 4 read latency histogram (micros): Count: 25 Average: 3000.8400 StdDev: 1708.86 Min: 1004 Median: 2511.1111 Max: 6572 Percentiles: P50: 2511.11 P75: 3931.25 P99: 6490.00 P99.9: 6572.00 P99.99: 6572.00 ------------------------------------------------------ ( 870, 1300 ] 6 24.000% 24.000% ##### ( 1300, 1900 ] 1 4.000% 28.000% # ( 1900, 2900 ] 9 36.000% 64.000% ####### ( 2900, 4400 ] 4 16.000% 80.000% ### ( 4400, 6600 ] 5 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 320.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.162 H:M:S, 5.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.162 H:M:S, 5.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-15:18:49 ... thread 0: (1000000,2000000) ops and (342909.1,338079.1) ops/second in (2.916225,5.915775) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.41 GB 119.0 1.0 0.0 1.0 2.8 1.8 0.0 1.6 113.0 305.2 9.46 9.01 32 0.296 1086K 5575 0.0 0.0 L1 1/0 11.75 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 252.7 251.6 1.00 0.98 1 0.995 255K 1019 0.0 0.0 L2 1/1 40.67 MB 0.0 0.3 0.1 0.1 0.3 0.1 0.2 2.1 255.2 254.7 1.01 0.99 2 0.507 262K 441 0.0 0.0 L3 19/10 1.15 GB 0.3 0.4 0.3 0.1 0.4 0.3 0.0 1.2 215.0 214.6 2.03 1.97 3 0.676 442K 799 0.0 0.0 L4 126/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 207.3 207.4 0.28 0.26 1 0.276 58K 0 0.0 0.0 L5 112/0 8.74 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 269/15 21.00 GB 0.0 2.0 0.8 1.2 3.8 2.5 0.4 2.1 150.5 282.3 13.77 13.20 39 0.353 2104K 7834 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.8 2.5 0.4 2.1 150.5 282.3 13.77 13.20 39 0.353 2104K 7834 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 2.0 0.8 0.0 0.0 242.6 241.7 8.54 8.34 11 0.777 2104K 7834 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.8 5.23 4.85 28 0.187 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.9 interval Flush(GB): cumulative 1.782, interval 1.782 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.80 GB write, 649.69 MB/s write, 2.02 GB read, 346.23 MB/s read, 13.8 seconds Interval compaction: 3.80 GB write, 657.15 MB/s write, 2.02 GB read, 350.21 MB/s read, 13.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 397414 Average: 2.3515 StdDev: 6.26 Min: 1 Median: 1.5828 Max: 1358 Percentiles: P50: 1.58 P75: 1.98 P99: 5.99 P99.9: 12.70 P99.99: 17.61 ------------------------------------------------------ [ 0, 1 ] 51198 12.883% 12.883% ### ( 1, 2 ] 253106 63.688% 76.571% ############# ( 2, 3 ] 56538 14.226% 90.798% ### ( 3, 4 ] 19707 4.959% 95.756% # ( 4, 6 ] 12956 3.260% 99.016% # ( 6, 10 ] 3118 0.785% 99.801% ( 10, 15 ] 731 0.184% 99.985% ( 15, 22 ] 57 0.014% 99.999% ( 22, 34 ] 12 0.003% 100.002% ( 34, 51 ] 2 0.001% 100.003% ( 51, 76 ] 4 0.001% 100.004% ( 76, 110 ] 1 0.000% 100.004% ( 170, 250 ] 27 0.007% 100.011% ( 250, 380 ] 10 0.003% 100.013% ( 380, 580 ] 19 0.005% 100.018% ( 580, 870 ] 1 0.000% 100.018% ( 870, 1300 ] 6 0.002% 100.020% ( 1300, 1900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 60610 Average: 2.8006 StdDev: 5.64 Min: 1 Median: 1.8242 Max: 677 Percentiles: P50: 1.82 P75: 2.62 P99: 8.67 P99.9: 14.72 P99.99: 235.85 ------------------------------------------------------ [ 0, 1 ] 1358 2.241% 2.241% ( 1, 2 ] 35120 57.944% 60.185% ############ ( 2, 3 ] 14450 23.841% 84.026% ##### ( 3, 4 ] 4462 7.362% 91.388% # ( 4, 6 ] 4018 6.629% 98.017% # ( 6, 10 ] 893 1.473% 99.490% ( 10, 15 ] 263 0.434% 99.924% ( 15, 22 ] 24 0.040% 99.964% ( 22, 34 ] 2 0.003% 99.967% ( 51, 76 ] 1 0.002% 99.969% ( 76, 110 ] 2 0.003% 99.972% ( 110, 170 ] 6 0.010% 99.982% ( 170, 250 ] 6 0.010% 99.992% ( 380, 580 ] 3 0.005% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 65336 Average: 2.3929 StdDev: 10.79 Min: 1 Median: 1.4133 Max: 1287 Percentiles: P50: 1.41 P75: 1.81 P99: 7.54 P99.9: 144.24 P99.99: 438.66 ------------------------------------------------------ [ 0, 1 ] 15773 24.141% 24.141% ##### ( 1, 2 ] 40879 62.567% 86.709% ############# ( 2, 3 ] 5146 7.876% 94.585% ## ( 3, 4 ] 1547 2.368% 96.953% ( 4, 6 ] 1121 1.716% 98.668% ( 6, 10 ] 563 0.862% 99.530% ( 10, 15 ] 138 0.211% 99.741% ( 15, 22 ] 28 0.043% 99.784% ( 22, 34 ] 6 0.009% 99.793% ( 34, 51 ] 3 0.005% 99.798% ( 76, 110 ] 25 0.038% 99.836% ( 110, 170 ] 73 0.112% 99.948% ( 170, 250 ] 14 0.021% 99.969% ( 250, 380 ] 12 0.018% 99.988% ( 380, 580 ] 5 0.008% 99.995% ( 870, 1300 ] 3 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 224322 Average: 3.3460 StdDev: 47.25 Min: 0 Median: 1.6767 Max: 6641 Percentiles: P50: 1.68 P75: 2.25 P99: 9.06 P99.9: 130.96 P99.99: 307.87 ------------------------------------------------------ [ 0, 1 ] 14163 6.314% 6.314% # ( 1, 2 ] 144822 64.560% 70.874% ############# ( 2, 3 ] 36613 16.322% 87.195% ### ( 3, 4 ] 13923 6.207% 93.402% # ( 4, 6 ] 9116 4.064% 97.466% # ( 6, 10 ] 4505 2.008% 99.474% ( 10, 15 ] 467 0.208% 99.682% ( 15, 22 ] 56 0.025% 99.707% ( 22, 34 ] 8 0.004% 99.711% ( 34, 51 ] 193 0.086% 99.797% ( 51, 76 ] 110 0.049% 99.846% ( 76, 110 ] 50 0.022% 99.868% ( 110, 170 ] 208 0.093% 99.961% ( 170, 250 ] 59 0.026% 99.987% ( 250, 380 ] 17 0.008% 99.995% ( 380, 580 ] 13 0.006% 100.000% ( 580, 870 ] 3 0.001% 100.002% ( 870, 1300 ] 4 0.002% 100.004% ( 1300, 1900 ] 9 0.004% 100.008% ( 1900, 2900 ] 8 0.004% 100.011% ( 2900, 4400 ] 6 0.003% 100.014% ( 4400, 6600 ] 9 0.004% 100.018% ( 6600, 9900 ] 1 0.000% 100.018% ** Level 4 read latency histogram (micros): Count: 55 Average: 1370.7091 StdDev: 1882.13 Min: 0 Median: 18.5000 Max: 6572 Percentiles: P50: 18.50 P75: 2372.22 P99: 6358.00 P99.9: 6572.00 P99.99: 6572.00 ------------------------------------------------------ [ 0, 1 ] 9 16.364% 16.364% ### ( 1, 2 ] 8 14.545% 30.909% ### ( 4, 6 ] 3 5.455% 36.364% # ( 6, 10 ] 4 7.273% 43.636% # ( 10, 15 ] 3 5.455% 49.091% # ( 15, 22 ] 1 1.818% 50.909% ( 22, 34 ] 1 1.818% 52.727% ( 170, 250 ] 1 1.818% 54.545% ( 870, 1300 ] 6 10.909% 65.455% ## ( 1300, 1900 ] 1 1.818% 67.273% ( 1900, 2900 ] 9 16.364% 83.636% ### ( 2900, 4400 ] 4 7.273% 90.909% # ( 4400, 6600 ] 5 9.091% 100.000% ## ** DB Stats ** Uptime(secs): 6.0 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 328.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.162 H:M:S, 2.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-15:18:52 ... thread 0: (1000000,3000000) ops and (332374.0,336155.8) ops/second in (3.008659,8.924434) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.39 GB 194.0 1.8 0.0 1.8 4.6 2.8 0.0 1.7 123.0 306.9 15.34 14.63 50 0.307 1916K 9918 0.0 0.0 L1 1/0 11.75 MB 1.2 0.2 0.2 0.0 0.2 0.2 0.1 1.0 252.7 251.6 1.00 0.98 1 0.995 255K 1019 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.2 2.1 255.2 254.7 1.01 0.99 2 0.507 262K 441 0.0 0.0 L3 20/0 959.63 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.4 237.8 236.6 5.71 5.51 4 1.428 1379K 6606 0.0 0.0 L4 126/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 207.3 207.4 0.28 0.26 1 0.276 58K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 279/8 21.97 GB 0.0 3.7 0.8 2.9 6.5 3.6 0.9 2.3 163.4 283.9 23.34 22.36 58 0.402 3872K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.8 2.9 6.5 3.6 0.9 2.3 163.4 283.9 23.34 22.36 58 0.402 3872K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.8 2.9 3.7 0.8 0.0 0.0 248.6 247.4 15.34 14.93 15 1.023 3872K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 353.9 8.00 7.42 43 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.47 GB write, 736.63 MB/s write, 3.72 GB read, 423.90 MB/s read, 23.3 seconds Interval compaction: 6.47 GB write, 742.23 MB/s write, 3.72 GB read, 427.13 MB/s read, 23.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 652431 Average: 2.2611 StdDev: 6.50 Min: 0 Median: 1.5378 Max: 1828 Percentiles: P50: 1.54 P75: 1.92 P99: 5.89 P99.9: 12.67 P99.99: 19.18 ------------------------------------------------------ [ 0, 1 ] 96794 14.836% 14.836% ### ( 1, 2 ] 426590 65.385% 80.221% ############# ( 2, 3 ] 81172 12.441% 92.662% ## ( 3, 4 ] 26344 4.038% 96.700% # ( 4, 6 ] 15842 2.428% 99.128% ( 6, 10 ] 4431 0.679% 99.807% ( 10, 15 ] 1138 0.174% 99.982% ( 15, 22 ] 95 0.015% 99.996% ( 22, 34 ] 19 0.003% 99.999% ( 34, 51 ] 8 0.001% 100.000% ( 51, 76 ] 4 0.001% 100.001% ( 76, 110 ] 1 0.000% 100.001% ( 170, 250 ] 41 0.006% 100.007% ( 250, 380 ] 19 0.003% 100.010% ( 380, 580 ] 25 0.004% 100.014% ( 580, 870 ] 3 0.000% 100.015% ( 870, 1300 ] 10 0.002% 100.016% ( 1300, 1900 ] 2 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 60610 Average: 2.8006 StdDev: 5.64 Min: 1 Median: 1.8242 Max: 677 Percentiles: P50: 1.82 P75: 2.62 P99: 8.67 P99.9: 14.72 P99.99: 235.85 ------------------------------------------------------ [ 0, 1 ] 1358 2.241% 2.241% ( 1, 2 ] 35120 57.944% 60.185% ############ ( 2, 3 ] 14450 23.841% 84.026% ##### ( 3, 4 ] 4462 7.362% 91.388% # ( 4, 6 ] 4018 6.629% 98.017% # ( 6, 10 ] 893 1.473% 99.490% ( 10, 15 ] 263 0.434% 99.924% ( 15, 22 ] 24 0.040% 99.964% ( 22, 34 ] 2 0.003% 99.967% ( 51, 76 ] 1 0.002% 99.969% ( 76, 110 ] 2 0.003% 99.972% ( 110, 170 ] 6 0.010% 99.982% ( 170, 250 ] 6 0.010% 99.992% ( 380, 580 ] 3 0.005% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 74431 Average: 2.4416 StdDev: 10.83 Min: 1 Median: 1.4370 Max: 1287 Percentiles: P50: 1.44 P75: 1.83 P99: 7.78 P99.9: 148.38 P99.99: 453.05 ------------------------------------------------------ [ 0, 1 ] 16558 22.246% 22.246% #### ( 1, 2 ] 47272 63.511% 85.757% ############# ( 2, 3 ] 6438 8.650% 94.407% ## ( 3, 4 ] 1793 2.409% 96.816% ( 4, 6 ] 1299 1.745% 98.561% ( 6, 10 ] 733 0.985% 99.546% ( 10, 15 ] 143 0.192% 99.738% ( 15, 22 ] 28 0.038% 99.776% ( 22, 34 ] 6 0.008% 99.784% ( 34, 51 ] 3 0.004% 99.788% ( 76, 110 ] 26 0.035% 99.823% ( 110, 170 ] 90 0.121% 99.944% ( 170, 250 ] 19 0.026% 99.969% ( 250, 380 ] 13 0.017% 99.987% ( 380, 580 ] 7 0.009% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 258245 Average: 3.2599 StdDev: 44.17 Min: 0 Median: 1.6671 Max: 6641 Percentiles: P50: 1.67 P75: 2.21 P99: 9.03 P99.9: 129.54 P99.99: 342.51 ------------------------------------------------------ [ 0, 1 ] 17317 6.706% 6.706% # ( 1, 2 ] 167608 64.903% 71.608% ############# ( 2, 3 ] 41836 16.200% 87.808% ### ( 3, 4 ] 15182 5.879% 93.687% # ( 4, 6 ] 9799 3.794% 97.482% # ( 6, 10 ] 5173 2.003% 99.485% ( 10, 15 ] 515 0.199% 99.684% ( 15, 22 ] 63 0.024% 99.709% ( 22, 34 ] 9 0.003% 99.712% ( 34, 51 ] 238 0.092% 99.804% ( 51, 76 ] 126 0.049% 99.853% ( 76, 110 ] 53 0.021% 99.874% ( 110, 170 ] 208 0.081% 99.954% ( 170, 250 ] 63 0.024% 99.979% ( 250, 380 ] 41 0.016% 99.995% ( 380, 580 ] 14 0.005% 100.000% ( 580, 870 ] 3 0.001% 100.001% ( 870, 1300 ] 4 0.002% 100.003% ( 1300, 1900 ] 9 0.003% 100.006% ( 1900, 2900 ] 8 0.003% 100.009% ( 2900, 4400 ] 6 0.002% 100.012% ( 4400, 6600 ] 9 0.003% 100.015% ( 6600, 9900 ] 1 0.000% 100.015% ** Level 4 read latency histogram (micros): Count: 55 Average: 1370.7091 StdDev: 1882.13 Min: 0 Median: 18.5000 Max: 6572 Percentiles: P50: 18.50 P75: 2372.22 P99: 6358.00 P99.9: 6572.00 P99.99: 6572.00 ------------------------------------------------------ [ 0, 1 ] 9 16.364% 16.364% ### ( 1, 2 ] 8 14.545% 30.909% ### ( 4, 6 ] 3 5.455% 36.364% # ( 6, 10 ] 4 7.273% 43.636% # ( 10, 15 ] 3 5.455% 49.091% # ( 15, 22 ] 1 1.818% 50.909% ( 22, 34 ] 1 1.818% 52.727% ( 170, 250 ] 1 1.818% 54.545% ( 870, 1300 ] 6 10.909% 65.455% ## ( 1300, 1900 ] 1 1.818% 67.273% ( 1900, 2900 ] 9 16.364% 83.636% ### ( 2900, 4400 ] 4 7.273% 90.909% # ( 4400, 6600 ] 5 9.091% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 455.1500 StdDev: 474.16 Min: 98 Median: 223.3333 Max: 2038 Percentiles: P50: 223.33 P75: 580.00 P99: 2038.00 P99.9: 2038.00 P99.99: 2038.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 6 30.000% 40.000% ###### ( 170, 250 ] 3 15.000% 55.000% ### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.320 H:M:S, 3.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.158 H:M:S, 5.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-15:18:55 ... thread 0: (1000000,4000000) ops and (336438.8,336226.5) ops/second in (2.972309,11.896743) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 3.36 GB 6.3 2.8 0.0 2.8 6.6 3.7 0.0 1.8 131.8 305.8 21.96 21.00 69 0.318 2938K 14K 0.0 0.0 L1 1/1 11.75 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 252.7 251.6 1.00 0.98 1 0.995 255K 1019 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.2 2.1 255.2 254.7 1.01 0.99 2 0.507 262K 441 0.0 0.0 L3 20/0 959.63 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.4 237.8 236.6 5.71 5.51 4 1.428 1379K 6606 0.0 0.0 L4 126/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 207.3 207.4 0.28 0.26 1 0.276 58K 0 0.0 0.0 L5 116/0 9.04 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 282/19 22.95 GB 0.0 4.7 0.8 3.9 8.4 4.5 0.9 2.2 160.9 288.2 29.96 28.73 77 0.389 4894K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 0.8 3.9 8.4 4.5 0.9 2.2 160.9 288.2 29.96 28.73 77 0.389 4894K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 0.8 3.9 4.7 0.8 0.0 0.0 251.1 249.9 19.20 18.72 19 1.010 4894K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 356.5 10.76 10.00 58 0.186 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.43 GB write, 721.46 MB/s write, 4.71 GB read, 402.73 MB/s read, 30.0 seconds Interval compaction: 8.43 GB write, 725.58 MB/s write, 4.71 GB read, 405.03 MB/s read, 30.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 886667 Average: 2.2656 StdDev: 7.52 Min: 0 Median: 1.5053 Max: 1918 Percentiles: P50: 1.51 P75: 1.88 P99: 5.86 P99.9: 13.98 P99.99: 158.33 ------------------------------------------------------ [ 0, 1 ] 148025 16.695% 16.695% ### ( 1, 2 ] 584460 65.917% 82.611% ############# ( 2, 3 ] 97521 10.999% 93.610% ## ( 3, 4 ] 31361 3.537% 97.147% # ( 4, 6 ] 17670 1.993% 99.139% ( 6, 10 ] 5635 0.636% 99.775% ( 10, 15 ] 1395 0.157% 99.932% ( 15, 22 ] 124 0.014% 99.946% ( 22, 34 ] 22 0.002% 99.949% ( 34, 51 ] 10 0.001% 99.950% ( 51, 76 ] 7 0.001% 99.951% ( 76, 110 ] 128 0.014% 99.965% ( 110, 170 ] 276 0.031% 99.996% ( 170, 250 ] 78 0.009% 100.005% ( 250, 380 ] 36 0.004% 100.009% ( 380, 580 ] 30 0.003% 100.013% ( 580, 870 ] 5 0.001% 100.013% ( 870, 1300 ] 18 0.002% 100.015% ( 1300, 1900 ] 2 0.000% 100.015% ( 1900, 2900 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 60611 Average: 2.8035 StdDev: 5.68 Min: 1 Median: 1.8242 Max: 677 Percentiles: P50: 1.82 P75: 2.62 P99: 8.67 P99.9: 14.74 P99.99: 237.87 ------------------------------------------------------ [ 0, 1 ] 1358 2.241% 2.241% ( 1, 2 ] 35120 57.943% 60.184% ############ ( 2, 3 ] 14450 23.841% 84.024% ##### ( 3, 4 ] 4462 7.362% 91.386% # ( 4, 6 ] 4018 6.629% 98.015% # ( 6, 10 ] 893 1.473% 99.489% ( 10, 15 ] 263 0.434% 99.922% ( 15, 22 ] 24 0.040% 99.962% ( 22, 34 ] 2 0.003% 99.965% ( 51, 76 ] 1 0.002% 99.967% ( 76, 110 ] 2 0.003% 99.970% ( 110, 170 ] 6 0.010% 99.980% ( 170, 250 ] 7 0.012% 99.992% ( 380, 580 ] 3 0.005% 99.997% ( 580, 870 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 74431 Average: 2.4416 StdDev: 10.83 Min: 1 Median: 1.4370 Max: 1287 Percentiles: P50: 1.44 P75: 1.83 P99: 7.78 P99.9: 148.38 P99.99: 453.05 ------------------------------------------------------ [ 0, 1 ] 16558 22.246% 22.246% #### ( 1, 2 ] 47272 63.511% 85.757% ############# ( 2, 3 ] 6438 8.650% 94.407% ## ( 3, 4 ] 1793 2.409% 96.816% ( 4, 6 ] 1299 1.745% 98.561% ( 6, 10 ] 733 0.985% 99.546% ( 10, 15 ] 143 0.192% 99.738% ( 15, 22 ] 28 0.038% 99.776% ( 22, 34 ] 6 0.008% 99.784% ( 34, 51 ] 3 0.004% 99.788% ( 76, 110 ] 26 0.035% 99.823% ( 110, 170 ] 90 0.121% 99.944% ( 170, 250 ] 19 0.026% 99.969% ( 250, 380 ] 13 0.017% 99.987% ( 380, 580 ] 7 0.009% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 258245 Average: 3.2599 StdDev: 44.17 Min: 0 Median: 1.6671 Max: 6641 Percentiles: P50: 1.67 P75: 2.21 P99: 9.03 P99.9: 129.54 P99.99: 342.51 ------------------------------------------------------ [ 0, 1 ] 17317 6.706% 6.706% # ( 1, 2 ] 167608 64.903% 71.608% ############# ( 2, 3 ] 41836 16.200% 87.808% ### ( 3, 4 ] 15182 5.879% 93.687% # ( 4, 6 ] 9799 3.794% 97.482% # ( 6, 10 ] 5173 2.003% 99.485% ( 10, 15 ] 515 0.199% 99.684% ( 15, 22 ] 63 0.024% 99.709% ( 22, 34 ] 9 0.003% 99.712% ( 34, 51 ] 238 0.092% 99.804% ( 51, 76 ] 126 0.049% 99.853% ( 76, 110 ] 53 0.021% 99.874% ( 110, 170 ] 208 0.081% 99.954% ( 170, 250 ] 63 0.024% 99.979% ( 250, 380 ] 41 0.016% 99.995% ( 380, 580 ] 14 0.005% 100.000% ( 580, 870 ] 3 0.001% 100.001% ( 870, 1300 ] 4 0.002% 100.003% ( 1300, 1900 ] 9 0.003% 100.006% ( 1900, 2900 ] 8 0.003% 100.009% ( 2900, 4400 ] 6 0.002% 100.012% ( 4400, 6600 ] 9 0.003% 100.015% ( 6600, 9900 ] 1 0.000% 100.015% ** Level 4 read latency histogram (micros): Count: 55 Average: 1370.7091 StdDev: 1882.13 Min: 0 Median: 18.5000 Max: 6572 Percentiles: P50: 18.50 P75: 2372.22 P99: 6358.00 P99.9: 6572.00 P99.99: 6572.00 ------------------------------------------------------ [ 0, 1 ] 9 16.364% 16.364% ### ( 1, 2 ] 8 14.545% 30.909% ### ( 4, 6 ] 3 5.455% 36.364% # ( 6, 10 ] 4 7.273% 43.636% # ( 10, 15 ] 3 5.455% 49.091% # ( 15, 22 ] 1 1.818% 50.909% ( 22, 34 ] 1 1.818% 52.727% ( 170, 250 ] 1 1.818% 54.545% ( 870, 1300 ] 6 10.909% 65.455% ## ( 1300, 1900 ] 1 1.818% 67.273% ( 1900, 2900 ] 9 16.364% 83.636% ### ( 2900, 4400 ] 4 7.273% 90.909% # ( 4400, 6600 ] 5 9.091% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 455.1500 StdDev: 474.16 Min: 98 Median: 223.3333 Max: 2038 Percentiles: P50: 223.33 P75: 580.00 P99: 2038.00 P99.9: 2038.00 P99.99: 2038.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 6 30.000% 40.000% ###### ( 170, 250 ] 3 15.000% 55.000% ### ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 3 15.000% 75.000% ### ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.492 H:M:S, 4.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.172 H:M:S, 5.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.071 micros/op 245629 ops/sec 20.002 seconds 4912999 operations; 238.0 MB/s Microseconds per write: Count: 4912999 Average: 4.0712 StdDev: 131.37 Min: 1 Median: 1.7700 Max: 172361 Percentiles: P50: 1.77 P75: 3.06 P99: 8.75 P99.9: 164.38 P99.99: 2396.58 ------------------------------------------------------ [ 0, 1 ] 646021 13.149% 13.149% ### ( 1, 2 ] 2351153 47.856% 61.005% ########## ( 2, 3 ] 647345 13.176% 74.181% ### ( 3, 4 ] 690835 14.061% 88.243% ### ( 4, 6 ] 484610 9.864% 98.106% ## ( 6, 10 ] 63953 1.302% 99.408% ( 10, 15 ] 14278 0.291% 99.699% ( 15, 22 ] 4376 0.089% 99.788% ( 22, 34 ] 1185 0.024% 99.812% ( 34, 51 ] 155 0.003% 99.815% ( 51, 76 ] 21 0.000% 99.815% ( 76, 110 ] 2 0.000% 99.815% ( 110, 170 ] 4581 0.093% 99.909% ( 170, 250 ] 324 0.007% 99.915% ( 250, 380 ] 73 0.001% 99.917% ( 380, 580 ] 8 0.000% 99.917% ( 580, 870 ] 5 0.000% 99.917% ( 870, 1300 ] 3102 0.063% 99.980% ( 1300, 1900 ] 1 0.000% 99.980% ( 1900, 2900 ] 966 0.020% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 178734 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4912999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5070214968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 154 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5839057 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9004181747 rocksdb.compact.write.bytes COUNT : 8829474650 rocksdb.flush.write.bytes COUNT : 4947219415 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 13 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 77 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4914289664 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8263680 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9043645829 rocksdb.non.last.level.read.count COUNT : 2183915 rocksdb.block.checksum.compute.count COUNT : 2183620 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.414510 P95 : 4.739002 P99 : 7.326485 P100 : 172359.000000 COUNT : 4912999 SUM : 17700154 rocksdb.compaction.times.micros P50 : 996000.000000 P95 : 3460000.000000 P99 : 3685868.000000 P100 : 3685868.000000 COUNT : 24 SUM : 26108047 rocksdb.compaction.times.cpu_micros P50 : 996000.000000 P95 : 3460000.000000 P99 : 3541914.000000 P100 : 3541914.000000 COUNT : 24 SUM : 25394400 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 545.853659 P95 : 1222.600000 P99 : 1258.000000 P100 : 1258.000000 COUNT : 72 SUM : 45634 rocksdb.compaction.outfile.sync.micros P50 : 680.694444 P95 : 1238.807692 P99 : 1914.000000 P100 : 1914.000000 COUNT : 77 SUM : 53023 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 82.375000 P95 : 248.000000 P99 : 379.350000 P100 : 468.000000 COUNT : 102 SUM : 10641 rocksdb.table.open.io.micros P50 : 793.472222 P95 : 13590.000000 P99 : 19277.000000 P100 : 19277.000000 COUNT : 154 SUM : 353323 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.598899 P95 : 6.005211 P99 : 9.990309 P100 : 6791.000000 COUNT : 2183236 SUM : 10251249 rocksdb.read.block.get.micros P50 : 362.372881 P95 : 3575.000000 P99 : 6142.400000 P100 : 6813.000000 COUNT : 308 SUM : 234987 rocksdb.write.raw.block.micros P50 : 0.511167 P95 : 0.971217 P99 : 2.945878 P100 : 3076.000000 COUNT : 3349006 SUM : 6216601 rocksdb.numfiles.in.singlecompaction P50 : 3.352941 P95 : 11.250000 P99 : 14.250000 P100 : 15.000000 COUNT : 30 SUM : 123 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560435 P95 : 1169.759749 P99 : 2508.726708 P100 : 172105.000000 COUNT : 38197 SUM : 5842993 rocksdb.sst.read.micros P50 : 1.538396 P95 : 3.590351 P99 : 7.652679 P100 : 6641.000000 COUNT : 2184065 SUM : 5872482 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4912999 SUM : 5070214968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 200769.230769 P95 : 263000.000000 P99 : 340733.000000 P100 : 340733.000000 COUNT : 72 SUM : 13224226 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 96 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0