[2024-11-19 00:08:19.303457] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-19 00:08:19.303726] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461519 ] Set seed to 1731971299296814 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 00:08:19.410343] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 00:08:19.448408] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 00:08:19.448455] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1461519' to capture a snapshot of events at runtime. [2024-11-19 00:08:19.448466] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 00:08:19.448476] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 00:08:19.448484] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1461519 for offline analysis/debug. [2024-11-19 00:08:19.448569] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 00:08:23 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-00:08:31 ... thread 0: (1000000,1000000) ops and (131527.1,131527.1) ops/second in (7.602996,7.602996) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.54 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 37.7 119.3 10.03 3.99 10 1.003 383K 533 0.0 0.0 L1 5/5 582.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 2/1 165.46 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 32/11 2.14 GB 1.4 1.8 1.1 0.8 1.8 1.0 0.0 1.7 96.4 95.5 19.64 8.93 12 1.636 594K 0 0.0 0.0 L4 186/13 12.12 GB 1.2 3.9 2.5 1.4 3.8 2.5 0.1 1.5 109.0 107.8 36.52 18.51 25 1.461 1497K 0 0.0 0.0 L5 1092/0 90.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/40 106.53 GB 0.0 6.1 3.6 2.5 6.8 4.3 0.1 8.6 94.5 105.9 66.18 31.43 47 1.408 2476K 533 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 3.6 2.5 6.8 4.3 0.1 8.6 94.5 105.9 66.18 31.43 47 1.408 2476K 533 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 3.6 2.5 6.0 3.5 0.0 0.0 105.7 104.6 59.16 29.01 38 1.557 2476K 533 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 116.7 7.02 2.42 9 0.780 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.8 total, 7.6 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.84 GB write, 903.26 MB/s write, 6.11 GB read, 806.12 MB/s read, 66.2 seconds Interval compaction: 6.84 GB write, 921.32 MB/s write, 6.11 GB read, 822.24 MB/s read, 66.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 269506 Average: 18.1551 StdDev: 204.50 Min: 1 Median: 1.8914 Max: 24540 Percentiles: P50: 1.89 P75: 2.88 P99: 229.61 P99.9: 3122.30 P99.99: 4926.63 ------------------------------------------------------ [ 0, 1 ] 9643 3.578% 3.578% # ( 1, 2 ] 140357 52.079% 55.657% ########## ( 2, 3 ] 59097 21.928% 77.585% #### ( 3, 4 ] 26048 9.665% 87.250% ## ( 4, 6 ] 24291 9.013% 96.264% ## ( 6, 10 ] 6116 2.269% 98.533% ( 10, 15 ] 1007 0.374% 98.907% ( 15, 22 ] 130 0.048% 98.955% ( 22, 34 ] 15 0.006% 98.960% ( 34, 51 ] 17 0.006% 98.967% ( 51, 76 ] 12 0.004% 98.971% ( 76, 110 ] 11 0.004% 98.975% ( 110, 170 ] 24 0.009% 98.984% ( 170, 250 ] 63 0.023% 99.007% ( 250, 380 ] 183 0.068% 99.075% ( 380, 580 ] 346 0.128% 99.204% ( 580, 870 ] 608 0.226% 99.429% ( 870, 1300 ] 608 0.226% 99.655% ( 1300, 1900 ] 368 0.137% 99.791% ( 1900, 2900 ] 259 0.096% 99.888% ( 2900, 4400 ] 253 0.094% 99.981% ( 4400, 6600 ] 113 0.042% 100.023% ( 6600, 9900 ] 12 0.004% 100.028% ( 9900, 14000 ] 1 0.000% 100.028% ( 14000, 22000 ] 1 0.000% 100.029% ( 22000, 33000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 21270 Average: 22.7624 StdDev: 252.90 Min: 1 Median: 2.0557 Max: 7718 Percentiles: P50: 2.06 P75: 3.09 P99: 176.00 P99.9: 4270.92 P99.99: 7718.00 ------------------------------------------------------ [ 0, 1 ] 305 1.434% 1.434% ( 1, 2 ] 10028 47.146% 48.580% ######### ( 2, 3 ] 5421 25.487% 74.067% ##### ( 3, 4 ] 2307 10.846% 84.913% ## ( 4, 6 ] 2303 10.827% 95.740% ## ( 6, 10 ] 563 2.647% 98.387% # ( 10, 15 ] 113 0.531% 98.919% ( 15, 22 ] 11 0.052% 98.970% ( 22, 34 ] 2 0.009% 98.980% ( 34, 51 ] 1 0.005% 98.984% ( 76, 110 ] 1 0.005% 98.989% ( 110, 170 ] 2 0.009% 98.999% ( 170, 250 ] 4 0.019% 99.017% ( 250, 380 ] 8 0.038% 99.055% ( 380, 580 ] 24 0.113% 99.168% ( 580, 870 ] 32 0.150% 99.318% ( 870, 1300 ] 38 0.179% 99.497% ( 1300, 1900 ] 25 0.118% 99.614% ( 1900, 2900 ] 26 0.122% 99.737% ( 2900, 4400 ] 38 0.179% 99.915% ( 4400, 6600 ] 14 0.066% 99.981% ( 6600, 9900 ] 4 0.019% 100.000% ** Level 2 read latency histogram (micros): Count: 181575 Average: 12.4191 StdDev: 168.78 Min: 1 Median: 1.9682 Max: 8039 Percentiles: P50: 1.97 P75: 2.97 P99: 12.02 P99.9: 2154.09 P99.99: 3913.89 ------------------------------------------------------ [ 0, 1 ] 5262 2.898% 2.898% # ( 1, 2 ] 88333 48.648% 51.546% ########## ( 2, 3 ] 43878 24.165% 75.711% ##### ( 3, 4 ] 18377 10.121% 85.832% ## ( 4, 6 ] 18217 10.033% 95.865% ## ( 6, 10 ] 5276 2.906% 98.771% # ( 10, 15 ] 1028 0.566% 99.337% ( 15, 22 ] 147 0.081% 99.418% ( 22, 34 ] 51 0.028% 99.446% ( 34, 51 ] 23 0.013% 99.459% ( 51, 76 ] 11 0.006% 99.465% ( 76, 110 ] 13 0.007% 99.472% ( 110, 170 ] 27 0.015% 99.487% ( 170, 250 ] 35 0.019% 99.506% ( 250, 380 ] 76 0.042% 99.548% ( 380, 580 ] 145 0.080% 99.628% ( 580, 870 ] 176 0.097% 99.725% ( 870, 1300 ] 159 0.088% 99.812% ( 1300, 1900 ] 133 0.073% 99.885% ( 1900, 2900 ] 104 0.057% 99.943% ( 2900, 4400 ] 127 0.070% 100.013% ( 4400, 6600 ] 64 0.035% 100.048% ( 6600, 9900 ] 9 0.005% 100.053% ** Level 3 read latency histogram (micros): Count: 819681 Average: 14.3423 StdDev: 185.81 Min: 1 Median: 1.9511 Max: 14932 Percentiles: P50: 1.95 P75: 2.93 P99: 9.95 P99.9: 1511.19 P99.99: 2309.88 ------------------------------------------------------ [ 0, 1 ] 15891 1.939% 1.939% ( 1, 2 ] 414208 50.533% 52.472% ########## ( 2, 3 ] 198962 24.273% 76.745% ##### ( 3, 4 ] 83566 10.195% 86.940% ## ( 4, 6 ] 79716 9.725% 96.665% ## ( 6, 10 ] 19362 2.362% 99.027% ( 10, 15 ] 3622 0.442% 99.469% ( 15, 22 ] 486 0.059% 99.528% ( 22, 34 ] 71 0.009% 99.537% ( 34, 51 ] 28 0.003% 99.540% ( 51, 76 ] 30 0.004% 99.544% ( 76, 110 ] 19 0.002% 99.546% ( 110, 170 ] 42 0.005% 99.551% ( 170, 250 ] 86 0.010% 99.562% ( 250, 380 ] 211 0.026% 99.588% ( 380, 580 ] 487 0.059% 99.647% ( 580, 870 ] 830 0.101% 99.748% ( 870, 1300 ] 994 0.121% 99.869% ( 1300, 1900 ] 714 0.087% 99.957% ( 1900, 2900 ] 671 0.082% 100.038% ( 2900, 4400 ] 791 0.097% 100.135% ( 4400, 6600 ] 292 0.036% 100.171% ( 6600, 9900 ] 52 0.006% 100.177% ( 9900, 14000 ] 3 0.000% 100.177% ( 14000, 22000 ] 1 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 452708 Average: 19.6309 StdDev: 209.20 Min: 1 Median: 1.9509 Max: 15623 Percentiles: P50: 1.95 P75: 2.94 P99: 169.92 P99.9: 2118.53 P99.99: 2897.57 ------------------------------------------------------ [ 0, 1 ] 9133 2.017% 2.017% ( 1, 2 ] 228435 50.460% 52.477% ########## ( 2, 3 ] 108201 23.901% 76.378% ##### ( 3, 4 ] 46837 10.346% 86.724% ## ( 4, 6 ] 42577 9.405% 96.129% ## ( 6, 10 ] 10923 2.413% 98.542% ( 10, 15 ] 1677 0.370% 98.912% ( 15, 22 ] 247 0.055% 98.967% ( 22, 34 ] 27 0.006% 98.973% ( 34, 51 ] 18 0.004% 98.977% ( 51, 76 ] 34 0.008% 98.984% ( 76, 110 ] 13 0.003% 98.987% ( 110, 170 ] 59 0.013% 99.000% ( 170, 250 ] 153 0.034% 99.034% ( 250, 380 ] 290 0.064% 99.098% ( 380, 580 ] 626 0.138% 99.236% ( 580, 870 ] 1026 0.227% 99.463% ( 870, 1300 ] 1120 0.247% 99.710% ( 1300, 1900 ] 745 0.165% 99.875% ( 1900, 2900 ] 523 0.116% 99.990% ( 2900, 4400 ] 482 0.106% 100.097% ( 4400, 6600 ] 161 0.036% 100.132% ( 6600, 9900 ] 29 0.006% 100.139% ( 9900, 14000 ] 4 0.001% 100.140% ( 14000, 22000 ] 3 0.001% 100.140% ** Level 5 read latency histogram (micros): Count: 12298 Average: 1754.5533 StdDev: 1548.24 Min: 80 Median: 1162.1549 Max: 14822 Percentiles: P50: 1162.15 P75: 2499.48 P99: 7331.32 P99.9: 9782.66 P99.99: 13842.97 ------------------------------------------------------ ( 76, 110 ] 7 0.057% 0.057% ( 110, 170 ] 65 0.529% 0.585% ( 170, 250 ] 211 1.716% 2.301% ( 250, 380 ] 622 5.058% 7.359% # ( 380, 580 ] 1419 11.538% 18.897% ## ( 580, 870 ] 2299 18.694% 37.591% #### ( 870, 1300 ] 2246 18.263% 55.855% #### ( 1300, 1900 ] 1544 12.555% 68.409% ### ( 1900, 2900 ] 1352 10.994% 79.403% ## ( 2900, 4400 ] 1630 13.254% 92.657% ### ( 4400, 6600 ] 747 6.074% 98.732% # ( 6600, 9900 ] 149 1.212% 99.943% ( 9900, 14000 ] 6 0.049% 99.992% ( 14000, 22000 ] 1 0.008% 100.000% ** DB Stats ** Uptime(secs): 7.8 total, 7.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 126.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.592 H:M:S, 46.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.592 H:M:S, 47.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/19-00:08:36 ... thread 0: (1000000,2000000) ops and (205678.9,160450.0) ops/second in (4.861948,12.464944) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.58 GB 138.4 1.4 0.0 1.4 3.2 1.8 0.0 1.7 70.0 165.4 19.80 10.96 28 0.707 1407K 1815 0.0 0.0 L1 5/5 582.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 82.54 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 961.94 MB 1.0 2.0 1.1 0.9 2.0 1.1 0.0 1.7 97.7 96.7 21.17 9.74 13 1.628 678K 0 0.0 0.0 L4 161/0 9.72 GB 1.0 6.4 3.7 2.7 6.3 3.6 0.1 1.7 114.4 112.8 57.52 30.45 38 1.514 2480K 39 0.0 0.0 L5 1136/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1337/19 107.52 GB 0.0 9.8 4.9 4.9 11.5 6.6 3.8 6.2 101.9 119.9 98.48 51.15 79 1.247 4566K 1854 0.0 0.0 Int 0/0 0.00 KB 0.0 9.8 4.9 4.9 11.5 6.6 3.8 6.2 101.9 119.9 98.48 51.15 79 1.247 4566K 1854 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.8 4.9 4.9 9.7 4.8 0.0 0.0 115.7 114.3 86.77 45.70 55 1.578 4566K 1854 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 161.3 11.71 5.45 24 0.488 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.5 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.53 GB write, 935.81 MB/s write, 9.80 GB read, 795.38 MB/s read, 98.5 seconds Interval compaction: 11.53 GB write, 947.22 MB/s write, 9.80 GB read, 805.08 MB/s read, 98.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 54, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 614350 Average: 14.8693 StdDev: 154.90 Min: 0 Median: 1.7290 Max: 24540 Percentiles: P50: 1.73 P75: 2.57 P99: 251.64 P99.9: 1893.38 P99.99: 3884.10 ------------------------------------------------------ [ 0, 1 ] 59021 9.607% 9.607% ## ( 1, 2 ] 340419 55.411% 65.018% ########### ( 2, 3 ] 107654 17.523% 82.542% #### ( 3, 4 ] 44177 7.191% 89.732% # ( 4, 6 ] 38811 6.317% 96.050% # ( 6, 10 ] 9285 1.511% 97.561% ( 10, 15 ] 1519 0.247% 97.808% ( 15, 22 ] 184 0.030% 97.838% ( 22, 34 ] 20 0.003% 97.842% ( 34, 51 ] 21 0.003% 97.845% ( 51, 76 ] 25 0.004% 97.849% ( 76, 110 ] 1186 0.193% 98.042% ( 110, 170 ] 3650 0.594% 98.636% ( 170, 250 ] 2218 0.361% 98.997% ( 250, 380 ] 1470 0.239% 99.237% ( 380, 580 ] 1451 0.236% 99.473% ( 580, 870 ] 1256 0.204% 99.677% ( 870, 1300 ] 891 0.145% 99.822% ( 1300, 1900 ] 485 0.079% 99.901% ( 1900, 2900 ] 335 0.055% 99.956% ( 2900, 4400 ] 324 0.053% 100.008% ( 4400, 6600 ] 135 0.022% 100.030% ( 6600, 9900 ] 15 0.002% 100.033% ( 9900, 14000 ] 1 0.000% 100.033% ( 14000, 22000 ] 1 0.000% 100.033% ( 22000, 33000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 107485 Average: 11.2363 StdDev: 149.34 Min: 1 Median: 2.4310 Max: 7718 Percentiles: P50: 2.43 P75: 3.58 P99: 15.23 P99.9: 2619.06 P99.99: 6198.20 ------------------------------------------------------ [ 0, 1 ] 1314 1.222% 1.222% ( 1, 2 ] 38435 35.758% 36.981% ####### ( 2, 3 ] 32468 30.207% 67.188% ###### ( 3, 4 ] 14551 13.538% 80.726% ### ( 4, 6 ] 14802 13.771% 94.497% ### ( 6, 10 ] 4026 3.746% 98.243% # ( 10, 15 ] 806 0.750% 98.992% ( 15, 22 ] 243 0.226% 99.218% ( 22, 34 ] 28 0.026% 99.245% ( 34, 51 ] 4 0.004% 99.248% ( 51, 76 ] 4 0.004% 99.252% ( 76, 110 ] 35 0.033% 99.285% ( 110, 170 ] 173 0.161% 99.446% ( 170, 250 ] 115 0.107% 99.552% ( 250, 380 ] 55 0.051% 99.604% ( 380, 580 ] 64 0.060% 99.663% ( 580, 870 ] 79 0.073% 99.737% ( 870, 1300 ] 85 0.079% 99.816% ( 1300, 1900 ] 56 0.052% 99.868% ( 1900, 2900 ] 48 0.045% 99.913% ( 2900, 4400 ] 62 0.058% 99.970% ( 4400, 6600 ] 26 0.024% 99.994% ( 6600, 9900 ] 6 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 192410 Average: 12.0719 StdDev: 165.26 Min: 1 Median: 1.9702 Max: 8039 Percentiles: P50: 1.97 P75: 2.98 P99: 11.94 P99.9: 2094.25 P99.99: 3928.43 ------------------------------------------------------ [ 0, 1 ] 5450 2.832% 2.832% # ( 1, 2 ] 93543 48.616% 51.449% ########## ( 2, 3 ] 46449 24.141% 75.590% ##### ( 3, 4 ] 19588 10.180% 85.770% ## ( 4, 6 ] 19458 10.113% 95.883% ## ( 6, 10 ] 5579 2.900% 98.782% # ( 10, 15 ] 1078 0.560% 99.343% ( 15, 22 ] 151 0.078% 99.421% ( 22, 34 ] 52 0.027% 99.448% ( 34, 51 ] 23 0.012% 99.460% ( 51, 76 ] 13 0.007% 99.467% ( 76, 110 ] 19 0.010% 99.477% ( 110, 170 ] 44 0.023% 99.500% ( 170, 250 ] 45 0.023% 99.523% ( 250, 380 ] 78 0.041% 99.563% ( 380, 580 ] 152 0.079% 99.642% ( 580, 870 ] 178 0.093% 99.735% ( 870, 1300 ] 161 0.084% 99.819% ( 1300, 1900 ] 136 0.071% 99.889% ( 1900, 2900 ] 106 0.055% 99.944% ( 2900, 4400 ] 128 0.067% 100.011% ( 4400, 6600 ] 66 0.034% 100.045% ( 6600, 9900 ] 9 0.005% 100.050% ** Level 3 read latency histogram (micros): Count: 1057440 Average: 13.1589 StdDev: 174.29 Min: 1 Median: 1.9532 Max: 14932 Percentiles: P50: 1.95 P75: 2.93 P99: 9.92 P99.9: 1314.51 P99.99: 2116.34 ------------------------------------------------------ [ 0, 1 ] 20296 1.919% 1.919% ( 1, 2 ] 533407 50.443% 52.363% ########## ( 2, 3 ] 256356 24.243% 76.606% ##### ( 3, 4 ] 108353 10.247% 86.852% ## ( 4, 6 ] 103753 9.812% 96.664% ## ( 6, 10 ] 25207 2.384% 99.048% ( 10, 15 ] 4519 0.427% 99.475% ( 15, 22 ] 588 0.056% 99.531% ( 22, 34 ] 76 0.007% 99.538% ( 34, 51 ] 40 0.004% 99.542% ( 51, 76 ] 50 0.005% 99.547% ( 76, 110 ] 84 0.008% 99.554% ( 110, 170 ] 284 0.027% 99.581% ( 170, 250 ] 205 0.019% 99.601% ( 250, 380 ] 308 0.029% 99.630% ( 380, 580 ] 664 0.063% 99.693% ( 580, 870 ] 1026 0.097% 99.790% ( 870, 1300 ] 1147 0.108% 99.898% ( 1300, 1900 ] 809 0.077% 99.975% ( 1900, 2900 ] 750 0.071% 100.046% ( 2900, 4400 ] 908 0.086% 100.131% ( 4400, 6600 ] 328 0.031% 100.162% ( 6600, 9900 ] 58 0.005% 100.168% ( 9900, 14000 ] 3 0.000% 100.168% ( 14000, 22000 ] 1 0.000% 100.168% ** Level 4 read latency histogram (micros): Count: 688175 Average: 19.2682 StdDev: 198.16 Min: 1 Median: 1.9557 Max: 15623 Percentiles: P50: 1.96 P75: 2.96 P99: 262.61 P99.9: 1972.79 P99.99: 2842.67 ------------------------------------------------------ [ 0, 1 ] 13822 2.009% 2.009% ( 1, 2 ] 345566 50.215% 52.223% ########## ( 2, 3 ] 164083 23.843% 76.067% ##### ( 3, 4 ] 69671 10.124% 86.191% ## ( 4, 6 ] 64668 9.397% 95.588% ## ( 6, 10 ] 16561 2.407% 97.994% ( 10, 15 ] 2512 0.365% 98.359% ( 15, 22 ] 350 0.051% 98.410% ( 22, 34 ] 38 0.006% 98.416% ( 34, 51 ] 27 0.004% 98.419% ( 51, 76 ] 53 0.008% 98.427% ( 76, 110 ] 628 0.091% 98.518% ( 110, 170 ] 2043 0.297% 98.815% ( 170, 250 ] 1186 0.172% 98.988% ( 250, 380 ] 879 0.128% 99.115% ( 380, 580 ] 1294 0.188% 99.303% ( 580, 870 ] 1571 0.228% 99.532% ( 870, 1300 ] 1524 0.221% 99.753% ( 1300, 1900 ] 959 0.139% 99.892% ( 1900, 2900 ] 712 0.103% 99.996% ( 2900, 4400 ] 684 0.099% 100.095% ( 4400, 6600 ] 212 0.031% 100.126% ( 6600, 9900 ] 40 0.006% 100.132% ( 9900, 14000 ] 4 0.001% 100.133% ( 14000, 22000 ] 3 0.000% 100.133% ** Level 5 read latency histogram (micros): Count: 50358 Average: 690.8583 StdDev: 1078.80 Min: 75 Median: 244.5684 Max: 14822 Percentiles: P50: 244.57 P75: 723.73 P99: 5726.84 P99.9: 9001.95 P99.99: 10558.87 ------------------------------------------------------ ( 51, 76 ] 4 0.008% 0.008% ( 76, 110 ] 4183 8.307% 8.314% ## ( 110, 170 ] 14059 27.918% 36.233% ###### ( 170, 250 ] 7438 14.770% 51.003% ### ( 250, 380 ] 4677 9.288% 60.290% ## ( 380, 580 ] 5149 10.225% 70.515% ## ( 580, 870 ] 4557 9.049% 79.564% ## ( 870, 1300 ] 3522 6.994% 86.558% # ( 1300, 1900 ] 2116 4.202% 90.760% # ( 1900, 2900 ] 1670 3.316% 94.076% # ( 2900, 4400 ] 1971 3.914% 97.990% # ( 4400, 6600 ] 843 1.674% 99.664% ( 6600, 9900 ] 163 0.324% 99.988% ( 9900, 14000 ] 6 0.012% 100.000% ( 14000, 22000 ] 1 0.002% 100.002% ** DB Stats ** Uptime(secs): 12.6 total, 4.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 155.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.835 H:M:S, 38.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 202.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.243 H:M:S, 25.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-00:08:39 ... thread 0: (1000000,3000000) ops and (288660.8,188333.2) ops/second in (3.464274,15.929218) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.83 GB 239.1 2.3 0.0 2.3 5.2 2.8 0.0 1.8 89.2 197.0 26.85 17.54 48 0.559 2430K 2780 0.0 0.0 L1 16/0 1.30 GB 133.4 1.3 0.7 0.6 1.3 0.7 0.0 1.8 93.0 92.6 14.41 7.12 1 14.406 1361K 6602 0.0 0.0 L2 1/0 82.54 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 961.94 MB 1.0 2.0 1.1 0.9 2.0 1.1 0.0 1.7 97.7 96.7 21.17 9.74 13 1.628 678K 0 0.0 0.0 L4 161/0 9.72 GB 1.0 6.4 3.7 2.7 6.3 3.6 0.1 1.7 114.4 112.8 57.52 30.45 38 1.514 2480K 39 0.0 0.0 L5 1136/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1346/8 108.50 GB 0.0 12.1 5.6 6.5 14.8 8.3 3.8 5.2 103.3 126.4 119.94 64.85 100 1.199 6951K 9421 0.0 0.0 Int 0/0 0.00 KB 0.0 12.1 5.6 6.5 14.8 8.3 3.8 5.2 103.3 126.4 119.94 64.85 100 1.199 6951K 9421 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.1 5.6 6.5 12.0 5.5 0.0 0.0 117.8 116.7 105.09 56.66 60 1.752 6951K 9421 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 195.1 14.85 8.18 40 0.371 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.1 total, 15.9 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.80 GB write, 942.44 MB/s write, 12.09 GB read, 770.06 MB/s read, 119.9 seconds Interval compaction: 14.80 GB write, 951.43 MB/s write, 12.09 GB read, 777.41 MB/s read, 119.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 54, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 877052 Average: 12.9793 StdDev: 132.34 Min: 0 Median: 1.6258 Max: 24540 Percentiles: P50: 1.63 P75: 2.27 P99: 233.35 P99.9: 1489.73 P99.99: 3431.84 ------------------------------------------------------ [ 0, 1 ] 129913 14.812% 14.812% ### ( 1, 2 ] 493176 56.231% 71.044% ########### ( 2, 3 ] 127875 14.580% 85.624% ### ( 3, 4 ] 50495 5.757% 91.381% # ( 4, 6 ] 42523 4.848% 96.229% # ( 6, 10 ] 9978 1.138% 97.367% ( 10, 15 ] 1677 0.191% 97.558% ( 15, 22 ] 200 0.023% 97.581% ( 22, 34 ] 21 0.002% 97.583% ( 34, 51 ] 23 0.003% 97.586% ( 51, 76 ] 30 0.003% 97.590% ( 76, 110 ] 2255 0.257% 97.847% ( 110, 170 ] 6961 0.794% 98.640% ( 170, 250 ] 3985 0.454% 99.095% ( 250, 380 ] 2337 0.266% 99.361% ( 380, 580 ] 2121 0.242% 99.603% ( 580, 870 ] 1514 0.173% 99.776% ( 870, 1300 ] 937 0.107% 99.882% ( 1300, 1900 ] 490 0.056% 99.938% ( 1900, 2900 ] 338 0.039% 99.977% ( 2900, 4400 ] 328 0.037% 100.014% ( 4400, 6600 ] 135 0.015% 100.030% ( 6600, 9900 ] 15 0.002% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ( 14000, 22000 ] 1 0.000% 100.032% ( 22000, 33000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 149083 Average: 10.2894 StdDev: 128.70 Min: 1 Median: 2.5042 Max: 7718 Percentiles: P50: 2.50 P75: 3.69 P99: 97.33 P99.9: 1829.17 P99.99: 5846.22 ------------------------------------------------------ [ 0, 1 ] 1884 1.264% 1.264% ( 1, 2 ] 49503 33.205% 34.469% ####### ( 2, 3 ] 45921 30.802% 65.271% ###### ( 3, 4 ] 20980 14.073% 79.344% ### ( 4, 6 ] 21868 14.668% 94.012% ### ( 6, 10 ] 5735 3.847% 97.859% # ( 10, 15 ] 1165 0.781% 98.640% ( 15, 22 ] 379 0.254% 98.895% ( 22, 34 ] 39 0.026% 98.921% ( 34, 51 ] 4 0.003% 98.923% ( 51, 76 ] 5 0.003% 98.927% ( 76, 110 ] 174 0.117% 99.043% ( 110, 170 ] 503 0.337% 99.381% ( 170, 250 ] 273 0.183% 99.564% ( 250, 380 ] 124 0.083% 99.647% ( 380, 580 ] 117 0.078% 99.726% ( 580, 870 ] 104 0.070% 99.795% ( 870, 1300 ] 103 0.069% 99.865% ( 1300, 1900 ] 60 0.040% 99.905% ( 1900, 2900 ] 48 0.032% 99.937% ( 2900, 4400 ] 62 0.042% 99.979% ( 4400, 6600 ] 26 0.017% 99.996% ( 6600, 9900 ] 6 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 192465 Average: 12.1313 StdDev: 165.29 Min: 1 Median: 1.9705 Max: 8039 Percentiles: P50: 1.97 P75: 2.98 P99: 12.20 P99.9: 2093.73 P99.99: 3928.36 ------------------------------------------------------ [ 0, 1 ] 5450 2.832% 2.832% # ( 1, 2 ] 93543 48.603% 51.434% ########## ( 2, 3 ] 46449 24.134% 75.568% ##### ( 3, 4 ] 19588 10.177% 85.745% ## ( 4, 6 ] 19458 10.110% 95.855% ## ( 6, 10 ] 5579 2.899% 98.754% # ( 10, 15 ] 1078 0.560% 99.314% ( 15, 22 ] 151 0.078% 99.393% ( 22, 34 ] 52 0.027% 99.420% ( 34, 51 ] 23 0.012% 99.432% ( 51, 76 ] 13 0.007% 99.438% ( 76, 110 ] 21 0.011% 99.449% ( 110, 170 ] 74 0.038% 99.488% ( 170, 250 ] 56 0.029% 99.517% ( 250, 380 ] 83 0.043% 99.560% ( 380, 580 ] 158 0.082% 99.642% ( 580, 870 ] 179 0.093% 99.735% ( 870, 1300 ] 161 0.084% 99.819% ( 1300, 1900 ] 136 0.071% 99.889% ( 1900, 2900 ] 106 0.055% 99.944% ( 2900, 4400 ] 128 0.067% 100.011% ( 4400, 6600 ] 66 0.034% 100.045% ( 6600, 9900 ] 9 0.005% 100.050% ** Level 3 read latency histogram (micros): Count: 1058176 Average: 13.2961 StdDev: 174.36 Min: 1 Median: 1.9539 Max: 14932 Percentiles: P50: 1.95 P75: 2.94 P99: 10.24 P99.9: 1314.68 P99.99: 2116.24 ------------------------------------------------------ [ 0, 1 ] 20296 1.918% 1.918% ( 1, 2 ] 533407 50.408% 52.326% ########## ( 2, 3 ] 256357 24.226% 76.552% ##### ( 3, 4 ] 108353 10.240% 86.792% ## ( 4, 6 ] 103755 9.805% 96.597% ## ( 6, 10 ] 25207 2.382% 98.979% ( 10, 15 ] 4519 0.427% 99.406% ( 15, 22 ] 588 0.056% 99.462% ( 22, 34 ] 76 0.007% 99.469% ( 34, 51 ] 40 0.004% 99.473% ( 51, 76 ] 50 0.005% 99.478% ( 76, 110 ] 186 0.018% 99.495% ( 110, 170 ] 609 0.058% 99.553% ( 170, 250 ] 357 0.034% 99.586% ( 250, 380 ] 383 0.036% 99.623% ( 380, 580 ] 715 0.068% 99.690% ( 580, 870 ] 1045 0.099% 99.789% ( 870, 1300 ] 1155 0.109% 99.898% ( 1300, 1900 ] 810 0.077% 99.975% ( 1900, 2900 ] 750 0.071% 100.046% ( 2900, 4400 ] 908 0.086% 100.131% ( 4400, 6600 ] 328 0.031% 100.162% ( 6600, 9900 ] 58 0.005% 100.168% ( 9900, 14000 ] 3 0.000% 100.168% ( 14000, 22000 ] 1 0.000% 100.168% ** Level 4 read latency histogram (micros): Count: 695300 Average: 21.0352 StdDev: 198.59 Min: 1 Median: 1.9658 Max: 15623 Percentiles: P50: 1.97 P75: 2.99 P99: 370.25 P99.9: 1966.81 P99.99: 2843.24 ------------------------------------------------------ [ 0, 1 ] 13822 1.988% 1.988% ( 1, 2 ] 345664 49.714% 51.702% ########## ( 2, 3 ] 164253 23.623% 75.326% ##### ( 3, 4 ] 69796 10.038% 85.364% ## ( 4, 6 ] 64852 9.327% 94.691% ## ( 6, 10 ] 16581 2.385% 97.076% ( 10, 15 ] 2518 0.362% 97.438% ( 15, 22 ] 352 0.051% 97.489% ( 22, 34 ] 38 0.005% 97.494% ( 34, 51 ] 27 0.004% 97.498% ( 51, 76 ] 55 0.008% 97.506% ( 76, 110 ] 1612 0.232% 97.738% ( 110, 170 ] 4980 0.716% 98.454% ( 170, 250 ] 2453 0.353% 98.807% ( 250, 380 ] 1453 0.209% 99.016% ( 380, 580 ] 1817 0.261% 99.277% ( 580, 870 ] 1760 0.253% 99.530% ( 870, 1300 ] 1561 0.225% 99.755% ( 1300, 1900 ] 963 0.139% 99.893% ( 1900, 2900 ] 714 0.103% 99.996% ( 2900, 4400 ] 685 0.099% 100.094% ( 4400, 6600 ] 212 0.030% 100.125% ( 6600, 9900 ] 40 0.006% 100.131% ( 9900, 14000 ] 4 0.001% 100.131% ( 14000, 22000 ] 3 0.000% 100.132% ** Level 5 read latency histogram (micros): Count: 93146 Average: 469.4609 StdDev: 835.99 Min: 73 Median: 182.8958 Max: 14822 Percentiles: P50: 182.90 P75: 415.98 P99: 4602.36 P99.9: 8074.96 P99.99: 9772.16 ------------------------------------------------------ ( 51, 76 ] 10 0.011% 0.011% ( 76, 110 ] 10840 11.638% 11.648% ## ( 110, 170 ] 33203 35.646% 47.295% ####### ( 170, 250 ] 15633 16.783% 64.078% ### ( 250, 380 ] 8658 9.295% 73.373% ## ( 380, 580 ] 8425 9.045% 82.418% ## ( 580, 870 ] 5790 6.216% 88.634% # ( 870, 1300 ] 3759 4.036% 92.670% # ( 1300, 1900 ] 2151 2.309% 94.979% ( 1900, 2900 ] 1692 1.817% 96.795% ( 2900, 4400 ] 1976 2.121% 98.917% ( 4400, 6600 ] 843 0.905% 99.822% ( 6600, 9900 ] 163 0.175% 99.997% ( 9900, 14000 ] 6 0.006% 100.003% ( 14000, 22000 ] 1 0.001% 100.004% ** DB Stats ** Uptime(secs): 16.1 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 183.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.924 H:M:S, 30.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.089 H:M:S, 2.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/19-00:09:20 ... thread 0: (1000000,4000000) ops and (24598.3,70693.3) ops/second in (40.653198,56.582416) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 3.81 GB 12.6 3.6 0.0 3.6 7.4 3.8 0.0 1.9 105.0 217.1 34.80 24.99 69 0.504 3709K 4021 0.0 0.0 L1 16/16 1.30 GB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 1.8 93.0 92.6 14.41 7.12 1 14.406 1361K 6602 0.0 0.0 L2 1/0 82.54 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 961.94 MB 1.0 2.0 1.1 0.9 2.0 1.1 0.0 1.7 97.7 96.7 21.17 9.74 13 1.628 678K 0 0.0 0.0 L4 161/0 9.72 GB 1.0 6.4 3.7 2.7 6.3 3.6 0.1 1.7 114.4 112.8 57.52 30.45 38 1.514 2480K 39 0.0 0.0 L5 1136/0 93.63 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/31 109.48 GB 0.0 13.3 5.6 7.7 17.0 9.3 3.8 4.5 106.7 136.2 127.89 72.30 121 1.057 8230K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.3 5.6 7.7 17.0 9.3 3.8 4.5 106.7 136.2 127.89 72.30 121 1.057 8230K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.3 5.6 7.7 13.2 5.5 0.0 0.0 124.2 123.0 109.87 61.34 65 1.690 8230K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 216.8 18.02 10.95 56 0.322 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.7 total, 56.6 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.02 GB write, 307.10 MB/s write, 13.33 GB read, 240.49 MB/s read, 127.9 seconds Interval compaction: 17.02 GB write, 307.93 MB/s write, 13.33 GB read, 241.14 MB/s read, 127.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 54, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1764808 Average: 27.1490 StdDev: 109.68 Min: 0 Median: 1.7569 Max: 24540 Percentiles: P50: 1.76 P75: 3.37 P99: 235.95 P99.9: 965.64 P99.99: 2582.67 ------------------------------------------------------ [ 0, 1 ] 283093 16.041% 16.041% ### ( 1, 2 ] 791794 44.866% 60.907% ######### ( 2, 3 ] 200698 11.372% 72.279% ## ( 3, 4 ] 131218 7.435% 79.714% # ( 4, 6 ] 69920 3.962% 83.676% # ( 6, 10 ] 13375 0.758% 84.434% ( 10, 15 ] 2642 0.150% 84.584% ( 15, 22 ] 304 0.017% 84.601% ( 22, 34 ] 24 0.001% 84.602% ( 34, 51 ] 24 0.001% 84.604% ( 51, 76 ] 247 0.014% 84.618% ( 76, 110 ] 66628 3.775% 88.393% # ( 110, 170 ] 165230 9.362% 97.756% ## ( 170, 250 ] 26642 1.510% 99.265% ( 250, 380 ] 5157 0.292% 99.557% ( 380, 580 ] 3858 0.219% 99.776% ( 580, 870 ] 1972 0.112% 99.888% ( 870, 1300 ] 981 0.056% 99.943% ( 1300, 1900 ] 519 0.029% 99.973% ( 1900, 2900 ] 449 0.025% 99.998% ( 2900, 4400 ] 405 0.023% 100.021% ( 4400, 6600 ] 135 0.008% 100.029% ( 6600, 9900 ] 15 0.001% 100.030% ( 9900, 14000 ] 1 0.000% 100.030% ( 14000, 22000 ] 1 0.000% 100.030% ( 22000, 33000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 280855 Average: 16.0416 StdDev: 100.99 Min: 1 Median: 2.6525 Max: 7718 Percentiles: P50: 2.65 P75: 4.32 P99: 178.24 P99.9: 984.17 P99.99: 4373.74 ------------------------------------------------------ [ 0, 1 ] 12073 4.299% 4.299% # ( 1, 2 ] 89637 31.916% 36.214% ###### ( 2, 3 ] 59339 21.128% 57.342% #### ( 3, 4 ] 42087 14.985% 72.328% ### ( 4, 6 ] 46893 16.697% 89.024% ### ( 6, 10 ] 7832 2.789% 91.813% # ( 10, 15 ] 1856 0.661% 92.474% ( 15, 22 ] 885 0.315% 92.789% ( 22, 34 ] 62 0.022% 92.811% ( 34, 51 ] 4 0.001% 92.812% ( 51, 76 ] 12 0.004% 92.817% ( 76, 110 ] 4984 1.775% 94.591% ( 110, 170 ] 12187 4.339% 98.930% # ( 170, 250 ] 1908 0.679% 99.610% ( 250, 380 ] 330 0.117% 99.727% ( 380, 580 ] 306 0.109% 99.836% ( 580, 870 ] 152 0.054% 99.890% ( 870, 1300 ] 106 0.038% 99.928% ( 1300, 1900 ] 62 0.022% 99.950% ( 1900, 2900 ] 52 0.019% 99.969% ( 2900, 4400 ] 62 0.022% 99.991% ( 4400, 6600 ] 26 0.009% 100.000% ( 6600, 9900 ] 6 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 193455 Average: 12.7840 StdDev: 165.18 Min: 1 Median: 1.9758 Max: 8039 Percentiles: P50: 1.98 P75: 2.99 P99: 92.00 P99.9: 2084.39 P99.99: 3927.20 ------------------------------------------------------ [ 0, 1 ] 5450 2.817% 2.817% # ( 1, 2 ] 93543 48.354% 51.171% ########## ( 2, 3 ] 46449 24.010% 75.181% ##### ( 3, 4 ] 19588 10.125% 85.307% ## ( 4, 6 ] 19458 10.058% 95.365% ## ( 6, 10 ] 5579 2.884% 98.249% # ( 10, 15 ] 1078 0.557% 98.806% ( 15, 22 ] 151 0.078% 98.884% ( 22, 34 ] 52 0.027% 98.911% ( 34, 51 ] 23 0.012% 98.923% ( 51, 76 ] 13 0.007% 98.929% ( 76, 110 ] 290 0.150% 99.079% ( 110, 170 ] 683 0.353% 99.432% ( 170, 250 ] 142 0.073% 99.506% ( 250, 380 ] 96 0.050% 99.555% ( 380, 580 ] 168 0.087% 99.642% ( 580, 870 ] 181 0.094% 99.736% ( 870, 1300 ] 162 0.084% 99.820% ( 1300, 1900 ] 136 0.070% 99.890% ( 1900, 2900 ] 106 0.055% 99.945% ( 2900, 4400 ] 128 0.066% 100.011% ( 4400, 6600 ] 66 0.034% 100.045% ( 6600, 9900 ] 9 0.005% 100.050% ** Level 3 read latency histogram (micros): Count: 1070021 Average: 14.6896 StdDev: 174.02 Min: 1 Median: 1.9650 Max: 14932 Percentiles: P50: 1.96 P75: 2.97 P99: 135.70 P99.9: 1309.58 P99.99: 2116.75 ------------------------------------------------------ [ 0, 1 ] 20296 1.897% 1.897% ( 1, 2 ] 533407 49.850% 51.747% ########## ( 2, 3 ] 256357 23.958% 75.705% ##### ( 3, 4 ] 108353 10.126% 85.831% ## ( 4, 6 ] 103755 9.697% 95.528% ## ( 6, 10 ] 25207 2.356% 97.884% ( 10, 15 ] 4519 0.422% 98.306% ( 15, 22 ] 588 0.055% 98.361% ( 22, 34 ] 76 0.007% 98.368% ( 34, 51 ] 40 0.004% 98.372% ( 51, 76 ] 56 0.005% 98.377% ( 76, 110 ] 3163 0.296% 98.673% ( 110, 170 ] 8181 0.765% 99.437% ( 170, 250 ] 1340 0.125% 99.562% ( 250, 380 ] 558 0.052% 99.614% ( 380, 580 ] 824 0.077% 99.692% ( 580, 870 ] 1063 0.099% 99.791% ( 870, 1300 ] 1155 0.108% 99.899% ( 1300, 1900 ] 813 0.076% 99.975% ( 1900, 2900 ] 752 0.070% 100.045% ( 2900, 4400 ] 908 0.085% 100.130% ( 4400, 6600 ] 328 0.031% 100.161% ( 6600, 9900 ] 58 0.005% 100.166% ( 9900, 14000 ] 3 0.000% 100.166% ( 14000, 22000 ] 1 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 814118 Average: 38.3020 StdDev: 189.95 Min: 1 Median: 2.2893 Max: 15623 Percentiles: P50: 2.29 P75: 4.52 P99: 390.94 P99.9: 1869.32 P99.99: 2832.50 ------------------------------------------------------ [ 0, 1 ] 13822 1.698% 1.698% ( 1, 2 ] 345696 42.463% 44.160% ######## ( 2, 3 ] 164344 20.187% 64.347% #### ( 3, 4 ] 69861 8.581% 72.928% ## ( 4, 6 ] 64903 7.972% 80.901% ## ( 6, 10 ] 16583 2.037% 82.937% ( 10, 15 ] 2521 0.310% 83.247% ( 15, 22 ] 353 0.043% 83.291% ( 22, 34 ] 38 0.005% 83.295% ( 34, 51 ] 27 0.003% 83.298% ( 51, 76 ] 105 0.013% 83.311% ( 76, 110 ] 32385 3.978% 87.289% # ( 110, 170 ] 79322 9.743% 97.033% ## ( 170, 250 ] 12777 1.569% 98.602% ( 250, 380 ] 3080 0.378% 98.980% ( 380, 580 ] 2923 0.359% 99.339% ( 580, 870 ] 2042 0.251% 99.590% ( 870, 1300 ] 1592 0.196% 99.786% ( 1300, 1900 ] 980 0.120% 99.906% ( 1900, 2900 ] 732 0.090% 99.996% ( 2900, 4400 ] 688 0.085% 100.081% ( 4400, 6600 ] 212 0.026% 100.107% ( 6600, 9900 ] 40 0.005% 100.112% ( 9900, 14000 ] 4 0.000% 100.112% ( 14000, 22000 ] 3 0.000% 100.112% ** Level 5 read latency histogram (micros): Count: 817679 Average: 176.8094 StdDev: 307.31 Min: 72 Median: 135.6904 Max: 14822 Percentiles: P50: 135.69 P75: 160.86 P99: 1174.75 P99.9: 4862.76 P99.99: 8021.88 ------------------------------------------------------ ( 51, 76 ] 267 0.033% 0.033% ( 76, 110 ] 199914 24.449% 24.482% ##### ( 110, 170 ] 487323 59.598% 84.080% ############ ( 170, 250 ] 78768 9.633% 93.713% ## ( 250, 380 ] 18098 2.213% 95.926% ( 380, 580 ] 15003 1.835% 97.761% ( 580, 870 ] 7334 0.897% 98.658% ( 870, 1300 ] 3944 0.482% 99.140% ( 1300, 1900 ] 2225 0.272% 99.413% ( 1900, 2900 ] 1817 0.222% 99.635% ( 2900, 4400 ] 1991 0.243% 99.878% ( 4400, 6600 ] 843 0.103% 99.981% ( 6600, 9900 ] 163 0.020% 100.001% ( 9900, 14000 ] 6 0.001% 100.002% ( 14000, 22000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 56.7 total, 40.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 69.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:41.064 H:M:S, 72.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 24.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:36.140 H:M:S, 88.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 223.678 micros/op 17878 ops/sec 60.072 seconds 1073996 operations; 17.3 MB/s (270999 of 270999 found) Microseconds per read: Count: 1073996 Average: 223.6793 StdDev: 677.27 Min: 2 Median: 165.2987 Max: 74214 Percentiles: P50: 165.30 P75: 223.39 P99: 931.56 P99.9: 10245.31 P99.99: 29368.28 ------------------------------------------------------ ( 1, 2 ] 1 0.000% 0.000% ( 2, 3 ] 30 0.003% 0.003% ( 3, 4 ] 71 0.007% 0.009% ( 4, 6 ] 90 0.008% 0.018% ( 6, 10 ] 352 0.033% 0.051% ( 10, 15 ] 3397 0.316% 0.367% ( 15, 22 ] 5021 0.468% 0.834% ( 22, 34 ] 9298 0.866% 1.700% ( 34, 51 ] 2403 0.224% 1.924% ( 51, 76 ] 292 0.027% 1.951% ( 76, 110 ] 27113 2.524% 4.476% # ( 110, 170 ] 530497 49.395% 53.870% ########## ( 170, 250 ] 340040 31.661% 85.532% ###### ( 250, 380 ] 99007 9.219% 94.750% ## ( 380, 580 ] 33210 3.092% 97.842% # ( 580, 870 ] 11745 1.094% 98.936% ( 870, 1300 ] 4813 0.448% 99.384% ( 1300, 1900 ] 2181 0.203% 99.587% ( 1900, 2900 ] 1459 0.136% 99.723% ( 2900, 4400 ] 1223 0.114% 99.837% ( 4400, 6600 ] 417 0.039% 99.876% ( 6600, 9900 ] 230 0.021% 99.897% ( 9900, 14000 ] 380 0.035% 99.932% ( 14000, 22000 ] 492 0.046% 99.978% ( 22000, 33000 ] 189 0.018% 99.996% ( 33000, 50000 ] 29 0.003% 99.999% ( 50000, 75000 ] 16 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18983228 rocksdb.bloom.filter.full.positive COUNT : 1258635 rocksdb.bloom.filter.full.true.positive COUNT : 1073578 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 418 rocksdb.memtable.miss COUNT : 1073578 rocksdb.l0.hit COUNT : 39238 rocksdb.l1.hit COUNT : 13501 rocksdb.l2andup.hit COUNT : 1020839 rocksdb.compaction.key.drop.new COUNT : 179039 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4009293 rocksdb.number.keys.read COUNT : 1073996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4137590376 rocksdb.bytes.read COUNT : 1073996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1547 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44429052 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16752788268 rocksdb.compact.write.bytes COUNT : 16574050507 rocksdb.flush.write.bytes COUNT : 4095538558 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 21 rocksdb.number.superversion_acquires COUNT : 764 rocksdb.number.superversion_releases COUNT : 735 rocksdb.number.superversion_cleanups COUNT : 193 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 200 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4062504960 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1572864 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21579128808 rocksdb.non.last.level.read.count COUNT : 5071895 rocksdb.block.checksum.compute.count COUNT : 5331076 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 164.460452 P95 : 394.106931 P99 : 929.573795 P100 : 74212.000000 COUNT : 1073996 SUM : 239254896 rocksdb.db.write.micros P50 : 1.559207 P95 : 4.951525 P99 : 12.854836 P100 : 940110.000000 COUNT : 4009293 SUM : 54954139 rocksdb.compaction.times.micros P50 : 1477586.206897 P95 : 2803846.153846 P99 : 14405631.000000 P100 : 14405631.000000 COUNT : 65 SUM : 109874151 rocksdb.compaction.times.cpu_micros P50 : 811666.666667 P95 : 1585000.000000 P99 : 7121256.000000 P100 : 7121256.000000 COUNT : 65 SUM : 61344260 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 784.074074 P95 : 122000.000000 P99 : 220837.000000 P100 : 220837.000000 COUNT : 56 SUM : 875781 rocksdb.compaction.outfile.sync.micros P50 : 48583.333333 P95 : 255571.428571 P99 : 480700.000000 P100 : 1024571.000000 COUNT : 194 SUM : 16013675 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 293.333333 P95 : 5231.111111 P99 : 6521.777778 P100 : 7295.000000 COUNT : 132 SUM : 161773 rocksdb.table.open.io.micros P50 : 9596.691176 P95 : 20600.754717 P99 : 27510.645161 P100 : 32748.000000 COUNT : 1547 SUM : 15157179 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.975625 P95 : 77.192410 P99 : 181.515088 P100 : 15255.000000 COUNT : 4058895 SUM : 72183621 rocksdb.read.block.get.micros P50 : 135.126775 P95 : 262.800694 P99 : 851.261038 P100 : 24544.000000 COUNT : 1270632 SUM : 202106125 rocksdb.write.raw.block.micros P50 : 0.540749 P95 : 1.462615 P99 : 3.805171 P100 : 22488.000000 COUNT : 5006582 SUM : 15394594 rocksdb.numfiles.in.singlecompaction P50 : 2.710526 P95 : 3.939062 P99 : 24.520000 P100 : 31.000000 COUNT : 79 SUM : 278 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.584364 P95 : 2188.504902 P99 : 2758.485294 P100 : 939924.000000 COUNT : 174414 SUM : 44449209 rocksdb.sst.read.micros P50 : 2.472413 P95 : 167.291214 P99 : 450.612810 P100 : 24540.000000 COUNT : 5071924 SUM : 260443979 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1073996 SUM : 1073996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4009293 SUM : 4137590376 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220909.090909 P95 : 1047000.000000 P99 : 1202565.000000 P100 : 1202565.000000 COUNT : 56 SUM : 18016502 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 207 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0