[2024-11-19 20:13:40.659404] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-19 20:13:40.659550] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1641552 ] Set seed to 1732043620655975 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 20:13:40.759462] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 20:13:40.797284] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 20:13:40.797329] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1641552' to capture a snapshot of events at runtime. [2024-11-19 20:13:40.797339] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 20:13:40.797349] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 20:13:40.797357] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1641552 for offline analysis/debug. [2024-11-19 20:13:40.797435] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 20:13:45 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-20:13:53 ... thread 0: (1000000,1000000) ops and (122168.6,122168.6) ops/second in (8.185407,8.185407) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.87 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 39.0 130.1 9.68 4.22 11 0.880 383K 501 0.0 0.0 L1 7/7 719.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 26/10 1.84 GB 0.9 2.6 1.8 0.9 2.6 1.7 0.1 1.5 99.3 98.0 27.27 12.46 8 3.409 784K 0 0.0 0.0 L4 166/23 10.85 GB 1.0 3.5 2.5 0.9 3.5 2.5 0.0 1.4 112.3 111.3 31.88 16.85 28 1.139 2428K 1179 0.0 0.0 L5 1100/0 90.61 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/51 105.87 GB 0.0 6.5 4.3 2.2 7.3 5.1 1.5 8.5 96.8 108.7 68.84 33.53 47 1.465 3597K 1680 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 4.3 2.2 7.3 5.1 1.5 8.5 96.8 108.7 68.84 33.53 47 1.465 3597K 1680 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 4.3 2.2 6.4 4.2 0.0 0.0 108.8 107.8 61.24 30.85 37 1.655 3597K 1680 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 116.1 7.59 2.68 10 0.759 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.3 total, 8.2 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.31 GB write, 899.94 MB/s write, 6.51 GB read, 801.63 MB/s read, 68.8 seconds Interval compaction: 7.31 GB write, 914.02 MB/s write, 6.51 GB read, 814.18 MB/s read, 68.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 30, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 361858 Average: 15.5427 StdDev: 194.85 Min: 1 Median: 1.9032 Max: 26073 Percentiles: P50: 1.90 P75: 2.93 P99: 13.70 P99.9: 2507.02 P99.99: 3994.76 ------------------------------------------------------ [ 0, 1 ] 12738 3.520% 3.520% # ( 1, 2 ] 186225 51.464% 54.984% ########## ( 2, 3 ] 77957 21.544% 76.527% #### ( 3, 4 ] 36357 10.047% 86.575% ## ( 4, 6 ] 35775 9.886% 96.461% ## ( 6, 10 ] 8145 2.251% 98.712% ( 10, 15 ] 1408 0.389% 99.101% ( 15, 22 ] 175 0.048% 99.149% ( 22, 34 ] 22 0.006% 99.155% ( 34, 51 ] 25 0.007% 99.162% ( 51, 76 ] 16 0.004% 99.167% ( 76, 110 ] 14 0.004% 99.171% ( 110, 170 ] 37 0.010% 99.181% ( 170, 250 ] 65 0.018% 99.199% ( 250, 380 ] 200 0.055% 99.254% ( 380, 580 ] 400 0.111% 99.365% ( 580, 870 ] 633 0.175% 99.540% ( 870, 1300 ] 653 0.180% 99.720% ( 1300, 1900 ] 466 0.129% 99.849% ( 1900, 2900 ] 305 0.084% 99.933% ( 2900, 4400 ] 282 0.078% 100.011% ( 4400, 6600 ] 95 0.026% 100.037% ( 6600, 9900 ] 10 0.003% 100.040% ( 9900, 14000 ] 2 0.001% 100.041% ( 14000, 22000 ] 1 0.000% 100.041% ( 22000, 33000 ] 4 0.001% 100.042% ** Level 1 read latency histogram (micros): Count: 122 Average: 1516.1148 StdDev: 1180.88 Min: 45 Median: 1169.1304 Max: 5409 Percentiles: P50: 1169.13 P75: 1933.33 P99: 5409.00 P99.9: 5409.00 P99.99: 5409.00 ------------------------------------------------------ ( 34, 51 ] 1 0.820% 0.820% ( 110, 170 ] 1 0.820% 1.639% ( 170, 250 ] 3 2.459% 4.098% ( 250, 380 ] 11 9.016% 13.115% ## ( 380, 580 ] 10 8.197% 21.311% ## ( 580, 870 ] 19 15.574% 36.885% ### ( 870, 1300 ] 23 18.852% 55.738% #### ( 1300, 1900 ] 23 18.852% 74.590% #### ( 1900, 2900 ] 15 12.295% 86.885% ## ( 2900, 4400 ] 11 9.016% 95.902% ## ( 4400, 6600 ] 5 4.098% 100.000% # ** Level 2 read latency histogram (micros): Count: 291161 Average: 12.2582 StdDev: 151.49 Min: 1 Median: 1.9170 Max: 10141 Percentiles: P50: 1.92 P75: 2.93 P99: 11.03 P99.9: 1362.94 P99.99: 1897.72 ------------------------------------------------------ [ 0, 1 ] 9710 3.335% 3.335% # ( 1, 2 ] 148163 50.887% 54.222% ########## ( 2, 3 ] 65327 22.437% 76.659% #### ( 3, 4 ] 29215 10.034% 86.693% ## ( 4, 6 ] 27847 9.564% 96.257% ## ( 6, 10 ] 7683 2.639% 98.895% # ( 10, 15 ] 1476 0.507% 99.402% ( 15, 22 ] 212 0.073% 99.475% ( 22, 34 ] 41 0.014% 99.489% ( 34, 51 ] 12 0.004% 99.493% ( 51, 76 ] 7 0.002% 99.496% ( 76, 110 ] 10 0.003% 99.499% ( 110, 170 ] 21 0.007% 99.506% ( 170, 250 ] 52 0.018% 99.524% ( 250, 380 ] 105 0.036% 99.560% ( 380, 580 ] 237 0.081% 99.642% ( 580, 870 ] 309 0.106% 99.748% ( 870, 1300 ] 412 0.142% 99.889% ( 1300, 1900 ] 294 0.101% 99.990% ( 1900, 2900 ] 208 0.071% 100.062% ( 2900, 4400 ] 173 0.059% 100.121% ( 4400, 6600 ] 58 0.020% 100.141% ( 6600, 9900 ] 6 0.002% 100.143% ( 9900, 14000 ] 1 0.000% 100.144% ** Level 3 read latency histogram (micros): Count: 753531 Average: 9.8198 StdDev: 154.81 Min: 1 Median: 1.9792 Max: 29501 Percentiles: P50: 1.98 P75: 2.98 P99: 9.24 P99.9: 116.38 P99.99: 599.76 ------------------------------------------------------ [ 0, 1 ] 13180 1.749% 1.749% ( 1, 2 ] 371322 49.278% 51.027% ########## ( 2, 3 ] 183651 24.372% 75.399% ##### ( 3, 4 ] 83608 11.095% 86.494% ## ( 4, 6 ] 81058 10.757% 97.251% ## ( 6, 10 ] 16286 2.161% 99.413% ( 10, 15 ] 3108 0.412% 99.825% ( 15, 22 ] 380 0.050% 99.876% ( 22, 34 ] 51 0.007% 99.882% ( 34, 51 ] 52 0.007% 99.889% ( 51, 76 ] 57 0.008% 99.897% ( 76, 110 ] 20 0.003% 99.899% ( 110, 170 ] 42 0.006% 99.905% ( 170, 250 ] 84 0.011% 99.916% ( 250, 380 ] 160 0.021% 99.937% ( 380, 580 ] 357 0.047% 99.985% ( 580, 870 ] 582 0.077% 100.062% ( 870, 1300 ] 660 0.088% 100.150% ( 1300, 1900 ] 423 0.056% 100.206% ( 1900, 2900 ] 342 0.045% 100.251% ( 2900, 4400 ] 375 0.050% 100.301% ( 4400, 6600 ] 111 0.015% 100.316% ( 6600, 9900 ] 23 0.003% 100.319% ( 9900, 14000 ] 7 0.001% 100.320% ( 14000, 22000 ] 7 0.001% 100.320% ( 22000, 33000 ] 3 0.000% 100.321% ** Level 4 read latency histogram (micros): Count: 382717 Average: 27.0782 StdDev: 277.68 Min: 1 Median: 1.9713 Max: 29492 Percentiles: P50: 1.97 P75: 3.04 P99: 582.22 P99.9: 2751.83 P99.99: 3492.08 ------------------------------------------------------ [ 0, 1 ] 7828 2.045% 2.045% ( 1, 2 ] 188952 49.371% 51.417% ########## ( 2, 3 ] 88748 23.189% 74.606% ##### ( 3, 4 ] 40207 10.506% 85.111% ## ( 4, 6 ] 39835 10.408% 95.520% ## ( 6, 10 ] 10020 2.618% 98.138% # ( 10, 15 ] 1771 0.463% 98.601% ( 15, 22 ] 219 0.057% 98.658% ( 22, 34 ] 23 0.006% 98.664% ( 34, 51 ] 23 0.006% 98.670% ( 51, 76 ] 30 0.008% 98.678% ( 76, 110 ] 21 0.005% 98.683% ( 110, 170 ] 58 0.015% 98.698% ( 170, 250 ] 178 0.047% 98.745% ( 250, 380 ] 280 0.073% 98.818% ( 380, 580 ] 689 0.180% 98.998% ( 580, 870 ] 1021 0.267% 99.265% ( 870, 1300 ] 1083 0.283% 99.548% ( 1300, 1900 ] 775 0.202% 99.750% ( 1900, 2900 ] 673 0.176% 99.926% ( 2900, 4400 ] 621 0.162% 100.088% ( 4400, 6600 ] 252 0.066% 100.154% ( 6600, 9900 ] 41 0.011% 100.165% ( 9900, 14000 ] 7 0.002% 100.167% ( 14000, 22000 ] 8 0.002% 100.169% ( 22000, 33000 ] 2 0.001% 100.169% ** Level 5 read latency histogram (micros): Count: 14001 Average: 1672.7011 StdDev: 1575.08 Min: 77 Median: 1135.4189 Max: 29687 Percentiles: P50: 1135.42 P75: 2296.91 P99: 6952.42 P99.9: 12974.66 P99.99: 29687.00 ------------------------------------------------------ ( 76, 110 ] 19 0.136% 0.136% ( 110, 170 ] 129 0.921% 1.057% ( 170, 250 ] 300 2.143% 3.200% ( 250, 380 ] 814 5.814% 9.014% # ( 380, 580 ] 1661 11.863% 20.877% ## ( 580, 870 ] 2464 17.599% 38.476% #### ( 870, 1300 ] 2614 18.670% 57.146% #### ( 1300, 1900 ] 1852 13.228% 70.374% ### ( 1900, 2900 ] 1632 11.656% 82.030% ## ( 2900, 4400 ] 1655 11.821% 93.850% ## ( 4400, 6600 ] 707 5.050% 98.900% # ( 6600, 9900 ] 131 0.936% 99.836% ( 9900, 14000 ] 12 0.086% 99.921% ( 14000, 22000 ] 6 0.043% 99.964% ( 22000, 33000 ] 5 0.036% 100.000% ** DB Stats ** Uptime(secs): 8.3 total, 8.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 118.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.149 H:M:S, 49.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 120.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.149 H:M:S, 50.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/19-20:13:57 ... thread 0: (1000000,2000000) ops and (244841.4,163003.4) ops/second in (4.084276,12.269683) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 2.86 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 80.3 176.6 19.61 11.79 30 0.654 1598K 1869 0.0 0.0 L1 7/7 719.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 934.97 MB 0.9 2.6 1.8 0.9 2.6 1.7 0.1 1.5 99.3 98.0 27.27 12.46 8 3.409 784K 0 0.0 0.0 L4 158/0 9.77 GB 1.0 5.6 3.5 2.1 5.5 3.4 0.0 1.6 114.4 113.0 50.03 26.96 36 1.390 2801K 1406 0.0 0.0 L5 1124/0 92.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/18 106.82 GB 0.0 9.8 5.2 4.5 11.5 7.0 3.5 6.2 103.2 121.7 96.91 51.21 74 1.310 5185K 3275 0.0 0.0 Int 0/0 0.00 KB 0.0 9.8 5.2 4.5 11.5 7.0 3.5 6.2 103.2 121.7 96.91 51.21 74 1.310 5185K 3275 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.8 5.2 4.5 9.7 5.1 0.0 0.0 117.3 116.1 85.30 45.63 49 1.741 5185K 3275 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 162.8 11.61 5.58 25 0.464 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.3 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.51 GB write, 950.90 MB/s write, 9.77 GB read, 806.85 MB/s read, 96.9 seconds Interval compaction: 11.51 GB write, 960.83 MB/s write, 9.77 GB read, 815.27 MB/s read, 96.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 38, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 672073 Average: 14.3208 StdDev: 157.06 Min: 1 Median: 1.7288 Max: 26073 Percentiles: P50: 1.73 P75: 2.59 P99: 234.96 P99.9: 1715.39 P99.99: 3291.35 ------------------------------------------------------ [ 0, 1 ] 68434 10.183% 10.183% ## ( 1, 2 ] 367178 54.634% 64.816% ########### ( 2, 3 ] 116051 17.268% 82.084% ### ( 3, 4 ] 48337 7.192% 89.276% # ( 4, 6 ] 44653 6.644% 95.920% # ( 6, 10 ] 10683 1.590% 97.510% ( 10, 15 ] 1885 0.280% 97.790% ( 15, 22 ] 235 0.035% 97.825% ( 22, 34 ] 26 0.004% 97.829% ( 34, 51 ] 28 0.004% 97.833% ( 51, 76 ] 20 0.003% 97.836% ( 76, 110 ] 1257 0.187% 98.023% ( 110, 170 ] 4481 0.667% 98.690% ( 170, 250 ] 2568 0.382% 99.072% ( 250, 380 ] 1513 0.225% 99.297% ( 380, 580 ] 1613 0.240% 99.537% ( 580, 870 ] 1175 0.175% 99.712% ( 870, 1300 ] 889 0.132% 99.844% ( 1300, 1900 ] 543 0.081% 99.925% ( 1900, 2900 ] 353 0.053% 99.978% ( 2900, 4400 ] 325 0.048% 100.026% ( 4400, 6600 ] 109 0.016% 100.042% ( 6600, 9900 ] 12 0.002% 100.044% ( 9900, 14000 ] 4 0.001% 100.044% ( 14000, 22000 ] 1 0.000% 100.045% ( 22000, 33000 ] 4 0.001% 100.045% ** Level 1 read latency histogram (micros): Count: 45693 Average: 10.9738 StdDev: 111.80 Min: 1 Median: 2.7362 Max: 5409 Percentiles: P50: 2.74 P75: 4.16 P99: 136.77 P99.9: 1706.14 P99.99: 4339.00 ------------------------------------------------------ [ 0, 1 ] 703 1.539% 1.539% ( 1, 2 ] 12612 27.602% 29.140% ###### ( 2, 3 ] 12947 28.335% 57.475% ###### ( 3, 4 ] 7322 16.024% 73.499% ### ( 4, 6 ] 8456 18.506% 92.005% #### ( 6, 10 ] 2420 5.296% 97.302% # ( 10, 15 ] 423 0.926% 98.227% ( 15, 22 ] 195 0.427% 98.654% ( 22, 34 ] 18 0.039% 98.693% ( 34, 51 ] 2 0.004% 98.698% ( 76, 110 ] 60 0.131% 98.829% ( 110, 170 ] 175 0.383% 99.212% ( 170, 250 ] 87 0.190% 99.403% ( 250, 380 ] 58 0.127% 99.529% ( 380, 580 ] 61 0.133% 99.663% ( 580, 870 ] 57 0.125% 99.788% ( 870, 1300 ] 31 0.068% 99.856% ( 1300, 1900 ] 30 0.066% 99.921% ( 1900, 2900 ] 18 0.039% 99.961% ( 2900, 4400 ] 14 0.031% 99.991% ( 4400, 6600 ] 5 0.011% 100.002% ** Level 2 read latency histogram (micros): Count: 293668 Average: 12.2061 StdDev: 151.21 Min: 1 Median: 1.9178 Max: 10141 Percentiles: P50: 1.92 P75: 2.93 P99: 10.98 P99.9: 1361.90 P99.99: 1903.03 ------------------------------------------------------ [ 0, 1 ] 9741 3.317% 3.317% # ( 1, 2 ] 149368 50.863% 54.180% ########## ( 2, 3 ] 65972 22.465% 76.645% #### ( 3, 4 ] 29466 10.034% 86.678% ## ( 4, 6 ] 28137 9.581% 96.260% ## ( 6, 10 ] 7756 2.641% 98.901% # ( 10, 15 ] 1486 0.506% 99.407% ( 15, 22 ] 212 0.072% 99.479% ( 22, 34 ] 41 0.014% 99.493% ( 34, 51 ] 12 0.004% 99.497% ( 51, 76 ] 7 0.002% 99.499% ( 76, 110 ] 10 0.003% 99.503% ( 110, 170 ] 21 0.007% 99.510% ( 170, 250 ] 52 0.018% 99.528% ( 250, 380 ] 105 0.036% 99.563% ( 380, 580 ] 237 0.081% 99.644% ( 580, 870 ] 309 0.105% 99.749% ( 870, 1300 ] 412 0.140% 99.890% ( 1300, 1900 ] 294 0.100% 99.990% ( 1900, 2900 ] 209 0.071% 100.061% ( 2900, 4400 ] 173 0.059% 100.120% ( 4400, 6600 ] 59 0.020% 100.140% ( 6600, 9900 ] 6 0.002% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 865996 Average: 9.2390 StdDev: 146.47 Min: 1 Median: 1.9686 Max: 29501 Percentiles: P50: 1.97 P75: 2.97 P99: 9.32 P99.9: 165.08 P99.99: 535.86 ------------------------------------------------------ [ 0, 1 ] 16044 1.853% 1.853% ( 1, 2 ] 430492 49.711% 51.563% ########## ( 2, 3 ] 209493 24.191% 75.754% ##### ( 3, 4 ] 93950 10.849% 86.603% ## ( 4, 6 ] 91306 10.543% 97.147% ## ( 6, 10 ] 19345 2.234% 99.380% ( 10, 15 ] 3550 0.410% 99.790% ( 15, 22 ] 439 0.051% 99.841% ( 22, 34 ] 54 0.006% 99.847% ( 34, 51 ] 57 0.007% 99.854% ( 51, 76 ] 65 0.008% 99.861% ( 76, 110 ] 89 0.010% 99.872% ( 110, 170 ] 268 0.031% 99.903% ( 170, 250 ] 210 0.024% 99.927% ( 250, 380 ] 231 0.027% 99.953% ( 380, 580 ] 406 0.047% 100.000% ( 580, 870 ] 620 0.072% 100.072% ( 870, 1300 ] 676 0.078% 100.150% ( 1300, 1900 ] 434 0.050% 100.200% ( 1900, 2900 ] 352 0.041% 100.241% ( 2900, 4400 ] 390 0.045% 100.286% ( 4400, 6600 ] 116 0.013% 100.299% ( 6600, 9900 ] 24 0.003% 100.302% ( 9900, 14000 ] 7 0.001% 100.303% ( 14000, 22000 ] 7 0.001% 100.304% ( 22000, 33000 ] 3 0.000% 100.304% ** Level 4 read latency histogram (micros): Count: 555063 Average: 24.1157 StdDev: 247.18 Min: 1 Median: 1.9570 Max: 29492 Percentiles: P50: 1.96 P75: 2.99 P99: 409.29 P99.9: 2150.60 P99.99: 2831.19 ------------------------------------------------------ [ 0, 1 ] 11512 2.074% 2.074% ( 1, 2 ] 277985 50.082% 52.156% ########## ( 2, 3 ] 128079 23.075% 75.230% ##### ( 3, 4 ] 55357 9.973% 85.203% ## ( 4, 6 ] 54474 9.814% 95.018% ## ( 6, 10 ] 14377 2.590% 97.608% # ( 10, 15 ] 2453 0.442% 98.050% ( 15, 22 ] 308 0.055% 98.105% ( 22, 34 ] 29 0.005% 98.110% ( 34, 51 ] 30 0.005% 98.116% ( 51, 76 ] 41 0.007% 98.123% ( 76, 110 ] 602 0.108% 98.232% ( 110, 170 ] 1982 0.357% 98.589% ( 170, 250 ] 1194 0.215% 98.804% ( 250, 380 ] 894 0.161% 98.965% ( 380, 580 ] 1334 0.240% 99.205% ( 580, 870 ] 1449 0.261% 99.466% ( 870, 1300 ] 1339 0.241% 99.707% ( 1300, 1900 ] 885 0.159% 99.867% ( 1900, 2900 ] 734 0.132% 99.999% ( 2900, 4400 ] 725 0.131% 100.130% ( 4400, 6600 ] 286 0.052% 100.181% ( 6600, 9900 ] 47 0.008% 100.190% ( 9900, 14000 ] 10 0.002% 100.192% ( 14000, 22000 ] 8 0.001% 100.193% ( 22000, 33000 ] 2 0.000% 100.193% ** Level 5 read latency histogram (micros): Count: 50188 Average: 678.0800 StdDev: 1092.46 Min: 73 Median: 241.2304 Max: 29687 Percentiles: P50: 241.23 P75: 710.43 P99: 5606.33 P99.9: 9143.23 P99.99: 16641.60 ------------------------------------------------------ ( 51, 76 ] 3 0.006% 0.006% ( 76, 110 ] 4030 8.030% 8.036% ## ( 110, 170 ] 14295 28.483% 36.519% ###### ( 170, 250 ] 7599 15.141% 51.660% ### ( 250, 380 ] 4511 8.988% 60.648% ## ( 380, 580 ] 5229 10.419% 71.067% ## ( 580, 870 ] 4389 8.745% 79.812% ## ( 870, 1300 ] 3464 6.902% 86.714% # ( 1300, 1900 ] 2167 4.318% 91.032% # ( 1900, 2900 ] 1778 3.543% 94.574% # ( 2900, 4400 ] 1800 3.587% 98.161% # ( 4400, 6600 ] 768 1.530% 99.691% ( 6600, 9900 ] 136 0.271% 99.962% ( 9900, 14000 ] 12 0.024% 99.986% ( 14000, 22000 ] 6 0.012% 99.998% ( 22000, 33000 ] 5 0.010% 100.008% ** DB Stats ** Uptime(secs): 12.4 total, 4.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 158.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.707 H:M:S, 38.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 240.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.558 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-20:14:04 ... thread 0: (1000000,3000000) ops and (137765.0,153622.3) ops/second in (7.258736,19.528419) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.84 GB 132.1 2.8 0.0 2.8 5.6 2.8 0.0 2.0 102.9 208.0 27.55 19.23 51 0.540 2878K 3108 0.0 0.0 L1 7/7 719.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 934.97 MB 0.9 2.6 1.8 0.9 2.6 1.7 0.1 1.5 99.3 98.0 27.27 12.46 8 3.409 784K 0 0.0 0.0 L4 158/0 9.77 GB 1.0 5.6 3.5 2.1 5.5 3.4 0.0 1.6 114.4 113.0 50.03 26.96 36 1.390 2801K 1406 0.0 0.0 L5 1124/0 92.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/21 107.80 GB 0.0 11.0 5.2 5.8 13.7 8.0 3.5 4.9 107.4 134.1 104.85 58.64 95 1.104 6464K 4514 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 5.2 5.8 13.7 8.0 3.5 4.9 107.4 134.1 104.85 58.64 95 1.104 6464K 4514 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 5.2 5.8 10.9 5.1 0.0 0.0 124.9 123.7 90.20 50.41 54 1.670 6464K 4514 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 197.7 14.66 8.23 41 0.357 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.7 total, 19.5 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.73 GB write, 715.08 MB/s write, 11.00 GB read, 573.01 MB/s read, 104.9 seconds Interval compaction: 13.73 GB write, 719.77 MB/s write, 11.00 GB read, 576.77 MB/s read, 104.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 38, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1233135 Average: 13.6695 StdDev: 121.59 Min: 0 Median: 1.5992 Max: 26073 Percentiles: P50: 1.60 P75: 2.22 P99: 238.47 P99.9: 1078.42 P99.99: 2063.97 ------------------------------------------------------ [ 0, 1 ] 209294 16.973% 16.973% ### ( 1, 2 ] 679645 55.115% 72.088% ########### ( 2, 3 ] 163783 13.282% 85.370% ### ( 3, 4 ] 63687 5.165% 90.534% # ( 4, 6 ] 54531 4.422% 94.956% # ( 6, 10 ] 12431 1.008% 95.964% ( 10, 15 ] 2459 0.199% 96.164% ( 15, 22 ] 301 0.024% 96.188% ( 22, 34 ] 28 0.002% 96.191% ( 34, 51 ] 30 0.002% 96.193% ( 51, 76 ] 28 0.002% 96.195% ( 76, 110 ] 6292 0.510% 96.705% ( 110, 170 ] 20564 1.668% 98.373% ( 170, 250 ] 9035 0.733% 99.106% ( 250, 380 ] 4119 0.334% 99.440% ( 380, 580 ] 3496 0.284% 99.723% ( 580, 870 ] 1717 0.139% 99.863% ( 870, 1300 ] 957 0.078% 99.940% ( 1300, 1900 ] 557 0.045% 99.985% ( 1900, 2900 ] 364 0.030% 100.015% ( 2900, 4400 ] 328 0.027% 100.041% ( 4400, 6600 ] 109 0.009% 100.050% ( 6600, 9900 ] 12 0.001% 100.051% ( 9900, 14000 ] 4 0.000% 100.052% ( 14000, 22000 ] 1 0.000% 100.052% ( 22000, 33000 ] 4 0.000% 100.052% ** Level 1 read latency histogram (micros): Count: 172896 Average: 6.8703 StdDev: 60.28 Min: 1 Median: 2.7656 Max: 5409 Percentiles: P50: 2.77 P75: 3.90 P99: 89.53 P99.9: 578.65 P99.99: 2828.36 ------------------------------------------------------ [ 0, 1 ] 3350 1.938% 1.938% ( 1, 2 ] 40841 23.622% 25.559% ##### ( 2, 3 ] 55196 31.924% 57.484% ###### ( 3, 4 ] 33736 19.512% 76.996% #### ( 4, 6 ] 28060 16.229% 93.225% ### ( 6, 10 ] 7632 4.414% 97.640% # ( 10, 15 ] 1587 0.918% 98.558% ( 15, 22 ] 601 0.348% 98.905% ( 22, 34 ] 49 0.028% 98.933% ( 34, 51 ] 5 0.003% 98.936% ( 51, 76 ] 2 0.001% 98.938% ( 76, 110 ] 274 0.158% 99.096% ( 110, 170 ] 782 0.452% 99.548% ( 170, 250 ] 338 0.195% 99.744% ( 250, 380 ] 139 0.080% 99.824% ( 380, 580 ] 133 0.077% 99.901% ( 580, 870 ] 76 0.044% 99.945% ( 870, 1300 ] 32 0.019% 99.964% ( 1300, 1900 ] 30 0.017% 99.981% ( 1900, 2900 ] 18 0.010% 99.991% ( 2900, 4400 ] 14 0.008% 99.999% ( 4400, 6600 ] 5 0.003% 100.002% ** Level 2 read latency histogram (micros): Count: 293668 Average: 12.2061 StdDev: 151.21 Min: 1 Median: 1.9178 Max: 10141 Percentiles: P50: 1.92 P75: 2.93 P99: 10.98 P99.9: 1361.90 P99.99: 1903.03 ------------------------------------------------------ [ 0, 1 ] 9741 3.317% 3.317% # ( 1, 2 ] 149368 50.863% 54.180% ########## ( 2, 3 ] 65972 22.465% 76.645% #### ( 3, 4 ] 29466 10.034% 86.678% ## ( 4, 6 ] 28137 9.581% 96.260% ## ( 6, 10 ] 7756 2.641% 98.901% # ( 10, 15 ] 1486 0.506% 99.407% ( 15, 22 ] 212 0.072% 99.479% ( 22, 34 ] 41 0.014% 99.493% ( 34, 51 ] 12 0.004% 99.497% ( 51, 76 ] 7 0.002% 99.499% ( 76, 110 ] 10 0.003% 99.503% ( 110, 170 ] 21 0.007% 99.510% ( 170, 250 ] 52 0.018% 99.528% ( 250, 380 ] 105 0.036% 99.563% ( 380, 580 ] 237 0.081% 99.644% ( 580, 870 ] 309 0.105% 99.749% ( 870, 1300 ] 412 0.140% 99.890% ( 1300, 1900 ] 294 0.100% 99.990% ( 1900, 2900 ] 209 0.071% 100.061% ( 2900, 4400 ] 173 0.059% 100.120% ( 4400, 6600 ] 59 0.020% 100.140% ( 6600, 9900 ] 6 0.002% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 867492 Average: 9.5340 StdDev: 146.60 Min: 1 Median: 1.9703 Max: 29501 Percentiles: P50: 1.97 P75: 2.97 P99: 9.63 P99.9: 243.75 P99.99: 552.26 ------------------------------------------------------ [ 0, 1 ] 16044 1.849% 1.849% ( 1, 2 ] 430492 49.625% 51.474% ########## ( 2, 3 ] 209493 24.149% 75.624% ##### ( 3, 4 ] 93950 10.830% 86.454% ## ( 4, 6 ] 91306 10.525% 96.979% ## ( 6, 10 ] 19345 2.230% 99.209% ( 10, 15 ] 3550 0.409% 99.618% ( 15, 22 ] 439 0.051% 99.669% ( 22, 34 ] 54 0.006% 99.675% ( 34, 51 ] 57 0.007% 99.682% ( 51, 76 ] 65 0.007% 99.689% ( 76, 110 ] 324 0.037% 99.726% ( 110, 170 ] 1063 0.123% 99.849% ( 170, 250 ] 480 0.055% 99.904% ( 250, 380 ] 335 0.039% 99.943% ( 380, 580 ] 474 0.055% 99.998% ( 580, 870 ] 640 0.074% 100.071% ( 870, 1300 ] 679 0.078% 100.150% ( 1300, 1900 ] 435 0.050% 100.200% ( 1900, 2900 ] 352 0.041% 100.240% ( 2900, 4400 ] 390 0.045% 100.285% ( 4400, 6600 ] 116 0.013% 100.299% ( 6600, 9900 ] 24 0.003% 100.301% ( 9900, 14000 ] 7 0.001% 100.302% ( 14000, 22000 ] 7 0.001% 100.303% ( 22000, 33000 ] 3 0.000% 100.303% ** Level 4 read latency histogram (micros): Count: 571333 Average: 28.3670 StdDev: 245.78 Min: 1 Median: 1.9859 Max: 29492 Percentiles: P50: 1.99 P75: 3.19 P99: 484.19 P99.9: 2128.12 P99.99: 2827.71 ------------------------------------------------------ [ 0, 1 ] 11512 2.015% 2.015% ( 1, 2 ] 278065 48.670% 50.684% ########## ( 2, 3 ] 128334 22.462% 73.147% #### ( 3, 4 ] 55575 9.727% 82.874% ## ( 4, 6 ] 54663 9.568% 92.442% ## ( 6, 10 ] 14406 2.521% 94.963% # ( 10, 15 ] 2463 0.431% 95.394% ( 15, 22 ] 310 0.054% 95.448% ( 22, 34 ] 29 0.005% 95.453% ( 34, 51 ] 30 0.005% 95.459% ( 51, 76 ] 44 0.008% 95.466% ( 76, 110 ] 3270 0.572% 96.039% ( 110, 170 ] 9951 1.742% 97.780% ( 170, 250 ] 3924 0.687% 98.467% ( 250, 380 ] 1920 0.336% 98.803% ( 380, 580 ] 2157 0.378% 99.181% ( 580, 870 ] 1678 0.294% 99.475% ( 870, 1300 ] 1373 0.240% 99.715% ( 1300, 1900 ] 890 0.156% 99.871% ( 1900, 2900 ] 735 0.129% 99.999% ( 2900, 4400 ] 726 0.127% 100.126% ( 4400, 6600 ] 286 0.050% 100.176% ( 6600, 9900 ] 47 0.008% 100.185% ( 9900, 14000 ] 10 0.002% 100.186% ( 14000, 22000 ] 8 0.001% 100.188% ( 22000, 33000 ] 2 0.000% 100.188% ** Level 5 read latency histogram (micros): Count: 149066 Average: 348.6065 StdDev: 683.29 Min: 73 Median: 159.0522 Max: 29687 Percentiles: P50: 159.05 P75: 254.36 P99: 3923.27 P99.9: 6599.81 P99.99: 9853.74 ------------------------------------------------------ ( 51, 76 ] 31 0.021% 0.021% ( 76, 110 ] 21582 14.478% 14.499% ### ( 110, 170 ] 64731 43.424% 57.923% ######### ( 170, 250 ] 25084 16.827% 74.751% ### ( 250, 380 ] 11087 7.438% 82.188% # ( 380, 580 ] 10414 6.986% 89.175% # ( 580, 870 ] 5756 3.861% 93.036% # ( 870, 1300 ] 3667 2.460% 95.496% ( 1300, 1900 ] 2186 1.466% 96.962% ( 1900, 2900 ] 1806 1.212% 98.174% ( 2900, 4400 ] 1805 1.211% 99.385% ( 4400, 6600 ] 768 0.515% 99.900% ( 6600, 9900 ] 136 0.091% 99.991% ( 9900, 14000 ] 12 0.008% 99.999% ( 14000, 22000 ] 6 0.004% 100.003% ( 22000, 33000 ] 5 0.003% 100.007% ** DB Stats ** Uptime(secs): 19.7 total, 7.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 150.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.314 H:M:S, 42.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 135.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.606 H:M:S, 49.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/19-20:14:09 ... thread 0: (1000000,4000000) ops and (188648.0,161100.0) ops/second in (5.300877,24.829296) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 3.74 GB 25.2 4.8 0.0 4.8 8.5 3.7 0.0 2.3 122.2 217.4 40.21 30.03 68 0.591 4987K 14K 0.0 0.0 L1 12/12 1.13 GB 0.0 1.7 1.0 0.7 1.7 1.0 0.0 1.7 87.2 86.6 20.14 10.34 1 20.145 1783K 12K 0.0 0.0 L2 1/0 72.70 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 899.01 MB 0.9 3.6 2.2 1.4 3.5 2.1 0.2 1.6 112.4 111.2 32.67 17.11 12 2.722 1371K 1903 0.0 0.0 L4 160/0 9.59 GB 1.0 6.7 4.0 2.7 6.7 3.9 0.0 1.7 119.7 118.1 57.69 32.32 43 1.342 3271K 1406 0.0 0.0 L5 1132/0 93.26 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/22 108.67 GB 0.0 16.8 7.2 9.7 20.4 10.8 4.8 5.4 114.4 138.8 150.71 89.80 124 1.215 11M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.8 7.2 9.7 20.4 10.8 4.8 5.4 114.4 138.8 150.71 89.80 124 1.215 11M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.8 7.2 9.7 16.7 7.0 0.0 0.0 130.5 129.3 132.16 78.82 69 1.915 11M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 207.2 18.55 10.98 55 0.337 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.0 total, 24.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.44 GB write, 838.43 MB/s write, 16.84 GB read, 690.83 MB/s read, 150.7 seconds Interval compaction: 20.44 GB write, 842.76 MB/s write, 16.84 GB read, 694.40 MB/s read, 150.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 42, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1565383 Average: 13.9227 StdDev: 117.74 Min: 0 Median: 1.6156 Max: 26073 Percentiles: P50: 1.62 P75: 2.27 P99: 243.80 P99.9: 1035.44 P99.99: 1860.70 ------------------------------------------------------ [ 0, 1 ] 248878 15.899% 15.899% ### ( 1, 2 ] 867198 55.398% 71.297% ########### ( 2, 3 ] 213572 13.643% 84.941% ### ( 3, 4 ] 83912 5.360% 90.301% # ( 4, 6 ] 70223 4.486% 94.787% # ( 6, 10 ] 15787 1.009% 95.796% ( 10, 15 ] 2999 0.192% 95.987% ( 15, 22 ] 359 0.023% 96.010% ( 22, 34 ] 38 0.002% 96.013% ( 34, 51 ] 36 0.002% 96.015% ( 51, 76 ] 40 0.003% 96.018% ( 76, 110 ] 8203 0.524% 96.542% ( 110, 170 ] 27441 1.753% 98.295% ( 170, 250 ] 11971 0.765% 99.059% ( 250, 380 ] 5575 0.356% 99.415% ( 380, 580 ] 4751 0.304% 99.719% ( 580, 870 ] 2351 0.150% 99.869% ( 870, 1300 ] 1257 0.080% 99.949% ( 1300, 1900 ] 680 0.043% 99.993% ( 1900, 2900 ] 426 0.027% 100.020% ( 2900, 4400 ] 378 0.024% 100.044% ( 4400, 6600 ] 126 0.008% 100.052% ( 6600, 9900 ] 18 0.001% 100.053% ( 9900, 14000 ] 5 0.000% 100.054% ( 14000, 22000 ] 1 0.000% 100.054% ( 22000, 33000 ] 4 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 286824 Average: 7.1149 StdDev: 77.26 Min: 1 Median: 2.4282 Max: 18552 Percentiles: P50: 2.43 P75: 3.57 P99: 104.23 P99.9: 608.96 P99.99: 1370.90 ------------------------------------------------------ [ 0, 1 ] 5872 2.047% 2.047% ( 1, 2 ] 102382 35.695% 37.742% ####### ( 2, 3 ] 82102 28.625% 66.367% ###### ( 3, 4 ] 43377 15.123% 81.490% ### ( 4, 6 ] 36819 12.837% 94.327% ### ( 6, 10 ] 10314 3.596% 97.923% # ( 10, 15 ] 1994 0.695% 98.618% ( 15, 22 ] 680 0.237% 98.855% ( 22, 34 ] 55 0.019% 98.874% ( 34, 51 ] 10 0.003% 98.878% ( 51, 76 ] 7 0.002% 98.880% ( 76, 110 ] 414 0.144% 99.024% ( 110, 170 ] 1243 0.433% 99.458% ( 170, 250 ] 589 0.205% 99.663% ( 250, 380 ] 339 0.118% 99.781% ( 380, 580 ] 321 0.112% 99.893% ( 580, 870 ] 192 0.067% 99.960% ( 870, 1300 ] 80 0.028% 99.988% ( 1300, 1900 ] 45 0.016% 100.004% ( 1900, 2900 ] 22 0.008% 100.012% ( 2900, 4400 ] 24 0.008% 100.020% ( 4400, 6600 ] 5 0.002% 100.022% ( 6600, 9900 ] 2 0.001% 100.022% ( 14000, 22000 ] 2 0.001% 100.023% ** Level 2 read latency histogram (micros): Count: 293668 Average: 12.2061 StdDev: 151.21 Min: 1 Median: 1.9178 Max: 10141 Percentiles: P50: 1.92 P75: 2.93 P99: 10.98 P99.9: 1361.90 P99.99: 1903.03 ------------------------------------------------------ [ 0, 1 ] 9741 3.317% 3.317% # ( 1, 2 ] 149368 50.863% 54.180% ########## ( 2, 3 ] 65972 22.465% 76.645% #### ( 3, 4 ] 29466 10.034% 86.678% ## ( 4, 6 ] 28137 9.581% 96.260% ## ( 6, 10 ] 7756 2.641% 98.901% # ( 10, 15 ] 1486 0.506% 99.407% ( 15, 22 ] 212 0.072% 99.479% ( 22, 34 ] 41 0.014% 99.493% ( 34, 51 ] 12 0.004% 99.497% ( 51, 76 ] 7 0.002% 99.499% ( 76, 110 ] 10 0.003% 99.503% ( 110, 170 ] 21 0.007% 99.510% ( 170, 250 ] 52 0.018% 99.528% ( 250, 380 ] 105 0.036% 99.563% ( 380, 580 ] 237 0.081% 99.644% ( 580, 870 ] 309 0.105% 99.749% ( 870, 1300 ] 412 0.140% 99.890% ( 1300, 1900 ] 294 0.100% 99.990% ( 1900, 2900 ] 209 0.071% 100.061% ( 2900, 4400 ] 173 0.059% 100.120% ( 4400, 6600 ] 59 0.020% 100.140% ( 6600, 9900 ] 6 0.002% 100.142% ( 9900, 14000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1146802 Average: 8.4161 StdDev: 133.12 Min: 1 Median: 1.9338 Max: 29501 Percentiles: P50: 1.93 P75: 2.92 P99: 9.52 P99.9: 218.72 P99.99: 476.93 ------------------------------------------------------ [ 0, 1 ] 27734 2.418% 2.418% ( 1, 2 ] 584363 50.956% 53.374% ########## ( 2, 3 ] 270733 23.608% 76.982% ##### ( 3, 4 ] 117053 10.207% 87.189% ## ( 4, 6 ] 113488 9.896% 97.085% ## ( 6, 10 ] 24927 2.174% 99.258% ( 10, 15 ] 4552 0.397% 99.655% ( 15, 22 ] 539 0.047% 99.702% ( 22, 34 ] 61 0.005% 99.708% ( 34, 51 ] 72 0.006% 99.714% ( 51, 76 ] 89 0.008% 99.722% ( 76, 110 ] 375 0.033% 99.754% ( 110, 170 ] 1288 0.112% 99.867% ( 170, 250 ] 626 0.055% 99.921% ( 250, 380 ] 482 0.042% 99.963% ( 380, 580 ] 630 0.055% 100.018% ( 580, 870 ] 779 0.068% 100.086% ( 870, 1300 ] 767 0.067% 100.153% ( 1300, 1900 ] 464 0.040% 100.194% ( 1900, 2900 ] 370 0.032% 100.226% ( 2900, 4400 ] 410 0.036% 100.262% ( 4400, 6600 ] 117 0.010% 100.272% ( 6600, 9900 ] 28 0.002% 100.274% ( 9900, 14000 ] 7 0.001% 100.275% ( 14000, 22000 ] 9 0.001% 100.276% ( 22000, 33000 ] 3 0.000% 100.276% ** Level 4 read latency histogram (micros): Count: 741903 Average: 26.8221 StdDev: 234.10 Min: 1 Median: 1.9533 Max: 29492 Percentiles: P50: 1.95 P75: 3.10 P99: 449.19 P99.9: 1851.26 P99.99: 2618.25 ------------------------------------------------------ [ 0, 1 ] 21986 2.963% 2.963% # ( 1, 2 ] 366052 49.340% 52.303% ########## ( 2, 3 ] 161404 21.755% 74.058% #### ( 3, 4 ] 68842 9.279% 83.338% ## ( 4, 6 ] 67678 9.122% 92.460% ## ( 6, 10 ] 18431 2.484% 94.944% ( 10, 15 ] 3267 0.440% 95.384% ( 15, 22 ] 387 0.052% 95.437% ( 22, 34 ] 38 0.005% 95.442% ( 34, 51 ] 37 0.005% 95.447% ( 51, 76 ] 54 0.007% 95.454% ( 76, 110 ] 4120 0.555% 96.009% ( 110, 170 ] 12916 1.741% 97.750% ( 170, 250 ] 5384 0.726% 98.476% ( 250, 380 ] 2854 0.385% 98.861% ( 380, 580 ] 2989 0.403% 99.264% ( 580, 870 ] 2175 0.293% 99.557% ( 870, 1300 ] 1632 0.220% 99.777% ( 1300, 1900 ] 996 0.134% 99.911% ( 1900, 2900 ] 817 0.110% 100.021% ( 2900, 4400 ] 838 0.113% 100.134% ( 4400, 6600 ] 333 0.045% 100.179% ( 6600, 9900 ] 62 0.008% 100.187% ( 9900, 14000 ] 12 0.002% 100.189% ( 14000, 22000 ] 8 0.001% 100.190% ( 22000, 33000 ] 3 0.000% 100.190% ** Level 5 read latency histogram (micros): Count: 195106 Average: 338.0308 StdDev: 638.17 Min: 73 Median: 160.9025 Max: 29687 Percentiles: P50: 160.90 P75: 271.74 P99: 3679.36 P99.9: 6524.22 P99.99: 9844.77 ------------------------------------------------------ ( 51, 76 ] 35 0.018% 0.018% ( 76, 110 ] 26957 13.817% 13.835% ### ( 110, 170 ] 83172 42.629% 56.464% ######### ( 170, 250 ] 33534 17.188% 73.651% ### ( 250, 380 ] 15739 8.067% 81.718% ## ( 380, 580 ] 14632 7.500% 89.218% # ( 580, 870 ] 8326 4.267% 93.485% # ( 870, 1300 ] 4975 2.550% 96.035% # ( 1300, 1900 ] 2624 1.345% 97.380% ( 1900, 2900 ] 2114 1.084% 98.463% ( 2900, 4400 ] 2015 1.033% 99.496% ( 4400, 6600 ] 816 0.418% 99.914% ( 6600, 9900 ] 150 0.077% 99.991% ( 9900, 14000 ] 14 0.007% 99.998% ( 14000, 22000 ] 7 0.004% 100.002% ( 22000, 33000 ] 6 0.003% 100.005% ** DB Stats ** Uptime(secs): 25.0 total, 5.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 157.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.804 H:M:S, 39.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 185.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.490 H:M:S, 28.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 232.860 micros/op 17164 ops/sec 60.125 seconds 1031996 operations; 16.6 MB/s (255999 of 255999 found) Microseconds per read: Count: 1031996 Average: 232.8628 StdDev: 662.49 Min: 2 Median: 167.3168 Max: 67257 Percentiles: P50: 167.32 P75: 225.75 P99: 1175.74 P99.9: 10271.12 P99.99: 28543.62 ------------------------------------------------------ ( 1, 2 ] 5 0.000% 0.000% ( 2, 3 ] 44 0.004% 0.005% ( 3, 4 ] 61 0.006% 0.011% ( 4, 6 ] 82 0.008% 0.019% ( 6, 10 ] 312 0.030% 0.049% ( 10, 15 ] 3165 0.307% 0.356% ( 15, 22 ] 5762 0.558% 0.914% ( 22, 34 ] 11076 1.073% 1.987% ( 34, 51 ] 3722 0.361% 2.348% ( 51, 76 ] 381 0.037% 2.385% ( 76, 110 ] 21009 2.036% 4.420% ( 110, 170 ] 492399 47.713% 52.134% ########## ( 170, 250 ] 338631 32.813% 84.947% ####### ( 250, 380 ] 90595 8.779% 93.726% ## ( 380, 580 ] 35168 3.408% 97.133% # ( 580, 870 ] 14626 1.417% 98.551% ( 870, 1300 ] 6523 0.632% 99.183% ( 1300, 1900 ] 2960 0.287% 99.469% ( 1900, 2900 ] 1915 0.186% 99.655% ( 2900, 4400 ] 1518 0.147% 99.802% ( 4400, 6600 ] 617 0.060% 99.862% ( 6600, 9900 ] 352 0.034% 99.896% ( 9900, 14000 ] 453 0.044% 99.940% ( 14000, 22000 ] 424 0.041% 99.981% ( 22000, 33000 ] 156 0.015% 99.996% ( 33000, 50000 ] 34 0.003% 99.999% ( 50000, 75000 ] 6 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15815580 rocksdb.bloom.filter.full.positive COUNT : 1185955 rocksdb.bloom.filter.full.true.positive COUNT : 1031586 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 410 rocksdb.memtable.miss COUNT : 1031586 rocksdb.l0.hit COUNT : 40555 rocksdb.l1.hit COUNT : 10853 rocksdb.l2andup.hit COUNT : 980178 rocksdb.compaction.key.drop.new COUNT : 175536 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4328252 rocksdb.number.keys.read COUNT : 1031996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4466756064 rocksdb.bytes.read COUNT : 1031996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1565 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43070580 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19741322090 rocksdb.compact.write.bytes COUNT : 19554247283 rocksdb.flush.write.bytes COUNT : 4425887195 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 885 rocksdb.number.superversion_releases COUNT : 851 rocksdb.number.superversion_cleanups COUNT : 219 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 205 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4390176768 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1689600 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23570737410 rocksdb.non.last.level.read.count COUNT : 5552395 rocksdb.block.checksum.compute.count COUNT : 5976756 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 166.339293 P95 : 453.226694 P99 : 1174.847961 P100 : 67256.000000 COUNT : 1031996 SUM : 239360891 rocksdb.db.write.micros P50 : 1.574435 P95 : 4.790118 P99 : 11.931595 P100 : 1046789.000000 COUNT : 4328252 SUM : 54387228 rocksdb.compaction.times.micros P50 : 1162812.500000 P95 : 3938333.333333 P99 : 16320000.000000 P100 : 20144560.000000 COUNT : 71 SUM : 134442143 rocksdb.compaction.times.cpu_micros P50 : 888333.333333 P95 : 1875937.500000 P99 : 10343492.000000 P100 : 10343492.000000 COUNT : 71 SUM : 80974933 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 799.838710 P95 : 97750.000000 P99 : 195391.000000 P100 : 195391.000000 COUNT : 61 SUM : 919269 rocksdb.compaction.outfile.sync.micros P50 : 38100.000000 P95 : 359416.666667 P99 : 678177.000000 P100 : 678177.000000 COUNT : 218 SUM : 17955257 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 210.000000 P95 : 3487.500000 P99 : 6211.333333 P100 : 7788.000000 COUNT : 153 SUM : 127271 rocksdb.table.open.io.micros P50 : 8617.451820 P95 : 19732.673267 P99 : 25461.764706 P100 : 37281.000000 COUNT : 1565 SUM : 13864365 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.980787 P95 : 79.340426 P99 : 189.077052 P100 : 29506.000000 COUNT : 4779382 SUM : 81316386 rocksdb.read.block.get.micros P50 : 137.974047 P95 : 334.481093 P99 : 1100.383039 P100 : 29692.000000 COUNT : 1195810 SUM : 203934241 rocksdb.write.raw.block.micros P50 : 0.538995 P95 : 1.436528 P99 : 3.713636 P100 : 37054.000000 COUNT : 5808023 SUM : 17633561 rocksdb.numfiles.in.singlecompaction P50 : 2.710526 P95 : 5.175000 P99 : 15.490000 P100 : 22.000000 COUNT : 93 SUM : 315 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.575165 P95 : 1273.062739 P99 : 2677.197988 P100 : 1046623.000000 COUNT : 205197 SUM : 43088908 rocksdb.sst.read.micros P50 : 2.285938 P95 : 167.287271 P99 : 467.895931 P100 : 29687.000000 COUNT : 5552453 SUM : 266206695 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1031996 SUM : 1031996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4328252 SUM : 4466756064 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226190.476190 P95 : 967666.666667 P99 : 1277532.000000 P100 : 1277532.000000 COUNT : 61 SUM : 19827497 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 230 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0