[2024-07-15 16:16:58.163146] Starting SPDK v24.09-pre git sha1 e3e9553ac / DPDK 24.03.0 initialization... [2024-07-15 16:16:58.163479] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2451858 ] Set seed to 1721053018155868 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 16:16:58.304260] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 16:16:58.516308] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 16:16:58.516357] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2451858' to capture a snapshot of events at runtime. [2024-07-15 16:16:58.516370] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 16:16:58.516383] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 16:16:58.516393] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2451858 for offline analysis/debug. [2024-07-15 16:16:58.516498] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 16:17:02 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-16:17:08 ... thread 0: (1000000,1000000) ops and (166385.7,166385.7) ops/second in (6.010133,6.010133) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.07 GB 37.6 0.2 0.0 0.2 1.1 0.9 0.0 1.3 36.5 163.8 6.90 3.64 12 0.575 255K 1295 0.0 0.0 L1 8/8 997.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 85.16 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/3 1.10 GB 1.0 1.9 1.1 0.8 1.8 1.0 0.0 1.6 123.6 118.1 15.72 9.48 8 1.965 1243K 9947 0.0 0.0 L4 142/10 10.36 GB 1.0 2.9 1.8 1.2 2.8 1.6 0.2 1.6 132.8 126.5 22.53 13.91 14 1.609 783K 0 0.0 0.0 L5 136/0 10.52 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 321/32 24.10 GB 0.0 5.1 2.9 2.2 5.7 3.5 1.1 6.6 114.9 129.3 45.15 27.03 34 1.328 2282K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 2.9 2.2 5.7 3.5 1.1 6.6 114.9 129.3 45.15 27.03 34 1.328 2282K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 2.9 2.2 4.8 2.7 0.0 0.0 130.6 124.8 39.72 24.50 23 1.727 2282K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 162.1 5.43 2.54 11 0.494 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.70 GB write, 957.22 MB/s write, 5.07 GB read, 850.47 MB/s read, 45.2 seconds Interval compaction: 5.70 GB write, 970.21 MB/s write, 5.07 GB read, 862.01 MB/s read, 45.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 74780 Average: 88.0765 StdDev: 472.77 Min: 1 Median: 2.3649 Max: 51629 Percentiles: P50: 2.36 P75: 3.78 P99: 1684.09 P99.9: 4818.34 P99.99: 10939.96 ------------------------------------------------------ [ 0, 1 ] 1047 1.400% 1.400% ( 1, 2 ] 28807 38.522% 39.922% ######## ( 2, 3 ] 20655 27.621% 67.543% ###### ( 3, 4 ] 7112 9.511% 77.054% ## ( 4, 6 ] 7540 10.083% 87.137% ## ( 6, 10 ] 1674 2.239% 89.376% ( 10, 15 ] 245 0.328% 89.703% ( 15, 22 ] 16 0.021% 89.725% ( 22, 34 ] 11 0.015% 89.739% ( 34, 51 ] 5 0.007% 89.746% ( 51, 76 ] 4 0.005% 89.751% ( 76, 110 ] 4 0.005% 89.757% ( 110, 170 ] 94 0.126% 89.882% ( 170, 250 ] 533 0.713% 90.595% ( 250, 380 ] 1359 1.817% 92.412% ( 380, 580 ] 2371 3.171% 95.583% # ( 580, 870 ] 1815 2.427% 98.010% ( 870, 1300 ] 617 0.825% 98.835% ( 1300, 1900 ] 194 0.259% 99.095% ( 1900, 2900 ] 266 0.356% 99.450% ( 2900, 4400 ] 326 0.436% 99.886% ( 4400, 6600 ] 59 0.079% 99.965% ( 6600, 9900 ] 18 0.024% 99.989% ( 9900, 14000 ] 6 0.008% 99.997% ( 14000, 22000 ] 5 0.007% 100.004% ( 22000, 33000 ] 1 0.001% 100.005% ( 50000, 75000 ] 1 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 195241 Average: 14.9472 StdDev: 199.08 Min: 1 Median: 2.3232 Max: 30577 Percentiles: P50: 2.32 P75: 3.33 P99: 206.96 P99.9: 2908.07 P99.99: 6453.87 ------------------------------------------------------ [ 0, 1 ] 1123 0.575% 0.575% ( 1, 2 ] 76560 39.213% 39.788% ######## ( 2, 3 ] 61684 31.594% 71.382% ###### ( 3, 4 ] 21734 11.132% 82.514% ## ( 4, 6 ] 24905 12.756% 95.270% ### ( 6, 10 ] 5743 2.941% 98.211% # ( 10, 15 ] 1214 0.622% 98.833% ( 15, 22 ] 138 0.071% 98.904% ( 22, 34 ] 33 0.017% 98.921% ( 34, 51 ] 47 0.024% 98.945% ( 51, 76 ] 29 0.015% 98.960% ( 76, 110 ] 11 0.006% 98.965% ( 110, 170 ] 20 0.010% 98.976% ( 170, 250 ] 103 0.053% 99.028% ( 250, 380 ] 305 0.156% 99.185% ( 380, 580 ] 523 0.268% 99.452% ( 580, 870 ] 427 0.219% 99.671% ( 870, 1300 ] 220 0.113% 99.784% ( 1300, 1900 ] 96 0.049% 99.833% ( 1900, 2900 ] 130 0.067% 99.900% ( 2900, 4400 ] 141 0.072% 99.972% ( 4400, 6600 ] 38 0.019% 99.991% ( 6600, 9900 ] 16 0.008% 99.999% ( 9900, 14000 ] 3 0.002% 100.001% ( 14000, 22000 ] 1 0.001% 100.002% ( 22000, 33000 ] 2 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 226119 Average: 11.6689 StdDev: 173.81 Min: 1 Median: 2.2374 Max: 20425 Percentiles: P50: 2.24 P75: 3.20 P99: 12.52 P99.9: 1873.71 P99.99: 3667.59 ------------------------------------------------------ [ 0, 1 ] 2183 0.965% 0.965% ( 1, 2 ] 94830 41.938% 42.904% ######## ( 2, 3 ] 67601 29.896% 72.800% ###### ( 3, 4 ] 24830 10.981% 83.781% ## ( 4, 6 ] 27173 12.017% 95.798% ## ( 6, 10 ] 6539 2.892% 98.690% # ( 10, 15 ] 1390 0.615% 99.304% ( 15, 22 ] 204 0.090% 99.395% ( 22, 34 ] 59 0.026% 99.421% ( 34, 51 ] 67 0.030% 99.450% ( 51, 76 ] 35 0.015% 99.466% ( 76, 110 ] 12 0.005% 99.471% ( 110, 170 ] 15 0.007% 99.478% ( 170, 250 ] 38 0.017% 99.495% ( 250, 380 ] 171 0.076% 99.570% ( 380, 580 ] 283 0.125% 99.695% ( 580, 870 ] 258 0.114% 99.809% ( 870, 1300 ] 115 0.051% 99.860% ( 1300, 1900 ] 94 0.042% 99.902% ( 1900, 2900 ] 117 0.052% 99.954% ( 2900, 4400 ] 161 0.071% 100.025% ( 4400, 6600 ] 34 0.015% 100.040% ( 6600, 9900 ] 18 0.008% 100.048% ( 9900, 14000 ] 6 0.003% 100.050% ( 14000, 22000 ] 2 0.001% 100.051% ** Level 3 read latency histogram (micros): Count: 513331 Average: 12.2761 StdDev: 178.76 Min: 1 Median: 2.3114 Max: 42921 Percentiles: P50: 2.31 P75: 3.26 P99: 13.46 P99.9: 884.34 P99.99: 1397.78 ------------------------------------------------------ [ 0, 1 ] 3280 0.639% 0.639% ( 1, 2 ] 202231 39.396% 40.035% ######## ( 2, 3 ] 164295 32.006% 72.040% ###### ( 3, 4 ] 58696 11.434% 83.475% ## ( 4, 6 ] 63183 12.308% 95.783% ## ( 6, 10 ] 14686 2.861% 98.644% # ( 10, 15 ] 2641 0.514% 99.159% ( 15, 22 ] 326 0.064% 99.222% ( 22, 34 ] 111 0.022% 99.244% ( 34, 51 ] 168 0.033% 99.276% ( 51, 76 ] 83 0.016% 99.293% ( 76, 110 ] 38 0.007% 99.300% ( 110, 170 ] 47 0.009% 99.309% ( 170, 250 ] 199 0.039% 99.348% ( 250, 380 ] 636 0.124% 99.472% ( 380, 580 ] 1178 0.229% 99.701% ( 580, 870 ] 1006 0.196% 99.897% ( 870, 1300 ] 440 0.086% 99.983% ( 1300, 1900 ] 225 0.044% 100.027% ( 1900, 2900 ] 249 0.049% 100.075% ( 2900, 4400 ] 292 0.057% 100.132% ( 4400, 6600 ] 57 0.011% 100.143% ( 6600, 9900 ] 21 0.004% 100.147% ( 9900, 14000 ] 3 0.001% 100.148% ( 14000, 22000 ] 3 0.001% 100.149% ( 22000, 33000 ] 4 0.001% 100.149% ( 33000, 50000 ] 1 0.000% 100.150% ** Level 4 read latency histogram (micros): Count: 427508 Average: 29.7378 StdDev: 276.58 Min: 1 Median: 2.3539 Max: 51148 Percentiles: P50: 2.35 P75: 3.43 P99: 657.63 P99.9: 2033.38 P99.99: 2713.16 ------------------------------------------------------ [ 0, 1 ] 2644 0.618% 0.618% ( 1, 2 ] 164346 38.443% 39.061% ######## ( 2, 3 ] 132146 30.911% 69.972% ###### ( 3, 4 ] 49707 11.627% 81.599% ## ( 4, 6 ] 52809 12.353% 93.952% ## ( 6, 10 ] 12084 2.827% 96.779% # ( 10, 15 ] 2190 0.512% 97.291% ( 15, 22 ] 222 0.052% 97.343% ( 22, 34 ] 79 0.018% 97.361% ( 34, 51 ] 113 0.026% 97.388% ( 51, 76 ] 81 0.019% 97.407% ( 76, 110 ] 14 0.003% 97.410% ( 110, 170 ] 113 0.026% 97.436% ( 170, 250 ] 637 0.149% 97.585% ( 250, 380 ] 1799 0.421% 98.006% ( 380, 580 ] 3472 0.812% 98.818% ( 580, 870 ] 2906 0.680% 99.498% ( 870, 1300 ] 1194 0.279% 99.777% ( 1300, 1900 ] 450 0.105% 99.883% ( 1900, 2900 ] 566 0.132% 100.015% ( 2900, 4400 ] 660 0.154% 100.169% ( 4400, 6600 ] 135 0.032% 100.201% ( 6600, 9900 ] 25 0.006% 100.207% ( 9900, 14000 ] 8 0.002% 100.209% ( 14000, 22000 ] 9 0.002% 100.211% ( 22000, 33000 ] 5 0.001% 100.212% ( 33000, 50000 ] 2 0.000% 100.212% ( 50000, 75000 ] 1 0.000% 100.213% ** Level 5 read latency histogram (micros): Count: 9400 Average: 891.0147 StdDev: 1359.07 Min: 107 Median: 572.0596 Max: 55012 Percentiles: P50: 572.06 P75: 853.73 P99: 4877.11 P99.9: 17600.00 P99.99: 51500.00 ------------------------------------------------------ ( 76, 110 ] 1 0.011% 0.011% ( 110, 170 ] 83 0.883% 0.894% ( 170, 250 ] 439 4.670% 5.564% # ( 250, 380 ] 1468 15.617% 21.181% ### ( 380, 580 ] 2822 30.021% 51.202% ###### ( 580, 870 ] 2371 25.223% 76.426% ##### ( 870, 1300 ] 975 10.372% 86.798% ## ( 1300, 1900 ] 355 3.777% 90.574% # ( 1900, 2900 ] 354 3.766% 94.340% # ( 2900, 4400 ] 421 4.479% 98.819% # ( 4400, 6600 ] 83 0.883% 99.702% ( 6600, 9900 ] 13 0.138% 99.840% ( 9900, 14000 ] 3 0.032% 99.872% ( 14000, 22000 ] 8 0.085% 99.957% ( 22000, 33000 ] 3 0.032% 99.989% ( 33000, 50000 ] 1 0.011% 100.000% ( 50000, 75000 ] 1 0.011% 100.011% ** DB Stats ** Uptime(secs): 6.1 total, 6.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 161.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.354 H:M:S, 22.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 163.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.354 H:M:S, 22.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/07/15-16:17:12 ... thread 0: (1000000,2000000) ops and (227915.7,192349.8) ops/second in (4.387588,10.397721) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.05 GB 150.3 1.1 0.0 1.1 2.9 1.8 0.0 1.6 74.4 198.0 15.21 10.14 30 0.507 1149K 6262 0.0 0.0 L2 1/0 1.71 MB 0.0 1.1 1.0 0.1 1.0 1.0 0.0 1.1 149.8 147.6 7.23 5.10 1 7.227 1099K 16K 0.0 0.0 L3 21/3 1.21 GB 1.0 2.5 1.7 0.8 2.4 1.6 0.5 1.4 130.7 125.9 19.68 12.61 10 1.968 1852K 9947 0.0 0.0 L4 143/9 9.97 GB 1.0 5.3 2.4 2.8 4.8 2.0 0.4 2.0 149.8 136.4 35.95 24.02 23 1.563 1553K 3224 0.0 0.0 L5 148/0 11.50 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 331/22 24.73 GB 0.0 9.9 5.1 4.8 11.2 6.4 2.8 6.1 130.3 146.8 78.08 51.87 64 1.220 5654K 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.9 5.1 4.8 11.2 6.4 2.8 6.1 130.3 146.8 78.08 51.87 64 1.220 5654K 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.9 5.1 4.8 9.4 4.5 0.0 0.0 148.6 139.9 68.44 46.50 38 1.801 5654K 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 195.9 9.63 5.37 26 0.370 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.5 total, 10.4 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.19 GB write, 1093.12 MB/s write, 9.93 GB read, 970.16 MB/s read, 78.1 seconds Interval compaction: 11.19 GB write, 1101.70 MB/s write, 9.93 GB read, 977.77 MB/s read, 78.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 349126 Average: 40.6404 StdDev: 283.55 Min: 1 Median: 1.9506 Max: 51629 Percentiles: P50: 1.95 P75: 2.94 P99: 766.61 P99.9: 3326.87 P99.99: 4292.69 ------------------------------------------------------ [ 0, 1 ] 12982 3.718% 3.718% # ( 1, 2 ] 169981 48.688% 52.406% ########## ( 2, 3 ] 84099 24.088% 76.494% ##### ( 3, 4 ] 26687 7.644% 84.138% ## ( 4, 6 ] 25883 7.414% 91.552% # ( 6, 10 ] 5701 1.633% 93.185% ( 10, 15 ] 730 0.209% 93.394% ( 15, 22 ] 56 0.016% 93.410% ( 22, 34 ] 21 0.006% 93.416% ( 34, 51 ] 9 0.003% 93.419% ( 51, 76 ] 12 0.003% 93.422% ( 76, 110 ] 33 0.009% 93.432% ( 110, 170 ] 1148 0.329% 93.760% ( 170, 250 ] 5126 1.468% 95.229% ( 250, 380 ] 5596 1.603% 96.832% ( 380, 580 ] 5435 1.557% 98.388% ( 580, 870 ] 3319 0.951% 99.339% ( 870, 1300 ] 1054 0.302% 99.641% ( 1300, 1900 ] 303 0.087% 99.728% ( 1900, 2900 ] 463 0.133% 99.860% ( 2900, 4400 ] 488 0.140% 100.000% ( 4400, 6600 ] 82 0.023% 100.023% ( 6600, 9900 ] 20 0.006% 100.029% ( 9900, 14000 ] 13 0.004% 100.033% ( 14000, 22000 ] 6 0.002% 100.035% ( 22000, 33000 ] 4 0.001% 100.036% ( 33000, 50000 ] 1 0.000% 100.036% ( 50000, 75000 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 255181 Average: 13.0079 StdDev: 175.30 Min: 1 Median: 2.2092 Max: 30577 Percentiles: P50: 2.21 P75: 3.07 P99: 199.97 P99.9: 2450.89 P99.99: 6048.95 ------------------------------------------------------ [ 0, 1 ] 2190 0.858% 0.858% ( 1, 2 ] 108998 42.714% 43.572% ######### ( 2, 3 ] 78421 30.732% 74.304% ###### ( 3, 4 ] 25506 9.995% 84.299% ## ( 4, 6 ] 28497 11.167% 95.466% ## ( 6, 10 ] 7089 2.778% 98.244% # ( 10, 15 ] 1336 0.524% 98.768% ( 15, 22 ] 152 0.060% 98.827% ( 22, 34 ] 35 0.014% 98.841% ( 34, 51 ] 49 0.019% 98.860% ( 51, 76 ] 32 0.013% 98.873% ( 76, 110 ] 13 0.005% 98.878% ( 110, 170 ] 131 0.051% 98.929% ( 170, 250 ] 481 0.188% 99.118% ( 250, 380 ] 537 0.210% 99.328% ( 380, 580 ] 616 0.241% 99.570% ( 580, 870 ] 449 0.176% 99.746% ( 870, 1300 ] 222 0.087% 99.833% ( 1300, 1900 ] 98 0.038% 99.871% ( 1900, 2900 ] 134 0.053% 99.924% ( 2900, 4400 ] 141 0.055% 99.979% ( 4400, 6600 ] 38 0.015% 99.994% ( 6600, 9900 ] 16 0.006% 100.000% ( 9900, 14000 ] 3 0.001% 100.001% ( 14000, 22000 ] 1 0.000% 100.002% ( 22000, 33000 ] 2 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 496388 Average: 9.6463 StdDev: 154.30 Min: 1 Median: 2.2721 Max: 23033 Percentiles: P50: 2.27 P75: 3.17 P99: 10.97 P99.9: 815.69 P99.99: 1839.43 ------------------------------------------------------ [ 0, 1 ] 3373 0.680% 0.680% ( 1, 2 ] 201824 40.659% 41.338% ######## ( 2, 3 ] 158028 31.836% 73.174% ###### ( 3, 4 ] 54377 10.955% 84.128% ## ( 4, 6 ] 59297 11.946% 96.074% ## ( 6, 10 ] 14036 2.828% 98.901% # ( 10, 15 ] 2524 0.508% 99.410% ( 15, 22 ] 334 0.067% 99.477% ( 22, 34 ] 87 0.018% 99.495% ( 34, 51 ] 142 0.029% 99.523% ( 51, 76 ] 76 0.015% 99.539% ( 76, 110 ] 27 0.005% 99.544% ( 110, 170 ] 57 0.011% 99.556% ( 170, 250 ] 234 0.047% 99.603% ( 250, 380 ] 457 0.092% 99.695% ( 380, 580 ] 609 0.123% 99.817% ( 580, 870 ] 504 0.102% 99.919% ( 870, 1300 ] 222 0.045% 99.964% ( 1300, 1900 ] 145 0.029% 99.993% ( 1900, 2900 ] 189 0.038% 100.031% ( 2900, 4400 ] 212 0.043% 100.074% ( 4400, 6600 ] 46 0.009% 100.083% ( 6600, 9900 ] 26 0.005% 100.088% ( 9900, 14000 ] 11 0.002% 100.090% ( 14000, 22000 ] 7 0.001% 100.092% ( 22000, 33000 ] 1 0.000% 100.092% ** Level 3 read latency histogram (micros): Count: 611693 Average: 12.9284 StdDev: 180.77 Min: 1 Median: 2.2926 Max: 42921 Percentiles: P50: 2.29 P75: 3.23 P99: 130.71 P99.9: 927.37 P99.99: 1532.64 ------------------------------------------------------ [ 0, 1 ] 4452 0.728% 0.728% ( 1, 2 ] 244545 39.978% 40.706% ######## ( 2, 3 ] 194278 31.761% 72.467% ###### ( 3, 4 ] 68507 11.200% 83.666% ## ( 4, 6 ] 73069 11.945% 95.612% ## ( 6, 10 ] 16817 2.749% 98.361% # ( 10, 15 ] 3001 0.491% 98.852% ( 15, 22 ] 374 0.061% 98.913% ( 22, 34 ] 122 0.020% 98.933% ( 34, 51 ] 199 0.033% 98.965% ( 51, 76 ] 98 0.016% 98.981% ( 76, 110 ] 44 0.007% 98.989% ( 110, 170 ] 203 0.033% 99.022% ( 170, 250 ] 889 0.145% 99.167% ( 250, 380 ] 1353 0.221% 99.388% ( 380, 580 ] 1779 0.291% 99.679% ( 580, 870 ] 1281 0.209% 99.889% ( 870, 1300 ] 527 0.086% 99.975% ( 1300, 1900 ] 242 0.040% 100.014% ( 1900, 2900 ] 288 0.047% 100.061% ( 2900, 4400 ] 322 0.053% 100.114% ( 4400, 6600 ] 63 0.010% 100.124% ( 6600, 9900 ] 22 0.004% 100.128% ( 9900, 14000 ] 6 0.001% 100.129% ( 14000, 22000 ] 3 0.000% 100.129% ( 22000, 33000 ] 6 0.001% 100.130% ( 33000, 50000 ] 1 0.000% 100.130% ** Level 4 read latency histogram (micros): Count: 862802 Average: 25.2482 StdDev: 237.77 Min: 1 Median: 2.2855 Max: 51148 Percentiles: P50: 2.29 P75: 3.32 P99: 533.64 P99.9: 1349.36 P99.99: 2178.39 ------------------------------------------------------ [ 0, 1 ] 6299 0.730% 0.730% ( 1, 2 ] 350694 40.646% 41.376% ######## ( 2, 3 ] 260668 30.212% 71.588% ###### ( 3, 4 ] 93152 10.796% 82.384% ## ( 4, 6 ] 96956 11.237% 93.622% ## ( 6, 10 ] 23385 2.710% 96.332% # ( 10, 15 ] 3883 0.450% 96.782% ( 15, 22 ] 410 0.048% 96.830% ( 22, 34 ] 141 0.016% 96.846% ( 34, 51 ] 248 0.029% 96.875% ( 51, 76 ] 138 0.016% 96.891% ( 76, 110 ] 42 0.005% 96.895% ( 110, 170 ] 1180 0.137% 97.032% ( 170, 250 ] 5372 0.623% 97.655% ( 250, 380 ] 6362 0.737% 98.392% ( 380, 580 ] 6829 0.791% 99.184% ( 580, 870 ] 4524 0.524% 99.708% ( 870, 1300 ] 1609 0.186% 99.895% ( 1300, 1900 ] 598 0.069% 99.964% ( 1900, 2900 ] 818 0.095% 100.059% ( 2900, 4400 ] 858 0.099% 100.158% ( 4400, 6600 ] 167 0.019% 100.177% ( 6600, 9900 ] 36 0.004% 100.182% ( 9900, 14000 ] 11 0.001% 100.183% ( 14000, 22000 ] 18 0.002% 100.185% ( 22000, 33000 ] 10 0.001% 100.186% ( 33000, 50000 ] 3 0.000% 100.186% ( 50000, 75000 ] 1 0.000% 100.187% ** Level 5 read latency histogram (micros): Count: 21565 Average: 642.8437 StdDev: 1108.12 Min: 93 Median: 415.4409 Max: 55012 Percentiles: P50: 415.44 P75: 668.39 P99: 4213.10 P99.9: 11861.17 P99.99: 43446.50 ------------------------------------------------------ ( 76, 110 ] 23 0.107% 0.107% ( 110, 170 ] 1013 4.697% 4.804% # ( 170, 250 ] 4159 19.286% 24.090% #### ( 250, 380 ] 4657 21.595% 45.685% #### ( 380, 580 ] 5251 24.350% 70.035% ##### ( 580, 870 ] 3513 16.290% 86.325% ### ( 870, 1300 ] 1284 5.954% 92.279% # ( 1300, 1900 ] 438 2.031% 94.310% ( 1900, 2900 ] 522 2.421% 96.731% ( 2900, 4400 ] 559 2.592% 99.323% # ( 4400, 6600 ] 106 0.492% 99.815% ( 6600, 9900 ] 17 0.079% 99.893% ( 9900, 14000 ] 3 0.014% 99.907% ( 14000, 22000 ] 11 0.051% 99.958% ( 22000, 33000 ] 5 0.023% 99.981% ( 33000, 50000 ] 3 0.014% 99.995% ( 50000, 75000 ] 1 0.005% 100.000% ** DB Stats ** Uptime(secs): 10.5 total, 4.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 187.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.707 H:M:S, 16.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 224.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.353 H:M:S, 8.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/15-16:17:20 ... thread 0: (1000000,3000000) ops and (132135.4,166984.7) ops/second in (7.567993,17.965714) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.97 GB 150.2 2.3 0.0 2.3 5.1 2.8 0.0 1.8 103.7 226.0 23.04 17.49 50 0.461 2427K 12K 0.0 0.0 L2 1/0 1.71 MB 0.0 1.1 1.0 0.1 1.0 1.0 0.0 1.1 149.8 147.6 7.23 5.10 1 7.227 1099K 16K 0.0 0.0 L3 18/0 988.22 MB 1.0 2.5 1.7 0.8 2.4 1.6 0.5 1.4 130.7 125.9 19.68 12.61 10 1.968 1852K 9947 0.0 0.0 L4 139/0 9.51 GB 1.0 6.2 2.7 3.5 5.6 2.1 0.4 2.1 157.1 142.2 40.29 27.82 26 1.550 1936K 4472 0.0 0.0 L5 156/0 12.08 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 332/12 25.53 GB 0.0 12.1 5.4 6.7 14.1 7.4 3.3 5.1 137.1 160.5 90.24 63.02 87 1.037 7315K 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.1 5.4 6.7 14.1 7.4 3.3 5.1 137.1 160.5 90.24 63.02 87 1.037 7315K 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.1 5.4 6.7 11.4 4.7 0.0 0.0 159.3 150.0 77.71 55.10 46 1.689 7315K 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 225.8 12.53 7.92 41 0.306 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.1 total, 18.0 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.14 GB write, 802.27 MB/s write, 12.09 GB read, 685.49 MB/s read, 90.2 seconds Interval compaction: 14.14 GB write, 805.92 MB/s write, 12.09 GB read, 688.60 MB/s read, 90.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 17, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 915418 Average: 30.2106 StdDev: 182.74 Min: 1 Median: 1.6849 Max: 51629 Percentiles: P50: 1.68 P75: 2.56 P99: 470.94 P99.9: 1265.45 P99.99: 2821.42 ------------------------------------------------------ [ 0, 1 ] 122493 13.381% 13.381% ### ( 1, 2 ] 489434 53.466% 66.847% ########### ( 2, 3 ] 134073 14.646% 81.493% ### ( 3, 4 ] 40059 4.376% 85.869% # ( 4, 6 ] 34207 3.737% 89.606% # ( 6, 10 ] 8406 0.918% 90.524% ( 10, 15 ] 1119 0.122% 90.646% ( 15, 22 ] 134 0.015% 90.661% ( 22, 34 ] 48 0.005% 90.666% ( 34, 51 ] 14 0.002% 90.668% ( 51, 76 ] 14 0.002% 90.669% ( 76, 110 ] 874 0.095% 90.765% ( 110, 170 ] 20338 2.222% 92.986% ( 170, 250 ] 41155 4.496% 97.482% # ( 250, 380 ] 10784 1.178% 98.660% ( 380, 580 ] 6844 0.748% 99.408% ( 580, 870 ] 3529 0.386% 99.793% ( 870, 1300 ] 1063 0.116% 99.909% ( 1300, 1900 ] 310 0.034% 99.943% ( 1900, 2900 ] 465 0.051% 99.994% ( 2900, 4400 ] 488 0.053% 100.047% ( 4400, 6600 ] 82 0.009% 100.056% ( 6600, 9900 ] 20 0.002% 100.058% ( 9900, 14000 ] 13 0.001% 100.060% ( 14000, 22000 ] 6 0.001% 100.061% ( 22000, 33000 ] 4 0.000% 100.061% ( 33000, 50000 ] 1 0.000% 100.061% ( 50000, 75000 ] 1 0.000% 100.061% ** Level 1 read latency histogram (micros): Count: 255181 Average: 13.0079 StdDev: 175.30 Min: 1 Median: 2.2092 Max: 30577 Percentiles: P50: 2.21 P75: 3.07 P99: 199.97 P99.9: 2450.89 P99.99: 6048.95 ------------------------------------------------------ [ 0, 1 ] 2190 0.858% 0.858% ( 1, 2 ] 108998 42.714% 43.572% ######### ( 2, 3 ] 78421 30.732% 74.304% ###### ( 3, 4 ] 25506 9.995% 84.299% ## ( 4, 6 ] 28497 11.167% 95.466% ## ( 6, 10 ] 7089 2.778% 98.244% # ( 10, 15 ] 1336 0.524% 98.768% ( 15, 22 ] 152 0.060% 98.827% ( 22, 34 ] 35 0.014% 98.841% ( 34, 51 ] 49 0.019% 98.860% ( 51, 76 ] 32 0.013% 98.873% ( 76, 110 ] 13 0.005% 98.878% ( 110, 170 ] 131 0.051% 98.929% ( 170, 250 ] 481 0.188% 99.118% ( 250, 380 ] 537 0.210% 99.328% ( 380, 580 ] 616 0.241% 99.570% ( 580, 870 ] 449 0.176% 99.746% ( 870, 1300 ] 222 0.087% 99.833% ( 1300, 1900 ] 98 0.038% 99.871% ( 1900, 2900 ] 134 0.053% 99.924% ( 2900, 4400 ] 141 0.055% 99.979% ( 4400, 6600 ] 38 0.015% 99.994% ( 6600, 9900 ] 16 0.006% 100.000% ( 9900, 14000 ] 3 0.001% 100.001% ( 14000, 22000 ] 1 0.000% 100.002% ( 22000, 33000 ] 2 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 496398 Average: 9.6501 StdDev: 154.30 Min: 1 Median: 2.2721 Max: 23033 Percentiles: P50: 2.27 P75: 3.17 P99: 10.99 P99.9: 815.68 P99.99: 1839.42 ------------------------------------------------------ [ 0, 1 ] 3373 0.679% 0.679% ( 1, 2 ] 201824 40.658% 41.337% ######## ( 2, 3 ] 158028 31.835% 73.172% ###### ( 3, 4 ] 54377 10.954% 84.126% ## ( 4, 6 ] 59297 11.945% 96.072% ## ( 6, 10 ] 14036 2.828% 98.899% # ( 10, 15 ] 2524 0.508% 99.408% ( 15, 22 ] 334 0.067% 99.475% ( 22, 34 ] 87 0.018% 99.493% ( 34, 51 ] 142 0.029% 99.521% ( 51, 76 ] 76 0.015% 99.537% ( 76, 110 ] 27 0.005% 99.542% ( 110, 170 ] 59 0.012% 99.554% ( 170, 250 ] 242 0.049% 99.603% ( 250, 380 ] 457 0.092% 99.695% ( 380, 580 ] 609 0.123% 99.817% ( 580, 870 ] 504 0.102% 99.919% ( 870, 1300 ] 222 0.045% 99.964% ( 1300, 1900 ] 145 0.029% 99.993% ( 1900, 2900 ] 189 0.038% 100.031% ( 2900, 4400 ] 212 0.043% 100.074% ( 4400, 6600 ] 46 0.009% 100.083% ( 6600, 9900 ] 26 0.005% 100.088% ( 9900, 14000 ] 11 0.002% 100.090% ( 14000, 22000 ] 7 0.001% 100.092% ( 22000, 33000 ] 1 0.000% 100.092% ** Level 3 read latency histogram (micros): Count: 625260 Average: 15.0951 StdDev: 180.11 Min: 1 Median: 2.3047 Max: 42921 Percentiles: P50: 2.30 P75: 3.30 P99: 245.17 P99.9: 916.30 P99.99: 1527.40 ------------------------------------------------------ [ 0, 1 ] 4871 0.779% 0.779% ( 1, 2 ] 248206 39.696% 40.475% ######## ( 2, 3 ] 195456 31.260% 71.735% ###### ( 3, 4 ] 68805 11.004% 82.740% ## ( 4, 6 ] 73287 11.721% 94.461% ## ( 6, 10 ] 16928 2.707% 97.168% # ( 10, 15 ] 3011 0.482% 97.650% ( 15, 22 ] 376 0.060% 97.710% ( 22, 34 ] 122 0.020% 97.729% ( 34, 51 ] 199 0.032% 97.761% ( 51, 76 ] 98 0.016% 97.777% ( 76, 110 ] 153 0.024% 97.801% ( 110, 170 ] 2566 0.410% 98.212% ( 170, 250 ] 5246 0.839% 99.051% ( 250, 380 ] 2007 0.321% 99.372% ( 380, 580 ] 1946 0.311% 99.683% ( 580, 870 ] 1301 0.208% 99.891% ( 870, 1300 ] 527 0.084% 99.975% ( 1300, 1900 ] 244 0.039% 100.014% ( 1900, 2900 ] 288 0.046% 100.060% ( 2900, 4400 ] 322 0.051% 100.112% ( 4400, 6600 ] 63 0.010% 100.122% ( 6600, 9900 ] 22 0.004% 100.125% ( 9900, 14000 ] 6 0.001% 100.126% ( 14000, 22000 ] 3 0.000% 100.127% ( 22000, 33000 ] 6 0.001% 100.128% ( 33000, 50000 ] 1 0.000% 100.128% ** Level 4 read latency histogram (micros): Count: 952465 Average: 34.1914 StdDev: 230.38 Min: 1 Median: 2.3665 Max: 51148 Percentiles: P50: 2.37 P75: 3.70 P99: 520.63 P99.9: 1279.08 P99.99: 2116.08 ------------------------------------------------------ [ 0, 1 ] 7587 0.797% 0.797% ( 1, 2 ] 369812 38.827% 39.623% ######## ( 2, 3 ] 269688 28.315% 67.938% ###### ( 3, 4 ] 95683 10.046% 77.984% ## ( 4, 6 ] 99513 10.448% 88.432% ## ( 6, 10 ] 24179 2.539% 90.970% # ( 10, 15 ] 3986 0.418% 91.389% ( 15, 22 ] 425 0.045% 91.434% ( 22, 34 ] 145 0.015% 91.449% ( 34, 51 ] 250 0.026% 91.475% ( 51, 76 ] 139 0.015% 91.490% ( 76, 110 ] 786 0.083% 91.572% ( 110, 170 ] 18020 1.892% 93.464% ( 170, 250 ] 36423 3.824% 97.288% # ( 250, 380 ] 10653 1.118% 98.407% ( 380, 580 ] 8037 0.844% 99.250% ( 580, 870 ] 4652 0.488% 99.739% ( 870, 1300 ] 1613 0.169% 99.908% ( 1300, 1900 ] 602 0.063% 99.971% ( 1900, 2900 ] 818 0.086% 100.057% ( 2900, 4400 ] 859 0.090% 100.148% ( 4400, 6600 ] 167 0.018% 100.165% ( 6600, 9900 ] 36 0.004% 100.169% ( 9900, 14000 ] 11 0.001% 100.170% ( 14000, 22000 ] 18 0.002% 100.172% ( 22000, 33000 ] 10 0.001% 100.173% ( 33000, 50000 ] 3 0.000% 100.173% ( 50000, 75000 ] 1 0.000% 100.173% ** Level 5 read latency histogram (micros): Count: 63139 Average: 349.2648 StdDev: 683.42 Min: 90 Median: 218.5840 Max: 55012 Percentiles: P50: 218.58 P75: 330.11 P99: 3097.52 P99.9: 6119.76 P99.99: 27909.42 ------------------------------------------------------ ( 76, 110 ] 591 0.936% 0.936% ( 110, 170 ] 14081 22.302% 23.238% #### ( 170, 250 ] 27824 44.068% 67.305% ######### ( 250, 380 ] 7884 12.487% 79.792% ## ( 380, 580 ] 6149 9.739% 89.531% ## ( 580, 870 ] 3651 5.782% 95.314% # ( 870, 1300 ] 1286 2.037% 97.350% ( 1300, 1900 ] 444 0.703% 98.054% ( 1900, 2900 ] 524 0.830% 98.883% ( 2900, 4400 ] 559 0.885% 99.769% ( 4400, 6600 ] 106 0.168% 99.937% ( 6600, 9900 ] 17 0.027% 99.964% ( 9900, 14000 ] 3 0.005% 99.968% ( 14000, 22000 ] 11 0.017% 99.986% ( 22000, 33000 ] 5 0.008% 99.994% ( 33000, 50000 ] 3 0.005% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 18.1 total, 7.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 163.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.317 H:M:S, 29.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.611 H:M:S, 47.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 379.727 micros/op 10492 ops/sec 20.204 seconds 211996 operations; 10.2 MB/s (53999 of 53999 found) Microseconds per read: Count: 211996 Average: 379.7389 StdDev: 871.02 Min: 2 Median: 239.5859 Max: 73691 Percentiles: P50: 239.59 P75: 377.88 P99: 2912.82 P99.9: 11854.84 P99.99: 32946.45 ------------------------------------------------------ ( 1, 2 ] 8 0.004% 0.004% ( 2, 3 ] 56 0.026% 0.030% ( 3, 4 ] 96 0.045% 0.075% ( 4, 6 ] 142 0.067% 0.142% ( 6, 10 ] 287 0.135% 0.278% ( 10, 15 ] 1117 0.527% 0.805% ( 15, 22 ] 2302 1.086% 1.891% ( 22, 34 ] 3774 1.780% 3.671% ( 34, 51 ] 1792 0.845% 4.516% ( 51, 76 ] 262 0.124% 4.640% ( 76, 110 ] 95 0.045% 4.685% ( 110, 170 ] 15717 7.414% 12.098% # ( 170, 250 ] 92375 43.574% 55.672% ######### ( 250, 380 ] 41652 19.648% 75.320% #### ( 380, 580 ] 29086 13.720% 89.040% ### ( 580, 870 ] 13571 6.402% 95.441% # ( 870, 1300 ] 4778 2.254% 97.695% ( 1300, 1900 ] 1504 0.709% 98.405% ( 1900, 2900 ] 1250 0.590% 98.994% ( 2900, 4400 ] 1409 0.665% 99.659% ( 4400, 6600 ] 323 0.152% 99.811% ( 6600, 9900 ] 147 0.069% 99.881% ( 9900, 14000 ] 86 0.041% 99.921% ( 14000, 22000 ] 105 0.050% 99.971% ( 22000, 33000 ] 41 0.019% 99.990% ( 33000, 50000 ] 15 0.007% 99.997% ( 50000, 75000 ] 6 0.003% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3588330 rocksdb.bloom.filter.full.positive COUNT : 245847 rocksdb.bloom.filter.full.true.positive COUNT : 211195 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 801 rocksdb.memtable.miss COUNT : 211195 rocksdb.l0.hit COUNT : 23634 rocksdb.l1.hit COUNT : 1848 rocksdb.l2andup.hit COUNT : 185713 rocksdb.compaction.key.drop.new COUNT : 763034 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3073739 rocksdb.number.keys.read COUNT : 211996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3172098648 rocksdb.bytes.read COUNT : 211996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 492 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7247984 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14447880111 rocksdb.compact.write.bytes COUNT : 13655146146 rocksdb.flush.write.bytes COUNT : 3165588850 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 620 rocksdb.number.superversion_releases COUNT : 599 rocksdb.number.superversion_cleanups COUNT : 151 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 20 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3145203712 rocksdb.memtable.garbage.bytes.at.flush COUNT : 5944320 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 14396801689 rocksdb.non.last.level.read.count COUNT : 3452052 rocksdb.block.checksum.compute.count COUNT : 3750018 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 238.952595 P95 : 849.424893 P99 : 2911.761364 P100 : 73690.000000 COUNT : 211996 SUM : 80325114 rocksdb.db.write.micros P50 : 1.647956 P95 : 5.278342 P99 : 9.020868 P100 : 401740.000000 COUNT : 3073739 SUM : 16054052 rocksdb.compaction.times.micros P50 : 1525000.000000 P95 : 2714285.714286 P99 : 7226974.000000 P100 : 7226974.000000 COUNT : 46 SUM : 77708648 rocksdb.compaction.times.cpu_micros P50 : 1077600.000000 P95 : 1830000.000000 P99 : 5098141.000000 P100 : 5098141.000000 COUNT : 46 SUM : 55102263 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1300.000000 P95 : 7920.000000 P99 : 12196.000000 P100 : 13709.000000 COUNT : 44 SUM : 95741 rocksdb.compaction.outfile.sync.micros P50 : 1805.263158 P95 : 6666.000000 P99 : 12811.000000 P100 : 16146.000000 COUNT : 158 SUM : 428202 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 210.000000 P95 : 1840.000000 P99 : 4340.000000 P100 : 15478.000000 COUNT : 104 SUM : 56048 rocksdb.table.open.io.micros P50 : 5439.560440 P95 : 17569.230769 P99 : 21606.153846 P100 : 26289.000000 COUNT : 492 SUM : 3031586 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.405465 P95 : 9.805924 P99 : 233.265628 P100 : 51636.000000 COUNT : 3500597 SUM : 52210956 rocksdb.read.block.get.micros P50 : 208.640372 P95 : 741.260075 P99 : 2507.098854 P100 : 55022.000000 COUNT : 248949 SUM : 72410765 rocksdb.write.raw.block.micros P50 : 0.530517 P95 : 1.203378 P99 : 3.455752 P100 : 85604.000000 COUNT : 4077083 SUM : 13313899 rocksdb.numfiles.in.singlecompaction P50 : 3.055556 P95 : 4.975000 P99 : 7.560000 P100 : 9.000000 COUNT : 61 SUM : 211 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562302 P95 : 1135.321255 P99 : 2131.871560 P100 : 401494.000000 COUNT : 42663 SUM : 7252123 rocksdb.sst.read.micros P50 : 2.111909 P95 : 201.937096 P99 : 517.056026 P100 : 55012.000000 COUNT : 3452120 SUM : 110453188 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 211996 SUM : 211996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3073739 SUM : 3172098648 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 234615.384615 P95 : 647333.333333 P99 : 683305.000000 P100 : 683305.000000 COUNT : 44 SUM : 13125168 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 157 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0