[2024-11-20 21:55:10.051358] Starting SPDK v25.01-pre git sha1 557f022f6 / DPDK 22.11.4 initialization... [2024-11-20 21:55:10.051475] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid138073 ] Set seed to 1732136110048867 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 21:55:10.147747] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 21:55:10.169571] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 21:55:10.169614] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 138073' to capture a snapshot of events at runtime. [2024-11-20 21:55:10.169625] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 21:55:10.169636] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 21:55:10.169644] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid138073 for offline analysis/debug. [2024-11-20 21:55:10.170183] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 21:55:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-21:55:22 ... thread 0: (1000000,1000000) ops and (129674.6,129674.6) ops/second in (7.711612,7.711612) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.70 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 94.4 241.2 6.01 4.70 15 0.400 575K 572 0.0 0.0 L1 14/14 1.64 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 77.69 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/0 932.80 MB 0.9 1.7 0.8 0.9 1.6 0.8 0.0 2.0 102.8 101.7 16.59 7.99 11 1.509 158K 0 0.0 0.0 L4 162/0 9.53 GB 1.0 3.6 2.2 1.3 3.5 2.2 0.0 1.6 126.4 124.8 28.82 16.67 25 1.153 1521K 0 0.0 0.0 L5 1112/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/22 106.27 GB 0.0 5.8 3.0 2.7 6.6 3.8 2.3 7.6 115.0 130.9 51.42 29.37 51 1.008 2255K 572 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 3.0 2.7 6.6 3.8 2.3 7.6 115.0 130.9 51.42 29.37 51 1.008 2255K 572 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 3.0 2.7 5.7 3.0 0.0 0.0 124.1 122.7 47.69 26.84 38 1.255 2255K 572 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 236.2 3.73 2.53 13 0.287 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.58 GB write, 855.71 MB/s write, 5.78 GB read, 751.83 MB/s read, 51.4 seconds Interval compaction: 6.58 GB write, 872.91 MB/s write, 5.78 GB read, 766.93 MB/s read, 51.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 20, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 4, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 437761 Average: 8.8940 StdDev: 104.37 Min: 1 Median: 1.7635 Max: 12426 Percentiles: P50: 1.76 P75: 2.62 P99: 127.04 P99.9: 831.67 P99.99: 1638.82 ------------------------------------------------------ [ 0, 1 ] 40757 9.310% 9.310% ## ( 1, 2 ] 233311 53.296% 62.607% ########### ( 2, 3 ] 88191 20.146% 82.753% #### ( 3, 4 ] 30002 6.854% 89.606% # ( 4, 6 ] 29351 6.705% 96.311% # ( 6, 10 ] 8915 2.036% 98.348% ( 10, 15 ] 1537 0.351% 98.699% ( 15, 22 ] 278 0.064% 98.762% ( 22, 34 ] 49 0.011% 98.773% ( 34, 51 ] 19 0.004% 98.778% ( 51, 76 ] 28 0.006% 98.784% ( 76, 110 ] 484 0.111% 98.895% ( 110, 170 ] 1632 0.373% 99.267% ( 170, 250 ] 1066 0.244% 99.511% ( 250, 380 ] 681 0.156% 99.666% ( 380, 580 ] 645 0.147% 99.814% ( 580, 870 ] 437 0.100% 99.914% ( 870, 1300 ] 247 0.056% 99.970% ( 1300, 1900 ] 158 0.036% 100.006% ( 1900, 2900 ] 127 0.029% 100.035% ( 2900, 4400 ] 121 0.028% 100.063% ( 4400, 6600 ] 26 0.006% 100.069% ( 6600, 9900 ] 6 0.001% 100.070% ( 9900, 14000 ] 2 0.000% 100.071% ** Level 1 read latency histogram (micros): Count: 721 Average: 595.2899 StdDev: 1467.27 Min: 58 Median: 203.3884 Max: 12738 Percentiles: P50: 203.39 P75: 454.00 P99: 10304.87 P99.9: 12738.00 P99.99: 12738.00 ------------------------------------------------------ ( 51, 76 ] 2 0.277% 0.277% ( 76, 110 ] 79 10.957% 11.234% ## ( 110, 170 ] 229 31.761% 42.996% ###### ( 170, 250 ] 121 16.782% 59.778% ### ( 250, 380 ] 82 11.373% 71.151% ## ( 380, 580 ] 75 10.402% 81.553% ## ( 580, 870 ] 50 6.935% 88.488% # ( 870, 1300 ] 26 3.606% 92.094% # ( 1300, 1900 ] 22 3.051% 95.146% # ( 1900, 2900 ] 8 1.110% 96.255% ( 2900, 4400 ] 11 1.526% 97.781% ( 4400, 6600 ] 4 0.555% 98.336% ( 6600, 9900 ] 4 0.555% 98.890% ( 9900, 14000 ] 8 1.110% 100.000% ** Level 2 read latency histogram (micros): Count: 39616 Average: 9.6255 StdDev: 124.01 Min: 1 Median: 1.9279 Max: 9588 Percentiles: P50: 1.93 P75: 2.96 P99: 11.07 P99.9: 2053.82 P99.99: 4319.87 ------------------------------------------------------ [ 0, 1 ] 1309 3.304% 3.304% # ( 1, 2 ] 19936 50.323% 53.627% ########## ( 2, 3 ] 8783 22.170% 75.798% #### ( 3, 4 ] 4062 10.253% 86.051% ## ( 4, 6 ] 3969 10.019% 96.070% ## ( 6, 10 ] 1120 2.827% 98.897% # ( 10, 15 ] 191 0.482% 99.379% ( 15, 22 ] 28 0.071% 99.450% ( 22, 34 ] 5 0.013% 99.462% ( 34, 51 ] 5 0.013% 99.475% ( 51, 76 ] 2 0.005% 99.480% ( 76, 110 ] 2 0.005% 99.485% ( 110, 170 ] 8 0.020% 99.505% ( 170, 250 ] 10 0.025% 99.530% ( 250, 380 ] 9 0.023% 99.553% ( 380, 580 ] 29 0.073% 99.626% ( 580, 870 ] 36 0.091% 99.717% ( 870, 1300 ] 44 0.111% 99.828% ( 1300, 1900 ] 25 0.063% 99.891% ( 1900, 2900 ] 22 0.056% 99.947% ( 2900, 4400 ] 18 0.045% 99.992% ( 4400, 6600 ] 2 0.005% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 644773 Average: 9.2458 StdDev: 120.87 Min: 1 Median: 1.9542 Max: 9016 Percentiles: P50: 1.95 P75: 3.00 P99: 9.70 P99.9: 554.59 P99.99: 841.81 ------------------------------------------------------ [ 0, 1 ] 15465 2.399% 2.399% ( 1, 2 ] 321656 49.887% 52.285% ########## ( 2, 3 ] 147066 22.809% 75.094% ##### ( 3, 4 ] 71121 11.030% 86.125% ## ( 4, 6 ] 68517 10.627% 96.751% ## ( 6, 10 ] 15687 2.433% 99.184% ( 10, 15 ] 2944 0.457% 99.641% ( 15, 22 ] 411 0.064% 99.704% ( 22, 34 ] 60 0.009% 99.714% ( 34, 51 ] 37 0.006% 99.719% ( 51, 76 ] 50 0.008% 99.727% ( 76, 110 ] 63 0.010% 99.737% ( 110, 170 ] 203 0.031% 99.768% ( 170, 250 ] 204 0.032% 99.800% ( 250, 380 ] 261 0.040% 99.841% ( 380, 580 ] 439 0.068% 99.909% ( 580, 870 ] 581 0.090% 99.999% ( 870, 1300 ] 608 0.094% 100.093% ( 1300, 1900 ] 395 0.061% 100.154% ( 1900, 2900 ] 269 0.042% 100.196% ( 2900, 4400 ] 266 0.041% 100.237% ( 4400, 6600 ] 67 0.010% 100.248% ( 6600, 9900 ] 12 0.002% 100.250% ** Level 4 read latency histogram (micros): Count: 346907 Average: 19.0201 StdDev: 182.71 Min: 1 Median: 1.9551 Max: 8981 Percentiles: P50: 1.96 P75: 3.08 P99: 340.55 P99.9: 1774.31 P99.99: 2548.94 ------------------------------------------------------ [ 0, 1 ] 8431 2.430% 2.430% ( 1, 2 ] 172775 49.804% 52.235% ########## ( 2, 3 ] 75836 21.861% 74.095% #### ( 3, 4 ] 37354 10.768% 84.863% ## ( 4, 6 ] 35232 10.156% 95.019% ## ( 6, 10 ] 8960 2.583% 97.602% # ( 10, 15 ] 1495 0.431% 98.033% ( 15, 22 ] 199 0.057% 98.090% ( 22, 34 ] 27 0.008% 98.098% ( 34, 51 ] 31 0.009% 98.107% ( 51, 76 ] 23 0.007% 98.114% ( 76, 110 ] 349 0.101% 98.214% ( 110, 170 ] 1234 0.356% 98.570% ( 170, 250 ] 973 0.280% 98.850% ( 250, 380 ] 745 0.215% 99.065% ( 380, 580 ] 907 0.261% 99.327% ( 580, 870 ] 844 0.243% 99.570% ( 870, 1300 ] 753 0.217% 99.787% ( 1300, 1900 ] 496 0.143% 99.930% ( 1900, 2900 ] 321 0.093% 100.022% ( 2900, 4400 ] 268 0.077% 100.100% ( 4400, 6600 ] 103 0.030% 100.129% ( 6600, 9900 ] 17 0.005% 100.134% ** Level 5 read latency histogram (micros): Count: 35744 Average: 613.3252 StdDev: 991.18 Min: 73 Median: 234.4302 Max: 11810 Percentiles: P50: 234.43 P75: 566.15 P99: 5378.26 P99.9: 8237.22 P99.99: 10248.99 ------------------------------------------------------ ( 51, 76 ] 3 0.008% 0.008% ( 76, 110 ] 2763 7.730% 7.738% ## ( 110, 170 ] 9954 27.848% 35.586% ###### ( 170, 250 ] 6397 17.897% 53.483% #### ( 250, 380 ] 4048 11.325% 64.808% ## ( 380, 580 ] 3914 10.950% 75.758% ## ( 580, 870 ] 2727 7.629% 83.387% ## ( 870, 1300 ] 1887 5.279% 88.667% # ( 1300, 1900 ] 1191 3.332% 91.999% # ( 1900, 2900 ] 1118 3.128% 95.126% # ( 2900, 4400 ] 1152 3.223% 98.349% # ( 4400, 6600 ] 523 1.463% 99.813% ( 6600, 9900 ] 63 0.176% 99.989% ( 9900, 14000 ] 5 0.014% 100.003% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 125.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.907 H:M:S, 49.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.907 H:M:S, 50.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-21:55:52 ... thread 0: (1000000,2000000) ops and (32472.0,51938.1) ops/second in (30.795758,38.507370) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 3/3 1.83 GB 0.0 3.3 0.0 3.3 5.1 1.8 0.0 2.8 131.2 205.0 25.44 18.44 37 0.688 3388K 11K 0.0 0.0 L1 12/12 1.42 GB 0.0 3.5 1.8 1.6 3.4 1.8 0.0 1.9 93.6 92.6 38.11 21.82 1 38.108 3622K 38K 0.0 0.0 L2 11/8 892.37 MB 2.4 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 33/13 2.14 GB 1.5 1.7 0.8 0.9 1.6 0.8 1.2 2.0 102.8 101.7 16.59 7.99 11 1.509 158K 0 0.0 0.0 L4 162/0 9.53 GB 1.0 3.6 2.2 1.3 3.5 2.2 0.0 1.6 126.4 124.8 28.82 16.67 25 1.153 1521K 0 0.0 0.0 L5 1112/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1333/36 107.21 GB 0.0 12.0 4.9 7.1 13.7 6.6 5.6 7.4 112.4 128.7 108.97 64.92 74 1.473 8690K 50K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 4.9 7.1 13.7 6.6 5.6 7.4 112.4 128.7 108.97 64.92 74 1.473 8690K 50K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 4.9 7.1 11.9 4.8 0.0 0.0 120.1 119.0 102.01 59.63 45 2.267 8690K 50K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 271.7 6.96 5.29 29 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.7 total, 38.5 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.70 GB write, 362.83 MB/s write, 11.97 GB read, 316.90 MB/s read, 109.0 seconds Interval compaction: 13.70 GB write, 364.29 MB/s write, 11.97 GB read, 318.18 MB/s read, 109.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 32, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 4, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1424358 Average: 24.4723 StdDev: 88.52 Min: 0 Median: 1.6787 Max: 12426 Percentiles: P50: 1.68 P75: 2.77 P99: 246.83 P99.9: 638.01 P99.99: 1017.81 ------------------------------------------------------ [ 0, 1 ] 244387 17.158% 17.158% ### ( 1, 2 ] 689274 48.392% 65.550% ########## ( 2, 3 ] 175390 12.314% 77.863% ## ( 3, 4 ] 59409 4.171% 82.034% # ( 4, 6 ] 48563 3.409% 85.444% # ( 6, 10 ] 13935 0.978% 86.422% ( 10, 15 ] 2426 0.170% 86.592% ( 15, 22 ] 447 0.031% 86.624% ( 22, 34 ] 66 0.005% 86.628% ( 34, 51 ] 24 0.002% 86.630% ( 51, 76 ] 87 0.006% 86.636% ( 76, 110 ] 35600 2.499% 89.135% ( 110, 170 ] 113248 7.951% 97.086% ## ( 170, 250 ] 28383 1.993% 99.079% ( 250, 380 ] 7094 0.498% 99.577% ( 380, 580 ] 4315 0.303% 99.880% ( 580, 870 ] 1428 0.100% 99.980% ( 870, 1300 ] 406 0.029% 100.009% ( 1300, 1900 ] 205 0.014% 100.023% ( 1900, 2900 ] 226 0.016% 100.039% ( 2900, 4400 ] 191 0.013% 100.052% ( 4400, 6600 ] 30 0.002% 100.054% ( 6600, 9900 ] 7 0.000% 100.055% ( 9900, 14000 ] 2 0.000% 100.055% ** Level 1 read latency histogram (micros): Count: 460552 Average: 9.5341 StdDev: 77.21 Min: 1 Median: 2.5324 Max: 12738 Percentiles: P50: 2.53 P75: 3.83 P99: 161.37 P99.9: 571.01 P99.99: 1659.26 ------------------------------------------------------ [ 0, 1 ] 19958 4.333% 4.333% # ( 1, 2 ] 152773 33.172% 37.505% ####### ( 2, 3 ] 108078 23.467% 60.972% ##### ( 3, 4 ] 78035 16.944% 77.916% ### ( 4, 6 ] 72186 15.674% 93.590% ### ( 6, 10 ] 10555 2.292% 95.882% ( 10, 15 ] 2914 0.633% 96.514% ( 15, 22 ] 1032 0.224% 96.738% ( 22, 34 ] 40 0.009% 96.747% ( 34, 51 ] 9 0.002% 96.749% ( 51, 76 ] 16 0.003% 96.753% ( 76, 110 ] 3178 0.690% 97.443% ( 110, 170 ] 8379 1.819% 99.262% ( 170, 250 ] 1880 0.408% 99.670% ( 250, 380 ] 623 0.135% 99.805% ( 380, 580 ] 457 0.099% 99.905% ( 580, 870 ] 236 0.051% 99.956% ( 870, 1300 ] 131 0.028% 99.984% ( 1300, 1900 ] 45 0.010% 99.994% ( 1900, 2900 ] 23 0.005% 99.999% ( 2900, 4400 ] 30 0.007% 100.006% ( 4400, 6600 ] 4 0.001% 100.007% ( 6600, 9900 ] 4 0.001% 100.007% ( 9900, 14000 ] 8 0.002% 100.009% ** Level 2 read latency histogram (micros): Count: 44765 Average: 11.9934 StdDev: 121.01 Min: 1 Median: 1.9510 Max: 9588 Percentiles: P50: 1.95 P75: 3.08 P99: 162.21 P99.9: 1951.46 P99.99: 4283.43 ------------------------------------------------------ [ 0, 1 ] 1424 3.181% 3.181% # ( 1, 2 ] 22039 49.233% 52.414% ########## ( 2, 3 ] 9767 21.818% 74.232% #### ( 3, 4 ] 4558 10.182% 84.414% ## ( 4, 6 ] 4430 9.896% 94.310% ## ( 6, 10 ] 1247 2.786% 97.096% # ( 10, 15 ] 204 0.456% 97.552% ( 15, 22 ] 31 0.069% 97.621% ( 22, 34 ] 5 0.011% 97.632% ( 34, 51 ] 5 0.011% 97.643% ( 51, 76 ] 2 0.004% 97.648% ( 76, 110 ] 172 0.384% 98.032% ( 110, 170 ] 498 1.112% 99.144% ( 170, 250 ] 126 0.281% 99.426% ( 250, 380 ] 49 0.109% 99.535% ( 380, 580 ] 49 0.109% 99.645% ( 580, 870 ] 42 0.094% 99.739% ( 870, 1300 ] 45 0.101% 99.839% ( 1300, 1900 ] 26 0.058% 99.897% ( 1900, 2900 ] 24 0.054% 99.951% ( 2900, 4400 ] 19 0.042% 99.993% ( 4400, 6600 ] 2 0.004% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 688015 Average: 11.1307 StdDev: 121.07 Min: 1 Median: 1.9702 Max: 9016 Percentiles: P50: 1.97 P75: 3.09 P99: 130.33 P99.9: 596.91 P99.99: 846.32 ------------------------------------------------------ [ 0, 1 ] 15987 2.324% 2.324% ( 1, 2 ] 338104 49.142% 51.466% ########## ( 2, 3 ] 155445 22.593% 74.059% ##### ( 3, 4 ] 75203 10.930% 84.989% ## ( 4, 6 ] 72388 10.521% 95.511% ## ( 6, 10 ] 16723 2.431% 97.941% ( 10, 15 ] 3055 0.444% 98.385% ( 15, 22 ] 430 0.062% 98.448% ( 22, 34 ] 64 0.009% 98.457% ( 34, 51 ] 48 0.007% 98.464% ( 51, 76 ] 53 0.008% 98.472% ( 76, 110 ] 1855 0.270% 98.741% ( 110, 170 ] 5261 0.765% 99.506% ( 170, 250 ] 1339 0.195% 99.701% ( 250, 380 ] 610 0.089% 99.789% ( 380, 580 ] 723 0.105% 99.894% ( 580, 870 ] 720 0.105% 99.999% ( 870, 1300 ] 643 0.093% 100.092% ( 1300, 1900 ] 413 0.060% 100.152% ( 1900, 2900 ] 284 0.041% 100.194% ( 2900, 4400 ] 283 0.041% 100.235% ( 4400, 6600 ] 68 0.010% 100.245% ( 6600, 9900 ] 12 0.002% 100.247% ** Level 4 read latency histogram (micros): Count: 421994 Average: 42.6055 StdDev: 178.08 Min: 1 Median: 2.3882 Max: 8981 Percentiles: P50: 2.39 P75: 5.19 P99: 470.26 P99.9: 1716.90 P99.99: 2561.08 ------------------------------------------------------ [ 0, 1 ] 8432 1.998% 1.998% ( 1, 2 ] 172937 40.981% 42.979% ######## ( 2, 3 ] 76330 18.088% 61.067% #### ( 3, 4 ] 37656 8.923% 69.990% ## ( 4, 6 ] 35530 8.420% 78.410% ## ( 6, 10 ] 8997 2.132% 80.542% ( 10, 15 ] 1501 0.356% 80.898% ( 15, 22 ] 199 0.047% 80.945% ( 22, 34 ] 27 0.006% 80.951% ( 34, 51 ] 31 0.007% 80.958% ( 51, 76 ] 35 0.008% 80.967% ( 76, 110 ] 16417 3.890% 84.857% # ( 110, 170 ] 45152 10.700% 95.557% ## ( 170, 250 ] 10378 2.459% 98.016% ( 250, 380 ] 3073 0.728% 98.744% ( 380, 580 ] 2391 0.567% 99.311% ( 580, 870 ] 1278 0.303% 99.614% ( 870, 1300 ] 846 0.200% 99.814% ( 1300, 1900 ] 521 0.123% 99.938% ( 1900, 2900 ] 334 0.079% 100.017% ( 2900, 4400 ] 276 0.065% 100.082% ( 4400, 6600 ] 103 0.024% 100.107% ( 6600, 9900 ] 17 0.004% 100.111% ** Level 5 read latency histogram (micros): Count: 560547 Average: 182.7821 StdDev: 289.85 Min: 73 Median: 140.0507 Max: 11810 Percentiles: P50: 140.05 P75: 166.22 P99: 1081.27 P99.9: 4489.90 P99.99: 6649.52 ------------------------------------------------------ ( 51, 76 ] 130 0.023% 0.023% ( 76, 110 ] 119225 21.269% 21.293% #### ( 110, 170 ] 321294 57.318% 78.611% ########### ( 170, 250 ] 72575 12.947% 91.558% ### ( 250, 380 ] 20715 3.695% 95.253% # ( 380, 580 ] 14207 2.534% 97.788% # ( 580, 870 ] 5607 1.000% 98.788% ( 870, 1300 ] 2419 0.432% 99.220% ( 1300, 1900 ] 1338 0.239% 99.458% ( 1900, 2900 ] 1240 0.221% 99.679% ( 2900, 4400 ] 1215 0.217% 99.896% ( 4400, 6600 ] 525 0.094% 99.990% ( 6600, 9900 ] 63 0.011% 100.001% ( 9900, 14000 ] 5 0.001% 100.002% ** DB Stats ** Uptime(secs): 38.7 total, 30.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 50.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.100 H:M:S, 77.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 31.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:26.193 H:M:S, 85.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-21:55:59 ... thread 0: (1000000,3000000) ops and (151403.1,66500.8) ops/second in (6.604885,45.112255) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.76 GB 37.7 3.6 0.0 3.6 6.4 2.8 0.0 2.3 110.9 195.2 33.50 22.65 50 0.670 3772K 12K 0.0 0.0 L1 12/12 1.42 GB 0.0 3.5 1.8 1.6 3.4 1.8 0.0 1.9 93.6 92.6 38.11 21.82 1 38.108 3622K 38K 0.0 0.0 L3 19/2 1.08 GB 1.0 3.6 1.7 1.9 3.5 1.6 1.2 2.1 114.6 113.5 31.94 17.11 22 1.452 1580K 8758 0.0 0.0 L4 175/4 9.79 GB 1.0 7.2 4.2 3.0 7.1 4.1 0.0 1.7 128.2 126.4 57.48 33.82 50 1.150 3967K 158 0.0 0.0 L5 1132/0 93.01 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1350/29 108.06 GB 0.0 17.9 7.7 10.2 20.5 10.3 5.2 7.4 113.7 130.1 161.02 95.39 123 1.309 12M 59K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 7.7 10.2 20.5 10.3 5.2 7.4 113.7 130.1 161.02 95.39 123 1.309 12M 59K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 7.7 10.2 17.7 7.5 0.0 0.0 123.6 122.3 148.15 87.44 82 1.807 12M 59K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 220.3 12.87 7.95 41 0.314 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.3 total, 45.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.46 GB write, 462.93 MB/s write, 17.88 GB read, 404.54 MB/s read, 161.0 seconds Interval compaction: 20.46 GB write, 464.52 MB/s write, 17.88 GB read, 405.93 MB/s read, 161.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 39, pending-compaction-bytes-stops: 0, total-delays: 39, total-stops: 25, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1819078 Average: 21.4413 StdDev: 101.53 Min: 0 Median: 1.7319 Max: 12843 Percentiles: P50: 1.73 P75: 2.80 P99: 241.52 P99.9: 784.30 P99.99: 1611.45 ------------------------------------------------------ [ 0, 1 ] 257458 14.153% 14.153% ### ( 1, 2 ] 890945 48.978% 63.131% ########## ( 2, 3 ] 270316 14.860% 77.991% ### ( 3, 4 ] 94367 5.188% 83.179% # ( 4, 6 ] 85762 4.715% 87.893% # ( 6, 10 ] 22817 1.254% 89.148% ( 10, 15 ] 3864 0.212% 89.360% ( 15, 22 ] 619 0.034% 89.394% ( 22, 34 ] 78 0.004% 89.398% ( 34, 51 ] 55 0.003% 89.401% ( 51, 76 ] 115 0.006% 89.408% ( 76, 110 ] 35616 1.958% 91.366% ( 110, 170 ] 113344 6.231% 97.596% # ( 170, 250 ] 28561 1.570% 99.167% ( 250, 380 ] 7332 0.403% 99.570% ( 380, 580 ] 4671 0.257% 99.826% ( 580, 870 ] 1902 0.105% 99.931% ( 870, 1300 ] 855 0.047% 99.978% ( 1300, 1900 ] 424 0.023% 100.001% ( 1900, 2900 ] 391 0.021% 100.023% ( 2900, 4400 ] 417 0.023% 100.046% ( 4400, 6600 ] 77 0.004% 100.050% ( 6600, 9900 ] 19 0.001% 100.051% ( 9900, 14000 ] 4 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 827991 Average: 9.8619 StdDev: 109.88 Min: 1 Median: 2.2692 Max: 12738 Percentiles: P50: 2.27 P75: 3.53 P99: 145.51 P99.9: 852.22 P99.99: 2095.03 ------------------------------------------------------ [ 0, 1 ] 25164 3.039% 3.039% # ( 1, 2 ] 335579 40.529% 43.568% ######## ( 2, 3 ] 197793 23.888% 67.457% ##### ( 3, 4 ] 117731 14.219% 81.676% ### ( 4, 6 ] 109434 13.217% 94.892% ### ( 6, 10 ] 20088 2.426% 97.319% ( 10, 15 ] 4372 0.528% 97.847% ( 15, 22 ] 1209 0.146% 97.993% ( 22, 34 ] 51 0.006% 97.999% ( 34, 51 ] 47 0.006% 98.004% ( 51, 76 ] 40 0.005% 98.009% ( 76, 110 ] 3200 0.386% 98.396% ( 110, 170 ] 8453 1.021% 99.417% ( 170, 250 ] 1978 0.239% 99.656% ( 250, 380 ] 779 0.094% 99.750% ( 380, 580 ] 694 0.084% 99.833% ( 580, 870 ] 587 0.071% 99.904% ( 870, 1300 ] 435 0.053% 99.957% ( 1300, 1900 ] 235 0.028% 99.985% ( 1900, 2900 ] 201 0.024% 100.010% ( 2900, 4400 ] 253 0.031% 100.040% ( 4400, 6600 ] 69 0.008% 100.048% ( 6600, 9900 ] 15 0.002% 100.050% ( 9900, 14000 ] 8 0.001% 100.051% ** Level 2 read latency histogram (micros): Count: 60129 Average: 11.0912 StdDev: 127.03 Min: 1 Median: 1.9473 Max: 9588 Percentiles: P50: 1.95 P75: 3.01 P99: 147.36 P99.9: 2145.97 P99.99: 4399.35 ------------------------------------------------------ [ 0, 1 ] 1690 2.811% 2.811% # ( 1, 2 ] 29952 49.813% 52.624% ########## ( 2, 3 ] 13380 22.252% 74.876% #### ( 3, 4 ] 6102 10.148% 85.024% ## ( 4, 6 ] 5979 9.944% 94.967% ## ( 6, 10 ] 1625 2.703% 97.670% # ( 10, 15 ] 259 0.431% 98.101% ( 15, 22 ] 41 0.068% 98.169% ( 22, 34 ] 6 0.010% 98.179% ( 34, 51 ] 5 0.008% 98.187% ( 51, 76 ] 5 0.008% 98.196% ( 76, 110 ] 173 0.288% 98.483% ( 110, 170 ] 499 0.830% 99.313% ( 170, 250 ] 126 0.210% 99.523% ( 250, 380 ] 52 0.086% 99.609% ( 380, 580 ] 50 0.083% 99.692% ( 580, 870 ] 42 0.070% 99.762% ( 870, 1300 ] 48 0.080% 99.842% ( 1300, 1900 ] 27 0.045% 99.887% ( 1900, 2900 ] 32 0.053% 99.940% ( 2900, 4400 ] 30 0.050% 99.990% ( 4400, 6600 ] 4 0.007% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1283911 Average: 9.4936 StdDev: 117.36 Min: 1 Median: 1.9474 Max: 15635 Percentiles: P50: 1.95 P75: 2.98 P99: 14.88 P99.9: 620.02 P99.99: 968.08 ------------------------------------------------------ [ 0, 1 ] 27748 2.161% 2.161% ( 1, 2 ] 648342 50.497% 52.659% ########## ( 2, 3 ] 292652 22.794% 75.452% ##### ( 3, 4 ] 137383 10.700% 86.153% ## ( 4, 6 ] 131011 10.204% 96.357% ## ( 6, 10 ] 29061 2.263% 98.620% ( 10, 15 ] 4994 0.389% 99.009% ( 15, 22 ] 644 0.050% 99.059% ( 22, 34 ] 87 0.007% 99.066% ( 34, 51 ] 97 0.008% 99.074% ( 51, 76 ] 105 0.008% 99.082% ( 76, 110 ] 1875 0.146% 99.228% ( 110, 170 ] 5317 0.414% 99.642% ( 170, 250 ] 1429 0.111% 99.753% ( 250, 380 ] 755 0.059% 99.812% ( 380, 580 ] 979 0.076% 99.888% ( 580, 870 ] 1073 0.084% 99.972% ( 870, 1300 ] 1011 0.079% 100.051% ( 1300, 1900 ] 616 0.048% 100.099% ( 1900, 2900 ] 473 0.037% 100.136% ( 2900, 4400 ] 502 0.039% 100.175% ( 4400, 6600 ] 133 0.010% 100.185% ( 6600, 9900 ] 19 0.001% 100.187% ( 9900, 14000 ] 1 0.000% 100.187% ( 14000, 22000 ] 1 0.000% 100.187% ** Level 4 read latency histogram (micros): Count: 913266 Average: 28.9810 StdDev: 181.70 Min: 1 Median: 2.1052 Max: 17958 Percentiles: P50: 2.11 P75: 3.64 P99: 402.96 P99.9: 1730.64 P99.99: 2595.92 ------------------------------------------------------ [ 0, 1 ] 16886 1.849% 1.849% ( 1, 2 ] 419666 45.952% 47.801% ######### ( 2, 3 ] 190818 20.894% 68.695% #### ( 3, 4 ] 90031 9.858% 78.553% ## ( 4, 6 ] 84772 9.282% 87.836% ## ( 6, 10 ] 21297 2.332% 90.168% ( 10, 15 ] 3357 0.368% 90.535% ( 15, 22 ] 406 0.044% 90.580% ( 22, 34 ] 45 0.005% 90.585% ( 34, 51 ] 78 0.009% 90.593% ( 51, 76 ] 80 0.009% 90.602% ( 76, 110 ] 16465 1.803% 92.405% ( 110, 170 ] 45375 4.968% 97.373% # ( 170, 250 ] 10803 1.183% 98.556% ( 250, 380 ] 3669 0.402% 98.958% ( 380, 580 ] 3356 0.367% 99.325% ( 580, 870 ] 2483 0.272% 99.597% ( 870, 1300 ] 1987 0.218% 99.815% ( 1300, 1900 ] 1085 0.119% 99.934% ( 1900, 2900 ] 741 0.081% 100.015% ( 2900, 4400 ] 725 0.079% 100.094% ( 4400, 6600 ] 211 0.023% 100.117% ( 6600, 9900 ] 36 0.004% 100.121% ( 9900, 14000 ] 3 0.000% 100.121% ( 14000, 22000 ] 2 0.000% 100.122% ** Level 5 read latency histogram (micros): Count: 581635 Average: 210.4641 StdDev: 369.80 Min: 73 Median: 141.8654 Max: 18274 Percentiles: P50: 141.87 P75: 168.92 P99: 1795.81 P99.9: 5274.51 P99.99: 7705.90 ------------------------------------------------------ ( 51, 76 ] 130 0.022% 0.022% ( 76, 110 ] 119420 20.532% 20.554% #### ( 110, 170 ] 322483 55.444% 75.998% ########### ( 170, 250 ] 74332 12.780% 88.778% ### ( 250, 380 ] 23214 3.991% 92.769% # ( 380, 580 ] 17992 3.093% 95.863% # ( 580, 870 ] 9900 1.702% 97.565% ( 870, 1300 ] 5838 1.004% 98.569% ( 1300, 1900 ] 3037 0.522% 99.091% ( 1900, 2900 ] 2181 0.375% 99.466% ( 2900, 4400 ] 2202 0.379% 99.844% ( 4400, 6600 ] 816 0.140% 99.985% ( 6600, 9900 ] 95 0.016% 100.001% ( 9900, 14000 ] 6 0.001% 100.002% ( 14000, 22000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 45.3 total, 6.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 65.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.779 H:M:S, 72.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 149.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.679 H:M:S, 40.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/20-21:56:03 ... thread 0: (1000000,4000000) ops and (282968.8,82226.3) ops/second in (3.533958,48.646213) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/7 3.74 GB 169.9 4.9 0.0 4.9 8.7 3.7 0.0 2.3 119.7 210.7 42.08 30.58 71 0.593 5115K 13K 0.0 0.0 L1 12/12 1.42 GB 0.0 3.5 1.8 1.6 3.4 1.8 0.0 1.9 93.6 92.6 38.11 21.82 1 38.108 3622K 38K 0.0 0.0 L3 17/0 965.33 MB 1.0 3.6 1.7 1.9 3.5 1.6 1.2 2.1 114.6 113.5 31.94 17.11 22 1.452 1580K 8758 0.0 0.0 L4 174/0 9.54 GB 1.0 7.5 4.3 3.2 7.4 4.2 0.0 1.7 129.6 127.7 59.44 35.32 52 1.143 4107K 158 0.0 0.0 L5 1136/0 93.38 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1352/19 109.03 GB 0.0 19.5 7.8 11.7 23.1 11.4 5.5 6.1 116.4 137.6 171.57 104.82 146 1.175 14M 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.5 7.8 11.7 23.1 11.4 5.5 6.1 116.4 137.6 171.57 104.82 146 1.175 14M 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.5 7.8 11.7 19.3 7.6 0.0 0.0 128.5 127.2 155.44 94.06 89 1.746 14M 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 238.2 16.13 10.76 57 0.283 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.8 total, 48.6 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.06 GB write, 483.85 MB/s write, 19.50 GB read, 409.22 MB/s read, 171.6 seconds Interval compaction: 23.06 GB write, 485.39 MB/s write, 19.50 GB read, 410.52 MB/s read, 171.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 39, pending-compaction-bytes-stops: 0, total-delays: 39, total-stops: 25, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2235086 Average: 18.6826 StdDev: 93.63 Min: 0 Median: 1.6985 Max: 12843 Percentiles: P50: 1.70 P75: 2.64 P99: 235.55 P99.9: 699.05 P99.99: 1213.66 ------------------------------------------------------ [ 0, 1 ] 319875 14.312% 14.312% ### ( 1, 2 ] 1141966 51.093% 65.404% ########## ( 2, 3 ] 332791 14.889% 80.294% ### ( 3, 4 ] 111524 4.990% 85.283% # ( 4, 6 ] 96798 4.331% 89.614% # ( 6, 10 ] 26623 1.191% 90.805% ( 10, 15 ] 4410 0.197% 91.003% ( 15, 22 ] 731 0.033% 91.035% ( 22, 34 ] 88 0.004% 91.039% ( 34, 51 ] 56 0.003% 91.042% ( 51, 76 ] 117 0.005% 91.047% ( 76, 110 ] 36408 1.629% 92.676% ( 110, 170 ] 116456 5.210% 97.886% # ( 170, 250 ] 30381 1.359% 99.246% ( 250, 380 ] 8325 0.372% 99.618% ( 380, 580 ] 5410 0.242% 99.860% ( 580, 870 ] 2180 0.098% 99.958% ( 870, 1300 ] 909 0.041% 99.998% ( 1300, 1900 ] 434 0.019% 100.018% ( 1900, 2900 ] 405 0.018% 100.036% ( 2900, 4400 ] 420 0.019% 100.055% ( 4400, 6600 ] 77 0.003% 100.058% ( 6600, 9900 ] 20 0.001% 100.059% ( 9900, 14000 ] 4 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 829292 Average: 10.1942 StdDev: 110.32 Min: 1 Median: 2.2725 Max: 12738 Percentiles: P50: 2.27 P75: 3.54 P99: 150.87 P99.9: 856.94 P99.99: 2098.37 ------------------------------------------------------ [ 0, 1 ] 25164 3.034% 3.034% # ( 1, 2 ] 335579 40.466% 43.500% ######## ( 2, 3 ] 197793 23.851% 67.351% ##### ( 3, 4 ] 117731 14.197% 81.548% ### ( 4, 6 ] 109434 13.196% 94.744% ### ( 6, 10 ] 20088 2.422% 97.166% ( 10, 15 ] 4372 0.527% 97.693% ( 15, 22 ] 1209 0.146% 97.839% ( 22, 34 ] 51 0.006% 97.845% ( 34, 51 ] 47 0.006% 97.851% ( 51, 76 ] 40 0.005% 97.856% ( 76, 110 ] 3357 0.405% 98.260% ( 110, 170 ] 9006 1.086% 99.346% ( 170, 250 ] 2258 0.272% 99.619% ( 250, 380 ] 926 0.112% 99.730% ( 380, 580 ] 808 0.097% 99.828% ( 580, 870 ] 628 0.076% 99.903% ( 870, 1300 ] 441 0.053% 99.957% ( 1300, 1900 ] 237 0.029% 99.985% ( 1900, 2900 ] 202 0.024% 100.010% ( 2900, 4400 ] 253 0.031% 100.040% ( 4400, 6600 ] 69 0.008% 100.048% ( 6600, 9900 ] 15 0.002% 100.050% ( 9900, 14000 ] 8 0.001% 100.051% ** Level 2 read latency histogram (micros): Count: 60129 Average: 11.0912 StdDev: 127.03 Min: 1 Median: 1.9473 Max: 9588 Percentiles: P50: 1.95 P75: 3.01 P99: 147.36 P99.9: 2145.97 P99.99: 4399.35 ------------------------------------------------------ [ 0, 1 ] 1690 2.811% 2.811% # ( 1, 2 ] 29952 49.813% 52.624% ########## ( 2, 3 ] 13380 22.252% 74.876% #### ( 3, 4 ] 6102 10.148% 85.024% ## ( 4, 6 ] 5979 9.944% 94.967% ## ( 6, 10 ] 1625 2.703% 97.670% # ( 10, 15 ] 259 0.431% 98.101% ( 15, 22 ] 41 0.068% 98.169% ( 22, 34 ] 6 0.010% 98.179% ( 34, 51 ] 5 0.008% 98.187% ( 51, 76 ] 5 0.008% 98.196% ( 76, 110 ] 173 0.288% 98.483% ( 110, 170 ] 499 0.830% 99.313% ( 170, 250 ] 126 0.210% 99.523% ( 250, 380 ] 52 0.086% 99.609% ( 380, 580 ] 50 0.083% 99.692% ( 580, 870 ] 42 0.070% 99.762% ( 870, 1300 ] 48 0.080% 99.842% ( 1300, 1900 ] 27 0.045% 99.887% ( 1900, 2900 ] 32 0.053% 99.940% ( 2900, 4400 ] 30 0.050% 99.990% ( 4400, 6600 ] 4 0.007% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1290988 Average: 9.5025 StdDev: 117.14 Min: 1 Median: 1.9460 Max: 15635 Percentiles: P50: 1.95 P75: 2.98 P99: 15.74 P99.9: 620.59 P99.99: 969.29 ------------------------------------------------------ [ 0, 1 ] 28061 2.174% 2.174% ( 1, 2 ] 652708 50.559% 52.732% ########## ( 2, 3 ] 293951 22.769% 75.502% ##### ( 3, 4 ] 137807 10.675% 86.176% ## ( 4, 6 ] 131380 10.177% 96.353% ## ( 6, 10 ] 29102 2.254% 98.607% ( 10, 15 ] 5001 0.387% 98.995% ( 15, 22 ] 644 0.050% 99.045% ( 22, 34 ] 87 0.007% 99.051% ( 34, 51 ] 99 0.008% 99.059% ( 51, 76 ] 105 0.008% 99.067% ( 76, 110 ] 1902 0.147% 99.214% ( 110, 170 ] 5428 0.420% 99.635% ( 170, 250 ] 1486 0.115% 99.750% ( 250, 380 ] 782 0.061% 99.811% ( 380, 580 ] 1003 0.078% 99.888% ( 580, 870 ] 1079 0.084% 99.972% ( 870, 1300 ] 1013 0.078% 100.050% ( 1300, 1900 ] 617 0.048% 100.098% ( 1900, 2900 ] 475 0.037% 100.135% ( 2900, 4400 ] 502 0.039% 100.174% ( 4400, 6600 ] 133 0.010% 100.184% ( 6600, 9900 ] 19 0.001% 100.186% ( 9900, 14000 ] 1 0.000% 100.186% ( 14000, 22000 ] 1 0.000% 100.186% ** Level 4 read latency histogram (micros): Count: 929922 Average: 29.9892 StdDev: 181.36 Min: 1 Median: 2.1125 Max: 17958 Percentiles: P50: 2.11 P75: 3.67 P99: 432.62 P99.9: 1723.57 P99.99: 2593.97 ------------------------------------------------------ [ 0, 1 ] 17296 1.860% 1.860% ( 1, 2 ] 425957 45.806% 47.666% ######### ( 2, 3 ] 192920 20.746% 68.411% #### ( 3, 4 ] 90809 9.765% 78.177% ## ( 4, 6 ] 85420 9.186% 87.362% ## ( 6, 10 ] 21514 2.314% 89.676% ( 10, 15 ] 3378 0.363% 90.039% ( 15, 22 ] 408 0.044% 90.083% ( 22, 34 ] 46 0.005% 90.088% ( 34, 51 ] 79 0.008% 90.096% ( 51, 76 ] 81 0.009% 90.105% ( 76, 110 ] 17190 1.849% 91.954% ( 110, 170 ] 47954 5.157% 97.111% # ( 170, 250 ] 12139 1.305% 98.416% ( 250, 380 ] 4402 0.473% 98.889% ( 380, 580 ] 3914 0.421% 99.310% ( 580, 870 ] 2688 0.289% 99.599% ( 870, 1300 ] 2029 0.218% 99.817% ( 1300, 1900 ] 1088 0.117% 99.934% ( 1900, 2900 ] 745 0.080% 100.015% ( 2900, 4400 ] 727 0.078% 100.093% ( 4400, 6600 ] 211 0.023% 100.115% ( 6600, 9900 ] 36 0.004% 100.119% ( 9900, 14000 ] 3 0.000% 100.120% ( 14000, 22000 ] 2 0.000% 100.120% ** Level 5 read latency histogram (micros): Count: 621886 Average: 211.5123 StdDev: 360.62 Min: 73 Median: 143.0156 Max: 18274 Percentiles: P50: 143.02 P75: 172.89 P99: 1729.21 P99.9: 5157.91 P99.99: 7461.87 ------------------------------------------------------ ( 51, 76 ] 137 0.022% 0.022% ( 76, 110 ] 124260 19.981% 20.003% #### ( 110, 170 ] 339014 54.514% 74.517% ########### ( 170, 250 ] 83175 13.375% 87.892% ### ( 250, 380 ] 27747 4.462% 92.353% # ( 380, 580 ] 21824 3.509% 95.863% # ( 580, 870 ] 11227 1.805% 97.668% ( 870, 1300 ] 6087 0.979% 98.647% ( 1300, 1900 ] 3070 0.494% 99.141% ( 1900, 2900 ] 2230 0.359% 99.499% ( 2900, 4400 ] 2212 0.356% 99.855% ( 4400, 6600 ] 816 0.131% 99.986% ( 6600, 9900 ] 95 0.015% 100.001% ( 9900, 14000 ] 6 0.001% 100.002% ( 14000, 22000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 48.8 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 80.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.779 H:M:S, 67.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 278.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 252.689 micros/op 15811 ops/sec 60.208 seconds 951996 operations; 15.3 MB/s (242999 of 242999 found) Microseconds per read: Count: 951996 Average: 252.6911 StdDev: 652.19 Min: 3 Median: 176.3349 Max: 74781 Percentiles: P50: 176.33 P75: 238.14 P99: 1270.79 P99.9: 10305.33 P99.99: 27324.67 ------------------------------------------------------ ( 2, 3 ] 15 0.002% 0.002% ( 3, 4 ] 60 0.006% 0.008% ( 4, 6 ] 87 0.009% 0.017% ( 6, 10 ] 302 0.032% 0.049% ( 10, 15 ] 1995 0.210% 0.258% ( 15, 22 ] 2666 0.280% 0.538% ( 22, 34 ] 4341 0.456% 0.994% ( 34, 51 ] 1393 0.146% 1.141% ( 51, 76 ] 183 0.019% 1.160% ( 76, 110 ] 23344 2.452% 3.612% ( 110, 170 ] 417216 43.825% 47.437% ######### ( 170, 250 ] 308082 32.362% 79.799% ###### ( 250, 380 ] 103273 10.848% 90.647% ## ( 380, 580 ] 50341 5.288% 95.935% # ( 580, 870 ] 21152 2.222% 98.157% ( 870, 1300 ] 8611 0.905% 99.061% ( 1300, 1900 ] 3356 0.353% 99.414% ( 1900, 2900 ] 2010 0.211% 99.625% ( 2900, 4400 ] 1706 0.179% 99.804% ( 4400, 6600 ] 556 0.058% 99.863% ( 6600, 9900 ] 312 0.033% 99.895% ( 9900, 14000 ] 435 0.046% 99.941% ( 14000, 22000 ] 398 0.042% 99.983% ( 22000, 33000 ] 138 0.014% 99.997% ( 33000, 50000 ] 17 0.002% 99.999% ( 50000, 75000 ] 7 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12310530 rocksdb.bloom.filter.full.positive COUNT : 1071295 rocksdb.bloom.filter.full.true.positive COUNT : 951582 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 414 rocksdb.memtable.miss COUNT : 951582 rocksdb.l0.hit COUNT : 35530 rocksdb.l1.hit COUNT : 15207 rocksdb.l2andup.hit COUNT : 900845 rocksdb.compaction.key.drop.new COUNT : 236924 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4601725 rocksdb.number.keys.read COUNT : 951996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4748980200 rocksdb.bytes.read COUNT : 951996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1635 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 41831324 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26082839540 rocksdb.compact.write.bytes COUNT : 25843319472 rocksdb.flush.write.bytes COUNT : 4690140568 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 982 rocksdb.number.superversion_releases COUNT : 950 rocksdb.number.superversion_cleanups COUNT : 245 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 143 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4652223488 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1728512 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29850603688 rocksdb.non.last.level.read.count COUNT : 7076543 rocksdb.block.checksum.compute.count COUNT : 7402213 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 174.637639 P95 : 543.862483 P99 : 1270.154830 P100 : 74780.000000 COUNT : 951996 SUM : 239678438 rocksdb.db.write.micros P50 : 1.602987 P95 : 5.181323 P99 : 13.519855 P100 : 666969.000000 COUNT : 4601725 SUM : 54148394 rocksdb.compaction.times.micros P50 : 1182105.263158 P95 : 2033333.333333 P99 : 34280000.000000 P100 : 38107843.000000 COUNT : 92 SUM : 158338564 rocksdb.compaction.times.cpu_micros P50 : 754545.454545 P95 : 1536000.000000 P99 : 14640000.000000 P100 : 21815178.000000 COUNT : 92 SUM : 96914404 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 762.179487 P95 : 21066.666667 P99 : 121989.000000 P100 : 121989.000000 COUNT : 67 SUM : 447291 rocksdb.compaction.outfile.sync.micros P50 : 22687.500000 P95 : 213250.000000 P99 : 326700.000000 P100 : 340222.000000 COUNT : 287 SUM : 15404364 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 228.181818 P95 : 3750.000000 P99 : 5816.800000 P100 : 6567.000000 COUNT : 178 SUM : 143792 rocksdb.table.open.io.micros P50 : 7924.946467 P95 : 19477.386935 P99 : 23534.210526 P100 : 27517.000000 COUNT : 1635 SUM : 13491253 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.925685 P95 : 9.924612 P99 : 169.898256 P100 : 18105.000000 COUNT : 6320661 SUM : 82881785 rocksdb.read.block.get.micros P50 : 144.840649 P95 : 463.530439 P99 : 1239.134302 P100 : 23309.000000 COUNT : 1079989 SUM : 208753103 rocksdb.write.raw.block.micros P50 : 0.534285 P95 : 1.322642 P99 : 3.714957 P100 : 20941.000000 COUNT : 7398271 SUM : 18488924 rocksdb.numfiles.in.singlecompaction P50 : 2.553571 P95 : 3.975581 P99 : 13.950000 P100 : 18.000000 COUNT : 121 SUM : 393 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568078 P95 : 1191.607693 P99 : 2538.509221 P100 : 666781.000000 COUNT : 252370 SUM : 41856776 rocksdb.sst.read.micros P50 : 1.973433 P95 : 167.390981 P99 : 467.506244 P100 : 18274.000000 COUNT : 7076704 SUM : 272107067 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 951996 SUM : 951996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4601725 SUM : 4748980200 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218727.272727 P95 : 689625.000000 P99 : 899103.000000 P100 : 899103.000000 COUNT : 67 SUM : 18158031 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 289 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0