[2024-11-20 10:07:51.538045] Starting SPDK v25.01-pre git sha1 a5dab6cf7 / DPDK 24.03.0 initialization... [2024-11-20 10:07:51.538234] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1919529 ] Set seed to 1732093671533872 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 10:07:51.681904] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 10:07:51.785372] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 10:07:51.785424] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1919529' to capture a snapshot of events at runtime. [2024-11-20 10:07:51.785453] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 10:07:51.785468] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 10:07:51.785477] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1919529 for offline analysis/debug. [2024-11-20 10:07:51.786794] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 10:07:54 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-10:08:01 ... thread 0: (1000000,1000000) ops and (155463.8,155463.8) ops/second in (6.432365,6.432365) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.31 GB 50.1 0.3 0.0 0.3 1.2 0.9 0.0 1.4 38.2 144.9 8.23 4.31 12 0.686 319K 1796 0.0 0.0 L1 5/5 404.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/2 1.10 GB 1.0 2.0 1.4 0.6 1.9 1.4 0.0 1.4 109.9 108.5 18.18 10.33 10 1.818 1724K 9889 0.0 0.0 L4 138/8 10.25 GB 1.0 3.2 1.8 1.4 3.1 1.7 0.3 1.7 117.3 111.9 28.18 16.89 15 1.879 637K 0 0.0 0.0 L5 136/0 11.01 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 313/24 24.07 GB 0.0 5.5 3.2 2.3 6.2 3.9 2.3 7.2 102.9 115.7 54.60 31.53 37 1.476 2681K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 3.2 2.3 6.2 3.9 2.3 7.2 102.9 115.7 54.60 31.53 37 1.476 2681K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 3.2 2.3 5.3 3.0 0.0 0.0 115.2 111.5 48.76 28.84 26 1.875 2681K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 150.8 5.84 2.70 11 0.530 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.5 total, 6.4 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.17 GB write, 969.48 MB/s write, 5.49 GB read, 862.11 MB/s read, 54.6 seconds Interval compaction: 6.17 GB write, 981.96 MB/s write, 5.49 GB read, 873.20 MB/s read, 54.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 185612 Average: 46.0195 StdDev: 427.53 Min: 1 Median: 2.1995 Max: 59948 Percentiles: P50: 2.20 P75: 3.29 P99: 886.19 P99.9: 4152.03 P99.99: 9065.82 ------------------------------------------------------ [ 0, 1 ] 3684 1.985% 1.985% ( 1, 2 ] 78749 42.427% 44.411% ######## ( 2, 3 ] 51987 28.008% 72.420% ###### ( 3, 4 ] 16562 8.923% 81.343% ## ( 4, 6 ] 18449 9.940% 91.282% ## ( 6, 10 ] 5131 2.764% 94.047% # ( 10, 15 ] 1226 0.661% 94.707% ( 15, 22 ] 184 0.099% 94.806% ( 22, 34 ] 19 0.010% 94.817% ( 34, 51 ] 14 0.008% 94.824% ( 51, 76 ] 11 0.006% 94.830% ( 76, 110 ] 16 0.009% 94.839% ( 110, 170 ] 253 0.136% 94.975% ( 170, 250 ] 1348 0.726% 95.701% ( 250, 380 ] 2016 1.086% 96.787% ( 380, 580 ] 2191 1.180% 97.968% ( 580, 870 ] 1887 1.017% 98.984% ( 870, 1300 ] 767 0.413% 99.398% ( 1300, 1900 ] 308 0.166% 99.564% ( 1900, 2900 ] 283 0.152% 99.716% ( 2900, 4400 ] 409 0.220% 99.936% ( 4400, 6600 ] 83 0.045% 99.981% ( 6600, 9900 ] 22 0.012% 99.993% ( 9900, 14000 ] 5 0.003% 99.996% ( 14000, 22000 ] 12 0.006% 100.002% ( 22000, 33000 ] 8 0.004% 100.006% ( 33000, 50000 ] 1 0.001% 100.007% ( 50000, 75000 ] 3 0.002% 100.009% ** Level 1 read latency histogram (micros): Count: 518 Average: 893.0618 StdDev: 1229.45 Min: 102 Median: 515.3383 Max: 9081 Percentiles: P50: 515.34 P75: 835.97 P99: 7051.00 P99.9: 9081.00 P99.99: 9081.00 ------------------------------------------------------ ( 76, 110 ] 1 0.193% 0.193% ( 110, 170 ] 16 3.089% 3.282% # ( 170, 250 ] 58 11.197% 14.479% ## ( 250, 380 ] 94 18.147% 32.625% #### ( 380, 580 ] 133 25.676% 58.301% ##### ( 580, 870 ] 98 18.919% 77.220% #### ( 870, 1300 ] 52 10.039% 87.259% ## ( 1300, 1900 ] 15 2.896% 90.154% # ( 1900, 2900 ] 11 2.124% 92.278% ( 2900, 4400 ] 24 4.633% 96.911% # ( 4400, 6600 ] 10 1.931% 98.842% ( 6600, 9900 ] 6 1.158% 100.000% ** Level 2 read latency histogram (micros): Count: 294196 Average: 14.4560 StdDev: 220.67 Min: 1 Median: 2.2745 Max: 30542 Percentiles: P50: 2.27 P75: 3.25 P99: 13.46 P99.9: 2207.84 P99.99: 3438.55 ------------------------------------------------------ [ 0, 1 ] 2450 0.833% 0.833% ( 1, 2 ] 119788 40.717% 41.550% ######## ( 2, 3 ] 90552 30.779% 72.329% ###### ( 3, 4 ] 31439 10.686% 83.016% ## ( 4, 6 ] 36152 12.288% 95.304% ## ( 6, 10 ] 9120 3.100% 98.404% # ( 10, 15 ] 2533 0.861% 99.265% ( 15, 22 ] 397 0.135% 99.400% ( 22, 34 ] 56 0.019% 99.419% ( 34, 51 ] 44 0.015% 99.434% ( 51, 76 ] 47 0.016% 99.450% ( 76, 110 ] 19 0.006% 99.456% ( 110, 170 ] 16 0.005% 99.462% ( 170, 250 ] 36 0.012% 99.474% ( 250, 380 ] 171 0.058% 99.532% ( 380, 580 ] 329 0.112% 99.644% ( 580, 870 ] 332 0.113% 99.757% ( 870, 1300 ] 188 0.064% 99.821% ( 1300, 1900 ] 158 0.054% 99.875% ( 1900, 2900 ] 243 0.083% 99.957% ( 2900, 4400 ] 269 0.091% 100.049% ( 4400, 6600 ] 77 0.026% 100.075% ( 6600, 9900 ] 28 0.010% 100.084% ( 9900, 14000 ] 4 0.001% 100.086% ( 14000, 22000 ] 8 0.003% 100.088% ( 22000, 33000 ] 3 0.001% 100.089% ** Level 3 read latency histogram (micros): Count: 511606 Average: 15.7186 StdDev: 282.52 Min: 1 Median: 2.3011 Max: 47016 Percentiles: P50: 2.30 P75: 3.26 P99: 13.79 P99.9: 1087.23 P99.99: 1820.99 ------------------------------------------------------ [ 0, 1 ] 3829 0.748% 0.748% ( 1, 2 ] 203187 39.716% 40.464% ######## ( 2, 3 ] 162047 31.674% 72.138% ###### ( 3, 4 ] 55363 10.821% 82.960% ## ( 4, 6 ] 63706 12.452% 95.412% ## ( 6, 10 ] 15692 3.067% 98.479% # ( 10, 15 ] 3520 0.688% 99.167% ( 15, 22 ] 461 0.090% 99.257% ( 22, 34 ] 59 0.012% 99.269% ( 34, 51 ] 112 0.022% 99.290% ( 51, 76 ] 115 0.022% 99.313% ( 76, 110 ] 21 0.004% 99.317% ( 110, 170 ] 89 0.017% 99.334% ( 170, 250 ] 296 0.058% 99.392% ( 250, 380 ] 575 0.112% 99.505% ( 380, 580 ] 934 0.183% 99.687% ( 580, 870 ] 855 0.167% 99.854% ( 870, 1300 ] 462 0.090% 99.945% ( 1300, 1900 ] 267 0.052% 99.997% ( 1900, 2900 ] 319 0.062% 100.059% ( 2900, 4400 ] 407 0.080% 100.139% ( 4400, 6600 ] 103 0.020% 100.159% ( 6600, 9900 ] 32 0.006% 100.165% ( 9900, 14000 ] 13 0.003% 100.168% ( 14000, 22000 ] 29 0.006% 100.173% ( 22000, 33000 ] 18 0.004% 100.177% ( 33000, 50000 ] 4 0.001% 100.178% ** Level 4 read latency histogram (micros): Count: 470754 Average: 32.6307 StdDev: 398.57 Min: 1 Median: 2.2726 Max: 71727 Percentiles: P50: 2.27 P75: 3.29 P99: 641.81 P99.9: 2427.98 P99.99: 3108.25 ------------------------------------------------------ [ 0, 1 ] 4307 0.915% 0.915% ( 1, 2 ] 192115 40.810% 41.725% ######## ( 2, 3 ] 142891 30.354% 72.079% ###### ( 3, 4 ] 48166 10.232% 82.310% ## ( 4, 6 ] 53124 11.285% 93.595% ## ( 6, 10 ] 13727 2.916% 96.511% # ( 10, 15 ] 3229 0.686% 97.197% ( 15, 22 ] 494 0.105% 97.302% ( 22, 34 ] 55 0.012% 97.314% ( 34, 51 ] 87 0.018% 97.332% ( 51, 76 ] 68 0.014% 97.347% ( 76, 110 ] 29 0.006% 97.353% ( 110, 170 ] 312 0.066% 97.419% ( 170, 250 ] 1535 0.326% 97.745% ( 250, 380 ] 2380 0.506% 98.251% ( 380, 580 ] 2943 0.625% 98.876% ( 580, 870 ] 2742 0.582% 99.458% ( 870, 1300 ] 1205 0.256% 99.714% ( 1300, 1900 ] 530 0.113% 99.827% ( 1900, 2900 ] 652 0.139% 99.965% ( 2900, 4400 ] 835 0.177% 100.143% ( 4400, 6600 ] 174 0.037% 100.180% ( 6600, 9900 ] 39 0.008% 100.188% ( 9900, 14000 ] 16 0.003% 100.191% ( 14000, 22000 ] 30 0.006% 100.198% ( 22000, 33000 ] 25 0.005% 100.203% ( 33000, 50000 ] 6 0.001% 100.204% ( 50000, 75000 ] 3 0.001% 100.205% ** Level 5 read latency histogram (micros): Count: 9011 Average: 933.2279 StdDev: 1674.75 Min: 101 Median: 540.5697 Max: 66977 Percentiles: P50: 540.57 P75: 868.80 P99: 5610.82 P99.9: 26697.00 P99.99: 52472.50 ------------------------------------------------------ ( 76, 110 ] 3 0.033% 0.033% ( 110, 170 ] 202 2.242% 2.275% ( 170, 250 ] 1096 12.163% 14.438% ## ( 250, 380 ] 1598 17.734% 32.172% #### ( 380, 580 ] 2001 22.206% 54.378% #### ( 580, 870 ] 1866 20.708% 75.086% #### ( 870, 1300 ] 859 9.533% 84.619% ## ( 1300, 1900 ] 349 3.873% 88.492% # ( 1900, 2900 ] 363 4.028% 92.520% # ( 2900, 4400 ] 525 5.826% 98.346% # ( 4400, 6600 ] 107 1.187% 99.534% ( 6600, 9900 ] 24 0.266% 99.800% ( 9900, 14000 ] 1 0.011% 99.811% ( 14000, 22000 ] 5 0.055% 99.867% ( 22000, 33000 ] 7 0.078% 99.945% ( 33000, 50000 ] 4 0.044% 99.989% ( 50000, 75000 ] 1 0.011% 100.000% ** DB Stats ** Uptime(secs): 6.5 total, 6.4 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 150.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.716 H:M:S, 26.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 152.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.716 H:M:S, 26.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-10:08:04 ... thread 0: (1000000,2000000) ops and (266721.2,196432.8) ops/second in (3.749233,10.181598) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.28 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.8 87.0 199.9 16.63 11.73 32 0.520 1468K 8270 0.0 0.0 L1 5/5 404.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 997.91 MB 1.0 2.0 1.4 0.6 1.9 1.4 0.0 1.4 109.9 108.5 18.18 10.33 10 1.818 1724K 9889 0.0 0.0 L4 133/0 9.70 GB 1.0 4.0 2.0 2.1 3.8 1.7 0.3 1.9 127.7 118.9 32.36 20.30 17 1.903 772K 0 0.0 0.0 L5 144/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 318/14 24.92 GB 0.0 7.4 3.3 4.1 8.9 4.9 2.8 4.8 112.8 136.1 67.17 42.36 59 1.139 3965K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 3.3 4.1 8.9 4.9 2.8 4.8 112.8 136.1 67.17 42.36 59 1.139 3965K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 3.3 4.1 7.1 3.0 0.0 0.0 130.3 124.8 58.16 36.87 32 1.818 3965K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 209.4 9.01 5.49 27 0.334 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.3 total, 10.2 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.93 GB write, 890.61 MB/s write, 7.40 GB read, 737.95 MB/s read, 67.2 seconds Interval compaction: 8.93 GB write, 897.85 MB/s write, 7.40 GB read, 743.95 MB/s read, 67.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 535716 Average: 26.3549 StdDev: 257.77 Min: 1 Median: 1.7465 Max: 59948 Percentiles: P50: 1.75 P75: 2.64 P99: 479.38 P99.9: 1885.30 P99.99: 3584.05 ------------------------------------------------------ [ 0, 1 ] 57566 10.746% 10.746% ## ( 1, 2 ] 281703 52.584% 63.330% ########### ( 2, 3 ] 97692 18.236% 81.566% #### ( 3, 4 ] 29474 5.502% 87.068% # ( 4, 6 ] 27268 5.090% 92.158% # ( 6, 10 ] 8537 1.594% 93.751% ( 10, 15 ] 1820 0.340% 94.091% ( 15, 22 ] 270 0.050% 94.141% ( 22, 34 ] 45 0.008% 94.150% ( 34, 51 ] 18 0.003% 94.153% ( 51, 76 ] 19 0.004% 94.157% ( 76, 110 ] 253 0.047% 94.204% ( 110, 170 ] 5856 1.093% 95.297% ( 170, 250 ] 13153 2.455% 97.752% ( 250, 380 ] 5058 0.944% 98.696% ( 380, 580 ] 3276 0.612% 99.308% ( 580, 870 ] 2083 0.389% 99.697% ( 870, 1300 ] 783 0.146% 99.843% ( 1300, 1900 ] 315 0.059% 99.902% ( 1900, 2900 ] 287 0.054% 99.955% ( 2900, 4400 ] 411 0.077% 100.032% ( 4400, 6600 ] 83 0.015% 100.047% ( 6600, 9900 ] 27 0.005% 100.052% ( 9900, 14000 ] 5 0.001% 100.053% ( 14000, 22000 ] 12 0.002% 100.056% ( 22000, 33000 ] 8 0.001% 100.057% ( 33000, 50000 ] 1 0.000% 100.057% ( 50000, 75000 ] 3 0.001% 100.058% ** Level 1 read latency histogram (micros): Count: 1569 Average: 439.5526 StdDev: 778.47 Min: 94 Median: 231.2272 Max: 9081 Percentiles: P50: 231.23 P75: 393.43 P99: 4468.20 P99.9: 9037.05 P99.99: 9081.00 ------------------------------------------------------ ( 76, 110 ] 17 1.083% 1.083% ( 110, 170 ] 306 19.503% 20.586% #### ( 170, 250 ] 603 38.432% 59.018% ######## ( 250, 380 ] 239 15.233% 74.251% ### ( 380, 580 ] 175 11.154% 85.405% ## ( 580, 870 ] 110 7.011% 92.416% # ( 870, 1300 ] 53 3.378% 95.793% # ( 1300, 1900 ] 15 0.956% 96.750% ( 1900, 2900 ] 11 0.701% 97.451% ( 2900, 4400 ] 24 1.530% 98.980% ( 4400, 6600 ] 10 0.637% 99.618% ( 6600, 9900 ] 6 0.382% 100.000% ** Level 2 read latency histogram (micros): Count: 294196 Average: 14.4560 StdDev: 220.67 Min: 1 Median: 2.2745 Max: 30542 Percentiles: P50: 2.27 P75: 3.25 P99: 13.46 P99.9: 2207.84 P99.99: 3438.55 ------------------------------------------------------ [ 0, 1 ] 2450 0.833% 0.833% ( 1, 2 ] 119788 40.717% 41.550% ######## ( 2, 3 ] 90552 30.779% 72.329% ###### ( 3, 4 ] 31439 10.686% 83.016% ## ( 4, 6 ] 36152 12.288% 95.304% ## ( 6, 10 ] 9120 3.100% 98.404% # ( 10, 15 ] 2533 0.861% 99.265% ( 15, 22 ] 397 0.135% 99.400% ( 22, 34 ] 56 0.019% 99.419% ( 34, 51 ] 44 0.015% 99.434% ( 51, 76 ] 47 0.016% 99.450% ( 76, 110 ] 19 0.006% 99.456% ( 110, 170 ] 16 0.005% 99.462% ( 170, 250 ] 36 0.012% 99.474% ( 250, 380 ] 171 0.058% 99.532% ( 380, 580 ] 329 0.112% 99.644% ( 580, 870 ] 332 0.113% 99.757% ( 870, 1300 ] 188 0.064% 99.821% ( 1300, 1900 ] 158 0.054% 99.875% ( 1900, 2900 ] 243 0.083% 99.957% ( 2900, 4400 ] 269 0.091% 100.049% ( 4400, 6600 ] 77 0.026% 100.075% ( 6600, 9900 ] 28 0.010% 100.084% ( 9900, 14000 ] 4 0.001% 100.086% ( 14000, 22000 ] 8 0.003% 100.088% ( 22000, 33000 ] 3 0.001% 100.089% ** Level 3 read latency histogram (micros): Count: 525012 Average: 16.8647 StdDev: 279.85 Min: 1 Median: 2.3021 Max: 47016 Percentiles: P50: 2.30 P75: 3.29 P99: 197.69 P99.9: 1072.45 P99.99: 1811.23 ------------------------------------------------------ [ 0, 1 ] 4199 0.800% 0.800% ( 1, 2 ] 208608 39.734% 40.534% ######## ( 2, 3 ] 164492 31.331% 71.865% ###### ( 3, 4 ] 56099 10.685% 82.550% ## ( 4, 6 ] 64255 12.239% 94.789% ## ( 6, 10 ] 15912 3.031% 97.820% # ( 10, 15 ] 3560 0.678% 98.498% ( 15, 22 ] 463 0.088% 98.586% ( 22, 34 ] 60 0.011% 98.597% ( 34, 51 ] 112 0.021% 98.619% ( 51, 76 ] 115 0.022% 98.641% ( 76, 110 ] 64 0.012% 98.653% ( 110, 170 ] 1022 0.195% 98.847% ( 170, 250 ] 2314 0.441% 99.288% ( 250, 380 ] 1042 0.198% 99.487% ( 380, 580 ] 1060 0.202% 99.689% ( 580, 870 ] 892 0.170% 99.858% ( 870, 1300 ] 463 0.088% 99.947% ( 1300, 1900 ] 267 0.051% 99.998% ( 1900, 2900 ] 320 0.061% 100.058% ( 2900, 4400 ] 407 0.078% 100.136% ( 4400, 6600 ] 103 0.020% 100.156% ( 6600, 9900 ] 32 0.006% 100.162% ( 9900, 14000 ] 14 0.003% 100.164% ( 14000, 22000 ] 29 0.006% 100.170% ( 22000, 33000 ] 18 0.003% 100.173% ( 33000, 50000 ] 4 0.001% 100.174% ** Level 4 read latency histogram (micros): Count: 549019 Average: 38.4618 StdDev: 373.80 Min: 1 Median: 2.3126 Max: 71727 Percentiles: P50: 2.31 P75: 3.56 P99: 579.31 P99.9: 2240.43 P99.99: 3011.29 ------------------------------------------------------ [ 0, 1 ] 5455 0.994% 0.994% ( 1, 2 ] 220002 40.072% 41.065% ######## ( 2, 3 ] 156942 28.586% 69.651% ###### ( 3, 4 ] 52439 9.551% 79.203% ## ( 4, 6 ] 56783 10.343% 89.545% ## ( 6, 10 ] 15011 2.734% 92.280% # ( 10, 15 ] 3502 0.638% 92.917% ( 15, 22 ] 530 0.097% 93.014% ( 22, 34 ] 58 0.011% 93.024% ( 34, 51 ] 88 0.016% 93.040% ( 51, 76 ] 68 0.012% 93.053% ( 76, 110 ] 322 0.059% 93.112% ( 110, 170 ] 7258 1.322% 94.434% ( 170, 250 ] 15289 2.785% 97.218% # ( 250, 380 ] 5689 1.036% 98.255% ( 380, 580 ] 4107 0.748% 99.003% ( 580, 870 ] 2944 0.536% 99.539% ( 870, 1300 ] 1222 0.223% 99.761% ( 1300, 1900 ] 538 0.098% 99.859% ( 1900, 2900 ] 655 0.119% 99.979% ( 2900, 4400 ] 837 0.152% 100.131% ( 4400, 6600 ] 175 0.032% 100.163% ( 6600, 9900 ] 43 0.008% 100.171% ( 9900, 14000 ] 20 0.004% 100.174% ( 14000, 22000 ] 30 0.005% 100.180% ( 22000, 33000 ] 25 0.005% 100.185% ( 33000, 50000 ] 6 0.001% 100.186% ( 50000, 75000 ] 3 0.001% 100.186% ** Level 5 read latency histogram (micros): Count: 28580 Average: 443.3805 StdDev: 1007.37 Min: 93 Median: 229.7940 Max: 66977 Percentiles: P50: 229.79 P75: 383.04 P99: 4024.14 P99.9: 8635.44 P99.99: 42103.50 ------------------------------------------------------ ( 76, 110 ] 258 0.903% 0.903% ( 110, 170 ] 5471 19.143% 20.045% #### ( 170, 250 ] 11454 40.077% 60.122% ######## ( 250, 380 ] 4208 14.724% 74.846% ### ( 380, 580 ] 2892 10.119% 84.965% ## ( 580, 870 ] 2023 7.078% 92.043% # ( 870, 1300 ] 877 3.069% 95.112% # ( 1300, 1900 ] 352 1.232% 96.344% ( 1900, 2900 ] 365 1.277% 97.621% ( 2900, 4400 ] 526 1.840% 99.461% ( 4400, 6600 ] 110 0.385% 99.846% ( 6600, 9900 ] 25 0.087% 99.934% ( 9900, 14000 ] 1 0.003% 99.937% ( 14000, 22000 ] 6 0.021% 99.958% ( 22000, 33000 ] 7 0.024% 99.983% ( 33000, 50000 ] 4 0.014% 99.997% ( 50000, 75000 ] 1 0.003% 100.000% ** DB Stats ** Uptime(secs): 10.3 total, 3.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 191.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.716 H:M:S, 16.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 262.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-10:08:09 ... thread 0: (1000000,3000000) ops and (218698.3,203333.2) ops/second in (4.572510,14.754108) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/5 3.26 GB 287.9 2.6 0.0 2.6 5.5 2.8 0.0 1.9 108.5 223.9 24.93 19.52 53 0.470 2746K 14K 0.0 0.0 L1 5/5 404.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 997.91 MB 1.0 2.0 1.4 0.6 1.9 1.4 0.0 1.4 109.9 108.5 18.18 10.33 10 1.818 1724K 9889 0.0 0.0 L4 133/0 9.70 GB 1.0 4.0 2.0 2.1 3.8 1.7 0.3 1.9 127.7 118.9 32.36 20.30 17 1.903 772K 0 0.0 0.0 L5 144/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 319/10 25.89 GB 0.0 8.6 3.3 5.3 11.1 5.8 2.8 3.9 117.1 151.1 75.47 50.16 80 0.943 5243K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 3.3 5.3 11.1 5.8 2.8 3.9 117.1 151.1 75.47 50.16 80 0.943 5243K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 3.3 5.3 8.3 3.0 0.0 0.0 139.7 134.5 63.25 41.82 37 1.709 5243K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 236.6 12.23 8.33 43 0.284 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.8 interval Flush(GB): cumulative 2.826, interval 2.826 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.14 GB write, 768.39 MB/s write, 8.63 GB read, 595.36 MB/s read, 75.5 seconds Interval compaction: 11.14 GB write, 772.70 MB/s write, 8.63 GB read, 598.70 MB/s read, 75.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 21, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 838291 Average: 23.1505 StdDev: 208.88 Min: 1 Median: 1.6745 Max: 59948 Percentiles: P50: 1.67 P75: 2.47 P99: 365.02 P99.9: 1206.81 P99.99: 2823.94 ------------------------------------------------------ [ 0, 1 ] 113610 13.553% 13.553% ### ( 1, 2 ] 452993 54.038% 67.590% ########### ( 2, 3 ] 131315 15.665% 83.255% ### ( 3, 4 ] 38668 4.613% 87.868% # ( 4, 6 ] 34082 4.066% 91.933% # ( 6, 10 ] 10079 1.202% 93.136% ( 10, 15 ] 2171 0.259% 93.395% ( 15, 22 ] 326 0.039% 93.433% ( 22, 34 ] 65 0.008% 93.441% ( 34, 51 ] 24 0.003% 93.444% ( 51, 76 ] 23 0.003% 93.447% ( 76, 110 ] 746 0.089% 93.536% ( 110, 170 ] 13950 1.664% 95.200% ( 170, 250 ] 25536 3.046% 98.246% # ( 250, 380 ] 7143 0.852% 99.098% ( 380, 580 ] 3927 0.468% 99.567% ( 580, 870 ] 2172 0.259% 99.826% ( 870, 1300 ] 795 0.095% 99.921% ( 1300, 1900 ] 317 0.038% 99.958% ( 1900, 2900 ] 287 0.034% 99.993% ( 2900, 4400 ] 411 0.049% 100.042% ( 4400, 6600 ] 83 0.010% 100.052% ( 6600, 9900 ] 27 0.003% 100.055% ( 9900, 14000 ] 5 0.001% 100.055% ( 14000, 22000 ] 12 0.001% 100.057% ( 22000, 33000 ] 8 0.001% 100.058% ( 33000, 50000 ] 1 0.000% 100.058% ( 50000, 75000 ] 3 0.000% 100.058% ** Level 1 read latency histogram (micros): Count: 77952 Average: 16.8994 StdDev: 129.59 Min: 1 Median: 2.9605 Max: 9081 Percentiles: P50: 2.96 P75: 4.16 P99: 268.00 P99.9: 1188.90 P99.99: 5765.06 ------------------------------------------------------ [ 0, 1 ] 582 0.747% 0.747% ( 1, 2 ] 15588 19.997% 20.744% #### ( 2, 3 ] 23744 30.460% 51.203% ###### ( 3, 4 ] 17606 22.586% 73.789% ##### ( 4, 6 ] 12135 15.567% 89.356% ### ( 6, 10 ] 3388 4.346% 93.703% # ( 10, 15 ] 1075 1.379% 95.082% ( 15, 22 ] 423 0.543% 95.624% ( 22, 34 ] 103 0.132% 95.756% ( 34, 51 ] 10 0.013% 95.769% ( 51, 76 ] 1 0.001% 95.770% ( 76, 110 ] 47 0.060% 95.831% ( 110, 170 ] 893 1.146% 96.976% ( 170, 250 ] 1525 1.956% 98.933% ( 250, 380 ] 379 0.486% 99.419% ( 380, 580 ] 215 0.276% 99.695% ( 580, 870 ] 120 0.154% 99.849% ( 870, 1300 ] 54 0.069% 99.918% ( 1300, 1900 ] 15 0.019% 99.937% ( 1900, 2900 ] 11 0.014% 99.951% ( 2900, 4400 ] 24 0.031% 99.982% ( 4400, 6600 ] 10 0.013% 99.995% ( 6600, 9900 ] 6 0.008% 100.003% ** Level 2 read latency histogram (micros): Count: 294196 Average: 14.4560 StdDev: 220.67 Min: 1 Median: 2.2745 Max: 30542 Percentiles: P50: 2.27 P75: 3.25 P99: 13.46 P99.9: 2207.84 P99.99: 3438.55 ------------------------------------------------------ [ 0, 1 ] 2450 0.833% 0.833% ( 1, 2 ] 119788 40.717% 41.550% ######## ( 2, 3 ] 90552 30.779% 72.329% ###### ( 3, 4 ] 31439 10.686% 83.016% ## ( 4, 6 ] 36152 12.288% 95.304% ## ( 6, 10 ] 9120 3.100% 98.404% # ( 10, 15 ] 2533 0.861% 99.265% ( 15, 22 ] 397 0.135% 99.400% ( 22, 34 ] 56 0.019% 99.419% ( 34, 51 ] 44 0.015% 99.434% ( 51, 76 ] 47 0.016% 99.450% ( 76, 110 ] 19 0.006% 99.456% ( 110, 170 ] 16 0.005% 99.462% ( 170, 250 ] 36 0.012% 99.474% ( 250, 380 ] 171 0.058% 99.532% ( 380, 580 ] 329 0.112% 99.644% ( 580, 870 ] 332 0.113% 99.757% ( 870, 1300 ] 188 0.064% 99.821% ( 1300, 1900 ] 158 0.054% 99.875% ( 1900, 2900 ] 243 0.083% 99.957% ( 2900, 4400 ] 269 0.091% 100.049% ( 4400, 6600 ] 77 0.026% 100.075% ( 6600, 9900 ] 28 0.010% 100.084% ( 9900, 14000 ] 4 0.001% 100.086% ( 14000, 22000 ] 8 0.003% 100.088% ( 22000, 33000 ] 3 0.001% 100.089% ** Level 3 read latency histogram (micros): Count: 529434 Average: 18.3417 StdDev: 279.20 Min: 1 Median: 2.3156 Max: 47016 Percentiles: P50: 2.32 P75: 3.35 P99: 231.09 P99.9: 1068.34 P99.99: 1810.24 ------------------------------------------------------ [ 0, 1 ] 4199 0.793% 0.793% ( 1, 2 ] 208608 39.402% 40.195% ######## ( 2, 3 ] 164492 31.069% 71.265% ###### ( 3, 4 ] 56099 10.596% 81.861% ## ( 4, 6 ] 64255 12.137% 93.997% ## ( 6, 10 ] 15912 3.005% 97.003% # ( 10, 15 ] 3560 0.672% 97.675% ( 15, 22 ] 463 0.087% 97.763% ( 22, 34 ] 60 0.011% 97.774% ( 34, 51 ] 112 0.021% 97.795% ( 51, 76 ] 115 0.022% 97.817% ( 76, 110 ] 157 0.030% 97.846% ( 110, 170 ] 2611 0.493% 98.340% ( 170, 250 ] 4579 0.865% 99.204% ( 250, 380 ] 1396 0.264% 99.468% ( 380, 580 ] 1176 0.222% 99.690% ( 580, 870 ] 897 0.169% 99.860% ( 870, 1300 ] 463 0.087% 99.947% ( 1300, 1900 ] 267 0.050% 99.998% ( 1900, 2900 ] 320 0.060% 100.058% ( 2900, 4400 ] 407 0.077% 100.135% ( 4400, 6600 ] 103 0.019% 100.154% ( 6600, 9900 ] 32 0.006% 100.160% ( 9900, 14000 ] 14 0.003% 100.163% ( 14000, 22000 ] 29 0.005% 100.168% ( 22000, 33000 ] 18 0.003% 100.172% ( 33000, 50000 ] 4 0.001% 100.173% ** Level 4 read latency histogram (micros): Count: 583318 Average: 47.5643 StdDev: 364.86 Min: 1 Median: 2.4215 Max: 71727 Percentiles: P50: 2.42 P75: 4.09 P99: 570.64 P99.9: 2188.06 P99.99: 3005.14 ------------------------------------------------------ [ 0, 1 ] 5455 0.935% 0.935% ( 1, 2 ] 220014 37.718% 38.653% ######## ( 2, 3 ] 157034 26.921% 65.574% ##### ( 3, 4 ] 52494 8.999% 74.573% ## ( 4, 6 ] 56832 9.743% 84.316% ## ( 6, 10 ] 15016 2.574% 86.890% # ( 10, 15 ] 3507 0.601% 87.491% ( 15, 22 ] 530 0.091% 87.582% ( 22, 34 ] 58 0.010% 87.592% ( 34, 51 ] 88 0.015% 87.607% ( 51, 76 ] 68 0.012% 87.619% ( 76, 110 ] 1043 0.179% 87.798% ( 110, 170 ] 19438 3.332% 91.130% # ( 170, 250 ] 32824 5.627% 96.757% # ( 250, 380 ] 8394 1.439% 98.196% ( 380, 580 ] 4920 0.843% 99.039% ( 580, 870 ] 3060 0.525% 99.564% ( 870, 1300 ] 1230 0.211% 99.775% ( 1300, 1900 ] 541 0.093% 99.868% ( 1900, 2900 ] 655 0.112% 99.980% ( 2900, 4400 ] 837 0.143% 100.123% ( 4400, 6600 ] 175 0.030% 100.153% ( 6600, 9900 ] 43 0.007% 100.161% ( 9900, 14000 ] 20 0.003% 100.164% ( 14000, 22000 ] 30 0.005% 100.169% ( 22000, 33000 ] 25 0.004% 100.174% ( 33000, 50000 ] 6 0.001% 100.175% ( 50000, 75000 ] 3 0.001% 100.175% ** Level 5 read latency histogram (micros): Count: 53041 Average: 328.4700 StdDev: 751.35 Min: 90 Median: 208.1836 Max: 66977 Percentiles: P50: 208.18 P75: 265.29 P99: 3323.74 P99.9: 6399.18 P99.99: 30950.70 ------------------------------------------------------ ( 76, 110 ] 822 1.550% 1.550% ( 110, 170 ] 14242 26.851% 28.401% ##### ( 170, 250 ] 24003 45.254% 73.654% ######### ( 250, 380 ] 6069 11.442% 85.096% ## ( 380, 580 ] 3520 6.636% 91.733% # ( 580, 870 ] 2102 3.963% 95.696% # ( 870, 1300 ] 885 1.669% 97.364% ( 1300, 1900 ] 352 0.664% 98.028% ( 1900, 2900 ] 367 0.692% 98.720% ( 2900, 4400 ] 526 0.992% 99.712% ( 4400, 6600 ] 110 0.207% 99.919% ( 6600, 9900 ] 25 0.047% 99.966% ( 9900, 14000 ] 1 0.002% 99.968% ( 14000, 22000 ] 6 0.011% 99.979% ( 22000, 33000 ] 7 0.013% 99.992% ( 33000, 50000 ] 4 0.008% 100.000% ( 50000, 75000 ] 1 0.002% 100.002% ** DB Stats ** Uptime(secs): 14.8 total, 4.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 198.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.458 H:M:S, 16.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 215.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.742 H:M:S, 16.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/20-10:08:14 ... thread 0: (1000000,4000000) ops and (213842.6,205862.5) ops/second in (4.676336,19.430444) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.73 GB 200.2 3.4 0.0 3.4 7.1 3.7 0.0 1.9 111.9 235.4 30.92 25.14 71 0.436 3513K 17K 0.0 0.0 L1 9/0 850.50 MB 85.0 0.8 0.4 0.4 0.8 0.4 0.0 1.9 52.1 51.3 16.58 6.32 1 16.575 876K 13K 0.0 0.0 L3 19/0 997.91 MB 1.0 2.0 1.4 0.6 1.9 1.4 0.0 1.4 109.9 108.5 18.18 10.33 10 1.818 1724K 9889 0.0 0.0 L4 133/0 9.70 GB 1.0 4.0 2.0 2.1 3.8 1.7 0.3 1.9 127.7 118.9 32.36 20.30 17 1.903 772K 0 0.0 0.0 L5 144/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 324/11 26.80 GB 0.0 10.2 3.8 6.4 13.6 7.2 2.8 3.6 106.6 142.3 98.04 62.09 99 0.990 6886K 40K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 3.8 6.4 13.6 7.2 2.8 3.6 106.6 142.3 98.04 62.09 99 0.990 6886K 40K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 3.8 6.4 9.9 3.4 0.0 0.0 126.3 122.1 82.80 51.07 41 2.019 6886K 40K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 251.8 15.24 11.02 58 0.263 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.5 total, 19.4 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.62 GB write, 714.71 MB/s write, 10.21 GB read, 535.63 MB/s read, 98.0 seconds Interval compaction: 13.62 GB write, 717.75 MB/s write, 10.21 GB read, 537.91 MB/s read, 98.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 21, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1110511 Average: 23.8083 StdDev: 184.56 Min: 1 Median: 1.6562 Max: 59948 Percentiles: P50: 1.66 P75: 2.46 P99: 342.63 P99.9: 955.09 P99.99: 2021.77 ------------------------------------------------------ [ 0, 1 ] 163799 14.750% 14.750% ### ( 1, 2 ] 596524 53.716% 68.466% ########### ( 2, 3 ] 157587 14.190% 82.657% ### ( 3, 4 ] 48641 4.380% 87.037% # ( 4, 6 ] 40969 3.689% 90.726% # ( 6, 10 ] 11684 1.052% 91.778% ( 10, 15 ] 2657 0.239% 92.017% ( 15, 22 ] 436 0.039% 92.056% ( 22, 34 ] 115 0.010% 92.067% ( 34, 51 ] 32 0.003% 92.070% ( 51, 76 ] 27 0.002% 92.072% ( 76, 110 ] 1380 0.124% 92.196% ( 110, 170 ] 25167 2.266% 94.463% ( 170, 250 ] 43348 3.903% 98.366% # ( 250, 380 ] 9881 0.890% 99.256% ( 380, 580 ] 4717 0.425% 99.681% ( 580, 870 ] 2278 0.205% 99.886% ( 870, 1300 ] 806 0.073% 99.958% ( 1300, 1900 ] 318 0.029% 99.987% ( 1900, 2900 ] 287 0.026% 100.013% ( 2900, 4400 ] 411 0.037% 100.050% ( 4400, 6600 ] 83 0.007% 100.057% ( 6600, 9900 ] 27 0.002% 100.060% ( 9900, 14000 ] 5 0.000% 100.060% ( 14000, 22000 ] 12 0.001% 100.061% ( 22000, 33000 ] 8 0.001% 100.062% ( 33000, 50000 ] 1 0.000% 100.062% ( 50000, 75000 ] 3 0.000% 100.062% ** Level 1 read latency histogram (micros): Count: 108309 Average: 17.0592 StdDev: 113.77 Min: 0 Median: 3.1627 Max: 9081 Percentiles: P50: 3.16 P75: 4.36 P99: 249.48 P99.9: 988.37 P99.99: 5097.20 ------------------------------------------------------ [ 0, 1 ] 756 0.698% 0.698% ( 1, 2 ] 18307 16.903% 17.601% ### ( 2, 3 ] 30462 28.125% 45.726% ###### ( 3, 4 ] 28447 26.265% 71.990% ##### ( 4, 6 ] 18172 16.778% 88.768% ### ( 6, 10 ] 4457 4.115% 92.883% # ( 10, 15 ] 1601 1.478% 94.362% ( 15, 22 ] 621 0.573% 94.935% ( 22, 34 ] 138 0.127% 95.062% ( 34, 51 ] 16 0.015% 95.077% ( 51, 76 ] 2 0.002% 95.079% ( 76, 110 ] 85 0.078% 95.157% ( 110, 170 ] 1540 1.422% 96.579% ( 170, 250 ] 2639 2.437% 99.016% ( 250, 380 ] 551 0.509% 99.525% ( 380, 580 ] 259 0.239% 99.764% ( 580, 870 ] 132 0.122% 99.886% ( 870, 1300 ] 57 0.053% 99.938% ( 1300, 1900 ] 17 0.016% 99.954% ( 1900, 2900 ] 12 0.011% 99.965% ( 2900, 4400 ] 24 0.022% 99.987% ( 4400, 6600 ] 10 0.009% 99.996% ( 6600, 9900 ] 6 0.006% 100.002% ** Level 2 read latency histogram (micros): Count: 294196 Average: 14.4560 StdDev: 220.67 Min: 1 Median: 2.2745 Max: 30542 Percentiles: P50: 2.27 P75: 3.25 P99: 13.46 P99.9: 2207.84 P99.99: 3438.55 ------------------------------------------------------ [ 0, 1 ] 2450 0.833% 0.833% ( 1, 2 ] 119788 40.717% 41.550% ######## ( 2, 3 ] 90552 30.779% 72.329% ###### ( 3, 4 ] 31439 10.686% 83.016% ## ( 4, 6 ] 36152 12.288% 95.304% ## ( 6, 10 ] 9120 3.100% 98.404% # ( 10, 15 ] 2533 0.861% 99.265% ( 15, 22 ] 397 0.135% 99.400% ( 22, 34 ] 56 0.019% 99.419% ( 34, 51 ] 44 0.015% 99.434% ( 51, 76 ] 47 0.016% 99.450% ( 76, 110 ] 19 0.006% 99.456% ( 110, 170 ] 16 0.005% 99.462% ( 170, 250 ] 36 0.012% 99.474% ( 250, 380 ] 171 0.058% 99.532% ( 380, 580 ] 329 0.112% 99.644% ( 580, 870 ] 332 0.113% 99.757% ( 870, 1300 ] 188 0.064% 99.821% ( 1300, 1900 ] 158 0.054% 99.875% ( 1900, 2900 ] 243 0.083% 99.957% ( 2900, 4400 ] 269 0.091% 100.049% ( 4400, 6600 ] 77 0.026% 100.075% ( 6600, 9900 ] 28 0.010% 100.084% ( 9900, 14000 ] 4 0.001% 100.086% ( 14000, 22000 ] 8 0.003% 100.088% ( 22000, 33000 ] 3 0.001% 100.089% ** Level 3 read latency histogram (micros): Count: 533747 Average: 19.7706 StdDev: 278.59 Min: 1 Median: 2.3287 Max: 47016 Percentiles: P50: 2.33 P75: 3.41 P99: 242.09 P99.9: 1064.85 P99.99: 1809.27 ------------------------------------------------------ [ 0, 1 ] 4199 0.787% 0.787% ( 1, 2 ] 208608 39.084% 39.870% ######## ( 2, 3 ] 164492 30.818% 70.689% ###### ( 3, 4 ] 56099 10.510% 81.199% ## ( 4, 6 ] 64255 12.038% 93.238% ## ( 6, 10 ] 15912 2.981% 96.219% # ( 10, 15 ] 3560 0.667% 96.886% ( 15, 22 ] 463 0.087% 96.973% ( 22, 34 ] 60 0.011% 96.984% ( 34, 51 ] 112 0.021% 97.005% ( 51, 76 ] 115 0.022% 97.026% ( 76, 110 ] 237 0.044% 97.071% ( 110, 170 ] 4102 0.769% 97.839% ( 170, 250 ] 6875 1.288% 99.127% ( 250, 380 ] 1718 0.322% 99.449% ( 380, 580 ] 1285 0.241% 99.690% ( 580, 870 ] 911 0.171% 99.861% ( 870, 1300 ] 464 0.087% 99.948% ( 1300, 1900 ] 267 0.050% 99.998% ( 1900, 2900 ] 320 0.060% 100.058% ( 2900, 4400 ] 407 0.076% 100.134% ( 4400, 6600 ] 103 0.019% 100.153% ( 6600, 9900 ] 32 0.006% 100.159% ( 9900, 14000 ] 14 0.003% 100.162% ( 14000, 22000 ] 29 0.005% 100.167% ( 22000, 33000 ] 18 0.003% 100.170% ( 33000, 50000 ] 4 0.001% 100.171% ** Level 4 read latency histogram (micros): Count: 616288 Average: 55.4233 StdDev: 356.82 Min: 1 Median: 2.5265 Max: 71727 Percentiles: P50: 2.53 P75: 4.96 P99: 563.74 P99.9: 2137.73 P99.99: 2999.23 ------------------------------------------------------ [ 0, 1 ] 5455 0.885% 0.885% ( 1, 2 ] 220014 35.700% 36.585% ####### ( 2, 3 ] 157034 25.481% 62.066% ##### ( 3, 4 ] 52494 8.518% 70.583% ## ( 4, 6 ] 56832 9.222% 79.805% ## ( 6, 10 ] 15016 2.437% 82.242% ( 10, 15 ] 3507 0.569% 82.811% ( 15, 22 ] 530 0.086% 82.897% ( 22, 34 ] 58 0.009% 82.906% ( 34, 51 ] 88 0.014% 82.920% ( 51, 76 ] 68 0.011% 82.931% ( 76, 110 ] 1635 0.265% 83.197% ( 110, 170 ] 30783 4.995% 88.192% # ( 170, 250 ] 50399 8.178% 96.369% ## ( 250, 380 ] 11051 1.793% 98.163% ( 380, 580 ] 5618 0.912% 99.074% ( 580, 870 ] 3158 0.512% 99.587% ( 870, 1300 ] 1234 0.200% 99.787% ( 1300, 1900 ] 542 0.088% 99.875% ( 1900, 2900 ] 655 0.106% 99.981% ( 2900, 4400 ] 837 0.136% 100.117% ( 4400, 6600 ] 175 0.028% 100.145% ( 6600, 9900 ] 43 0.007% 100.152% ( 9900, 14000 ] 20 0.003% 100.155% ( 14000, 22000 ] 30 0.005% 100.160% ( 22000, 33000 ] 25 0.004% 100.164% ( 33000, 50000 ] 6 0.001% 100.165% ( 50000, 75000 ] 3 0.000% 100.166% ** Level 5 read latency histogram (micros): Count: 76534 Average: 287.3437 StdDev: 629.58 Min: 90 Median: 202.1369 Max: 66977 Percentiles: P50: 202.14 P75: 243.98 P99: 2664.74 P99.9: 5929.32 P99.99: 27258.94 ------------------------------------------------------ ( 76, 110 ] 1277 1.669% 1.669% ( 110, 170 ] 22295 29.131% 30.799% ###### ( 170, 250 ] 36581 47.797% 78.596% ########## ( 250, 380 ] 7870 10.283% 88.879% ## ( 380, 580 ] 4050 5.292% 94.171% # ( 580, 870 ] 2172 2.838% 97.009% # ( 870, 1300 ] 890 1.163% 98.172% ( 1300, 1900 ] 353 0.461% 98.633% ( 1900, 2900 ] 367 0.480% 99.113% ( 2900, 4400 ] 526 0.687% 99.800% ( 4400, 6600 ] 110 0.144% 99.944% ( 6600, 9900 ] 25 0.033% 99.976% ( 9900, 14000 ] 1 0.001% 99.978% ( 14000, 22000 ] 6 0.008% 99.986% ( 22000, 33000 ] 7 0.009% 99.995% ( 33000, 50000 ] 4 0.005% 100.000% ( 50000, 75000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 19.5 total, 4.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 201.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.399 H:M:S, 17.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 210.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.942 H:M:S, 20.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 334.075 micros/op 11948 ops/sec 20.253 seconds 241996 operations; 11.6 MB/s (59999 of 59999 found) Microseconds per read: Count: 241996 Average: 334.0847 StdDev: 931.15 Min: 2 Median: 229.6006 Max: 106048 Percentiles: P50: 229.60 P75: 330.66 P99: 2296.98 P99.9: 12721.68 P99.99: 32832.97 ------------------------------------------------------ ( 1, 2 ] 12 0.005% 0.005% ( 2, 3 ] 71 0.029% 0.034% ( 3, 4 ] 117 0.048% 0.083% ( 4, 6 ] 219 0.090% 0.173% ( 6, 10 ] 402 0.166% 0.339% ( 10, 15 ] 1194 0.493% 0.833% ( 15, 22 ] 3738 1.545% 2.377% ( 22, 34 ] 5037 2.081% 4.459% ( 34, 51 ] 2410 0.996% 5.455% ( 51, 76 ] 455 0.188% 5.643% ( 76, 110 ] 162 0.067% 5.710% ( 110, 170 ] 21070 8.707% 14.416% ## ( 170, 250 ] 115584 47.763% 62.179% ########## ( 250, 380 ] 50006 20.664% 82.843% #### ( 380, 580 ] 25159 10.396% 93.240% ## ( 580, 870 ] 9434 3.898% 97.138% # ( 870, 1300 ] 3048 1.260% 98.397% ( 1300, 1900 ] 1121 0.463% 98.861% ( 1900, 2900 ] 849 0.351% 99.212% ( 2900, 4400 ] 1157 0.478% 99.690% ( 4400, 6600 ] 293 0.121% 99.811% ( 6600, 9900 ] 152 0.063% 99.874% ( 9900, 14000 ] 93 0.038% 99.912% ( 14000, 22000 ] 111 0.046% 99.958% ( 22000, 33000 ] 79 0.033% 99.990% ( 33000, 50000 ] 13 0.005% 99.996% ( 50000, 75000 ] 7 0.003% 99.999% ( 75000, 110000 ] 3 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3921455 rocksdb.bloom.filter.full.positive COUNT : 278945 rocksdb.bloom.filter.full.true.positive COUNT : 240895 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 1101 rocksdb.memtable.miss COUNT : 240895 rocksdb.l0.hit COUNT : 30650 rocksdb.l1.hit COUNT : 5373 rocksdb.l2andup.hit COUNT : 204872 rocksdb.compaction.key.drop.new COUNT : 352326 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4091132 rocksdb.number.keys.read COUNT : 241996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4222048224 rocksdb.bytes.read COUNT : 241996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 468 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3877861 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11357408944 rocksdb.compact.write.bytes COUNT : 10988379800 rocksdb.flush.write.bytes COUNT : 4155538122 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 22 rocksdb.number.superversion_acquires COUNT : 710 rocksdb.number.superversion_releases COUNT : 692 rocksdb.number.superversion_cleanups COUNT : 176 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 123 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4128084992 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7142400 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 11736255044 rocksdb.non.last.level.read.count COUNT : 2803860 rocksdb.block.checksum.compute.count COUNT : 3032296 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 228.908126 P95 : 709.855076 P99 : 2295.806832 P100 : 106048.000000 COUNT : 241996 SUM : 80626159 rocksdb.db.write.micros P50 : 1.552748 P95 : 5.107486 P99 : 7.940598 P100 : 568352.000000 COUNT : 4091132 SUM : 14896127 rocksdb.compaction.times.micros P50 : 1600000.000000 P95 : 2821428.571429 P99 : 16575273.000000 P100 : 16575273.000000 COUNT : 42 SUM : 83771366 rocksdb.compaction.times.cpu_micros P50 : 1074736.842105 P95 : 1840769.230769 P99 : 5576000.000000 P100 : 6316091.000000 COUNT : 42 SUM : 52030757 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 685.454545 P95 : 5500.000000 P99 : 79314.000000 P100 : 79314.000000 COUNT : 60 SUM : 146140 rocksdb.compaction.outfile.sync.micros P50 : 2400.000000 P95 : 8514.000000 P99 : 8880.000000 P100 : 8880.000000 COUNT : 126 SUM : 385462 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 170.000000 P95 : 836.166667 P99 : 3972.500000 P100 : 4400.000000 COUNT : 114 SUM : 40492 rocksdb.table.open.io.micros P50 : 6050.000000 P95 : 19433.333333 P99 : 26565.000000 P100 : 27559.000000 COUNT : 468 SUM : 3148299 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.324700 P95 : 9.993995 P99 : 229.730147 P100 : 59954.000000 COUNT : 2749760 SUM : 44298336 rocksdb.read.block.get.micros P50 : 197.340506 P95 : 555.210111 P99 : 1889.910828 P100 : 71732.000000 COUNT : 282084 SUM : 70962488 rocksdb.write.raw.block.micros P50 : 0.544722 P95 : 1.561430 P99 : 4.513070 P100 : 101386.000000 COUNT : 3668524 SUM : 12658832 rocksdb.numfiles.in.singlecompaction P50 : 3.045455 P95 : 5.650000 P99 : 8.920000 P100 : 10.000000 COUNT : 54 SUM : 189 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557886 P95 : 1102.663183 P99 : 1277.492980 P100 : 568168.000000 COUNT : 18967 SUM : 3879441 rocksdb.sst.read.micros P50 : 2.045200 P95 : 211.379152 P99 : 477.514541 P100 : 71727.000000 COUNT : 2803919 SUM : 102754905 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 241996 SUM : 241996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4091132 SUM : 4222048224 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218333.333333 P95 : 666666.666667 P99 : 866597.000000 P100 : 866597.000000 COUNT : 60 SUM : 15603279 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 145 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0