[2024-11-20 17:14:47.870091] Starting SPDK v25.01-pre git sha1 f40c2e7bb / DPDK 24.03.0 initialization... [2024-11-20 17:14:47.870253] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4035613 ] Set seed to 1732119287866565 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 17:14:48.011112] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 17:14:48.117040] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 17:14:48.117088] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4035613' to capture a snapshot of events at runtime. [2024-11-20 17:14:48.117118] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 17:14:48.117132] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 17:14:48.117142] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4035613 for offline analysis/debug. [2024-11-20 17:14:48.118347] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 17:14:51 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-17:14:56 ... thread 0: (1000000,1000000) ops and (172525.7,172525.7) ops/second in (5.796238,5.796238) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 1.50 GB 50.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 42.2 151.8 7.44 3.84 12 0.620 319K 1859 0.0 0.0 L1 7/7 593.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/3 1.22 GB 1.0 1.8 1.3 0.5 1.7 1.3 0.0 1.3 105.6 103.6 17.09 10.11 8 2.137 1114K 5009 0.0 0.0 L4 141/10 10.29 GB 1.0 2.8 1.6 1.2 2.6 1.4 0.3 1.7 126.6 119.5 22.69 14.47 13 1.745 541K 0 0.0 0.0 L5 132/0 10.83 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 315/30 24.42 GB 0.0 4.9 2.9 2.0 5.5 3.5 1.9 6.9 105.7 118.8 47.22 28.42 33 1.431 1975K 6868 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 2.9 2.0 5.5 3.5 1.9 6.9 105.7 118.8 47.22 28.42 33 1.431 1975K 6868 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 2.9 2.0 4.7 2.7 0.0 0.0 118.7 114.0 42.05 25.97 22 1.911 1975K 6868 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 157.9 5.18 2.45 11 0.471 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.48 GB write, 955.74 MB/s write, 4.88 GB read, 850.17 MB/s read, 47.2 seconds Interval compaction: 5.48 GB write, 967.99 MB/s write, 4.88 GB read, 861.07 MB/s read, 47.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 112611 Average: 85.3468 StdDev: 620.35 Min: 1 Median: 2.2747 Max: 60814 Percentiles: P50: 2.27 P75: 3.67 P99: 1638.29 P99.9: 5334.73 P99.99: 20738.90 ------------------------------------------------------ [ 0, 1 ] 2247 1.995% 1.995% ( 1, 2 ] 46011 40.858% 42.854% ######## ( 2, 3 ] 29291 26.011% 68.864% ##### ( 3, 4 ] 10382 9.219% 78.084% ## ( 4, 6 ] 10751 9.547% 87.631% ## ( 6, 10 ] 2992 2.657% 90.288% # ( 10, 15 ] 586 0.520% 90.808% ( 15, 22 ] 90 0.080% 90.888% ( 22, 34 ] 24 0.021% 90.909% ( 34, 51 ] 30 0.027% 90.936% ( 51, 76 ] 22 0.020% 90.956% ( 76, 110 ] 8 0.007% 90.963% ( 110, 170 ] 108 0.096% 91.059% ( 170, 250 ] 784 0.696% 91.755% ( 250, 380 ] 1847 1.640% 93.395% ( 380, 580 ] 3102 2.755% 96.150% # ( 580, 870 ] 2256 2.003% 98.153% ( 870, 1300 ] 787 0.699% 98.852% ( 1300, 1900 ] 296 0.263% 99.115% ( 1900, 2900 ] 427 0.379% 99.494% ( 2900, 4400 ] 420 0.373% 99.867% ( 4400, 6600 ] 88 0.078% 99.945% ( 6600, 9900 ] 33 0.029% 99.974% ( 9900, 14000 ] 11 0.010% 99.984% ( 14000, 22000 ] 8 0.007% 99.991% ( 22000, 33000 ] 16 0.014% 100.005% ( 33000, 50000 ] 4 0.004% 100.009% ( 50000, 75000 ] 2 0.002% 100.011% ** Level 1 read latency histogram (micros): Count: 638 Average: 1147.6803 StdDev: 2942.02 Min: 101 Median: 553.5632 Max: 55025 Percentiles: P50: 553.56 P75: 858.77 P99: 7111.50 P99.9: 29491.00 P99.99: 32649.10 ------------------------------------------------------ ( 76, 110 ] 1 0.157% 0.157% ( 110, 170 ] 6 0.940% 1.097% ( 170, 250 ] 51 7.994% 9.091% ## ( 250, 380 ] 110 17.241% 26.332% ### ( 380, 580 ] 174 27.273% 53.605% ##### ( 580, 870 ] 142 22.257% 75.862% #### ( 870, 1300 ] 55 8.621% 84.483% ## ( 1300, 1900 ] 14 2.194% 86.677% ( 1900, 2900 ] 28 4.389% 91.066% # ( 2900, 4400 ] 36 5.643% 96.708% # ( 4400, 6600 ] 14 2.194% 98.903% ( 6600, 9900 ] 4 0.627% 99.530% ( 9900, 14000 ] 1 0.157% 99.687% ( 22000, 33000 ] 2 0.313% 100.000% ( 50000, 75000 ] 1 0.157% 100.157% ** Level 2 read latency histogram (micros): Count: 239652 Average: 14.0126 StdDev: 286.87 Min: 1 Median: 2.2038 Max: 37228 Percentiles: P50: 2.20 P75: 3.17 P99: 13.60 P99.9: 1596.01 P99.99: 3262.93 ------------------------------------------------------ [ 0, 1 ] 2727 1.138% 1.138% ( 1, 2 ] 102915 42.944% 44.081% ######### ( 2, 3 ] 69593 29.039% 73.121% ###### ( 3, 4 ] 26287 10.969% 84.089% ## ( 4, 6 ] 27572 11.505% 95.594% ## ( 6, 10 ] 7012 2.926% 98.520% # ( 10, 15 ] 1598 0.667% 99.187% ( 15, 22 ] 271 0.113% 99.300% ( 22, 34 ] 68 0.028% 99.329% ( 34, 51 ] 66 0.028% 99.356% ( 51, 76 ] 50 0.021% 99.377% ( 76, 110 ] 21 0.009% 99.386% ( 110, 170 ] 13 0.005% 99.391% ( 170, 250 ] 67 0.028% 99.419% ( 250, 380 ] 235 0.098% 99.517% ( 380, 580 ] 393 0.164% 99.681% ( 580, 870 ] 319 0.133% 99.814% ( 870, 1300 ] 157 0.066% 99.880% ( 1300, 1900 ] 98 0.041% 99.921% ( 1900, 2900 ] 137 0.057% 99.978% ( 2900, 4400 ] 120 0.050% 100.028% ( 4400, 6600 ] 39 0.016% 100.044% ( 6600, 9900 ] 20 0.008% 100.053% ( 9900, 14000 ] 9 0.004% 100.056% ( 14000, 22000 ] 15 0.006% 100.063% ( 22000, 33000 ] 9 0.004% 100.066% ( 33000, 50000 ] 2 0.001% 100.067% ** Level 3 read latency histogram (micros): Count: 452763 Average: 14.0465 StdDev: 239.95 Min: 1 Median: 2.2243 Max: 40213 Percentiles: P50: 2.22 P75: 3.14 P99: 13.95 P99.9: 843.05 P99.99: 1357.03 ------------------------------------------------------ [ 0, 1 ] 4426 0.978% 0.978% ( 1, 2 ] 191241 42.239% 43.216% ######## ( 2, 3 ] 136952 30.248% 73.464% ###### ( 3, 4 ] 50090 11.063% 84.527% ## ( 4, 6 ] 50880 11.238% 95.765% ## ( 6, 10 ] 12665 2.797% 98.562% # ( 10, 15 ] 2505 0.553% 99.116% ( 15, 22 ] 352 0.078% 99.193% ( 22, 34 ] 82 0.018% 99.212% ( 34, 51 ] 181 0.040% 99.251% ( 51, 76 ] 136 0.030% 99.282% ( 76, 110 ] 40 0.009% 99.290% ( 110, 170 ] 52 0.011% 99.302% ( 170, 250 ] 242 0.053% 99.355% ( 250, 380 ] 663 0.146% 99.502% ( 380, 580 ] 1093 0.241% 99.743% ( 580, 870 ] 783 0.173% 99.916% ( 870, 1300 ] 316 0.070% 99.986% ( 1300, 1900 ] 197 0.044% 100.029% ( 1900, 2900 ] 273 0.060% 100.090% ( 2900, 4400 ] 273 0.060% 100.150% ( 4400, 6600 ] 58 0.013% 100.163% ( 6600, 9900 ] 39 0.009% 100.171% ( 9900, 14000 ] 13 0.003% 100.174% ( 14000, 22000 ] 17 0.004% 100.178% ( 22000, 33000 ] 8 0.002% 100.180% ( 33000, 50000 ] 2 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 426746 Average: 29.6363 StdDev: 407.99 Min: 1 Median: 2.2078 Max: 91762 Percentiles: P50: 2.21 P75: 3.22 P99: 600.00 P99.9: 2198.03 P99.99: 2930.07 ------------------------------------------------------ [ 0, 1 ] 4552 1.067% 1.067% ( 1, 2 ] 183434 42.984% 44.051% ######### ( 2, 3 ] 122199 28.635% 72.686% ###### ( 3, 4 ] 45898 10.755% 83.441% ## ( 4, 6 ] 45749 10.720% 94.162% ## ( 6, 10 ] 11520 2.699% 96.861% # ( 10, 15 ] 2331 0.546% 97.408% ( 15, 22 ] 310 0.073% 97.480% ( 22, 34 ] 54 0.013% 97.493% ( 34, 51 ] 134 0.031% 97.524% ( 51, 76 ] 103 0.024% 97.548% ( 76, 110 ] 35 0.008% 97.557% ( 110, 170 ] 126 0.030% 97.586% ( 170, 250 ] 667 0.156% 97.742% ( 250, 380 ] 1972 0.462% 98.205% ( 380, 580 ] 3229 0.757% 98.961% ( 580, 870 ] 2415 0.566% 99.527% ( 870, 1300 ] 981 0.230% 99.757% ( 1300, 1900 ] 453 0.106% 99.863% ( 1900, 2900 ] 531 0.124% 99.988% ( 2900, 4400 ] 565 0.132% 100.120% ( 4400, 6600 ] 126 0.030% 100.150% ( 6600, 9900 ] 33 0.008% 100.157% ( 9900, 14000 ] 14 0.003% 100.161% ( 14000, 22000 ] 18 0.004% 100.165% ( 22000, 33000 ] 18 0.004% 100.169% ( 33000, 50000 ] 8 0.002% 100.171% ( 75000, 110000 ] 2 0.000% 100.171% ** Level 5 read latency histogram (micros): Count: 7748 Average: 970.0874 StdDev: 2295.01 Min: 105 Median: 544.1091 Max: 71391 Percentiles: P50: 544.11 P75: 836.20 P99: 5914.64 P99.9: 33535.50 P99.99: 48353.55 ------------------------------------------------------ ( 76, 110 ] 2 0.026% 0.026% ( 110, 170 ] 85 1.097% 1.123% ( 170, 250 ] 483 6.234% 7.357% # ( 250, 380 ] 1379 17.798% 25.155% #### ( 380, 580 ] 2346 30.279% 55.434% ###### ( 580, 870 ] 1716 22.148% 77.581% #### ( 870, 1300 ] 687 8.867% 86.448% ## ( 1300, 1900 ] 266 3.433% 89.881% # ( 1900, 2900 ] 308 3.975% 93.856% # ( 2900, 4400 ] 340 4.388% 98.245% # ( 4400, 6600 ] 85 1.097% 99.342% ( 6600, 9900 ] 20 0.258% 99.600% ( 9900, 14000 ] 8 0.103% 99.703% ( 14000, 22000 ] 10 0.129% 99.832% ( 22000, 33000 ] 5 0.065% 99.897% ( 33000, 50000 ] 8 0.103% 100.000% ( 50000, 75000 ] 3 0.039% 100.039% ** DB Stats ** Uptime(secs): 5.9 total, 5.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 167.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.263 H:M:S, 21.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.72 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.263 H:M:S, 21.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/20-17:15:00 ... thread 0: (1000000,2000000) ops and (252339.1,204935.7) ops/second in (3.962921,9.759159) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.53 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.8 81.3 186.9 17.79 11.59 32 0.556 1468K 7963 0.0 0.0 L1 7/7 593.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 999.84 MB 1.0 1.8 1.3 0.5 1.7 1.3 0.0 1.3 105.6 103.6 17.09 10.11 8 2.137 1114K 5009 0.0 0.0 L4 133/0 9.49 GB 1.0 3.8 1.8 2.0 3.5 1.5 0.3 1.9 137.7 127.3 28.01 18.53 16 1.751 770K 0 0.0 0.0 L5 144/0 11.75 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 320/17 25.33 GB 0.0 6.9 3.1 3.8 8.5 4.6 2.8 4.6 113.0 137.7 62.90 40.23 56 1.123 3353K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 3.1 3.8 8.5 4.6 2.8 4.6 113.0 137.7 62.90 40.23 56 1.123 3353K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 3.1 3.8 6.6 2.8 0.0 0.0 131.2 125.1 54.17 34.66 29 1.868 3353K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 216.0 8.73 5.57 27 0.323 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.8 total, 9.8 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.46 GB write, 880.79 MB/s write, 6.94 GB read, 722.74 MB/s read, 62.9 seconds Interval compaction: 8.46 GB write, 887.50 MB/s write, 6.94 GB read, 728.25 MB/s read, 62.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 22, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 475908 Average: 36.0515 StdDev: 308.65 Min: 1 Median: 1.6889 Max: 60814 Percentiles: P50: 1.69 P75: 2.55 P99: 556.35 P99.9: 2168.91 P99.99: 3312.18 ------------------------------------------------------ [ 0, 1 ] 61628 12.950% 12.950% ### ( 1, 2 ] 255942 53.780% 66.729% ########### ( 2, 3 ] 71437 15.011% 81.740% ### ( 3, 4 ] 22299 4.686% 86.426% # ( 4, 6 ] 17560 3.690% 90.115% # ( 6, 10 ] 5850 1.229% 91.345% ( 10, 15 ] 1034 0.217% 91.562% ( 15, 22 ] 151 0.032% 91.594% ( 22, 34 ] 52 0.011% 91.604% ( 34, 51 ] 32 0.007% 91.611% ( 51, 76 ] 24 0.005% 91.616% ( 76, 110 ] 242 0.051% 91.667% ( 110, 170 ] 6175 1.298% 92.965% ( 170, 250 ] 17223 3.619% 96.584% # ( 250, 380 ] 7303 1.535% 98.118% ( 380, 580 ] 4761 1.000% 99.119% ( 580, 870 ] 2496 0.524% 99.643% ( 870, 1300 ] 811 0.170% 99.813% ( 1300, 1900 ] 298 0.063% 99.876% ( 1900, 2900 ] 428 0.090% 99.966% ( 2900, 4400 ] 420 0.088% 100.054% ( 4400, 6600 ] 88 0.018% 100.073% ( 6600, 9900 ] 33 0.007% 100.080% ( 9900, 14000 ] 11 0.002% 100.082% ( 14000, 22000 ] 8 0.002% 100.084% ( 22000, 33000 ] 16 0.003% 100.087% ( 33000, 50000 ] 4 0.001% 100.088% ( 50000, 75000 ] 2 0.000% 100.088% ** Level 1 read latency histogram (micros): Count: 2207 Average: 489.6126 StdDev: 1638.04 Min: 101 Median: 234.5532 Max: 55025 Percentiles: P50: 234.55 P75: 384.17 P99: 4355.42 P99.9: 13151.30 P99.99: 31786.15 ------------------------------------------------------ ( 76, 110 ] 11 0.498% 0.498% ( 110, 170 ] 334 15.134% 15.632% ### ( 170, 250 ] 940 42.592% 58.224% ######### ( 250, 380 ] 365 16.538% 74.762% ### ( 380, 580 ] 252 11.418% 86.180% ## ( 580, 870 ] 150 6.797% 92.977% # ( 870, 1300 ] 56 2.537% 95.514% # ( 1300, 1900 ] 14 0.634% 96.149% ( 1900, 2900 ] 28 1.269% 97.417% ( 2900, 4400 ] 36 1.631% 99.048% ( 4400, 6600 ] 14 0.634% 99.683% ( 6600, 9900 ] 4 0.181% 99.864% ( 9900, 14000 ] 1 0.045% 99.909% ( 22000, 33000 ] 2 0.091% 100.000% ( 50000, 75000 ] 1 0.045% 100.045% ** Level 2 read latency histogram (micros): Count: 239652 Average: 14.0126 StdDev: 286.87 Min: 1 Median: 2.2038 Max: 37228 Percentiles: P50: 2.20 P75: 3.17 P99: 13.60 P99.9: 1596.01 P99.99: 3262.93 ------------------------------------------------------ [ 0, 1 ] 2727 1.138% 1.138% ( 1, 2 ] 102915 42.944% 44.081% ######### ( 2, 3 ] 69593 29.039% 73.121% ###### ( 3, 4 ] 26287 10.969% 84.089% ## ( 4, 6 ] 27572 11.505% 95.594% ## ( 6, 10 ] 7012 2.926% 98.520% # ( 10, 15 ] 1598 0.667% 99.187% ( 15, 22 ] 271 0.113% 99.300% ( 22, 34 ] 68 0.028% 99.329% ( 34, 51 ] 66 0.028% 99.356% ( 51, 76 ] 50 0.021% 99.377% ( 76, 110 ] 21 0.009% 99.386% ( 110, 170 ] 13 0.005% 99.391% ( 170, 250 ] 67 0.028% 99.419% ( 250, 380 ] 235 0.098% 99.517% ( 380, 580 ] 393 0.164% 99.681% ( 580, 870 ] 319 0.133% 99.814% ( 870, 1300 ] 157 0.066% 99.880% ( 1300, 1900 ] 98 0.041% 99.921% ( 1900, 2900 ] 137 0.057% 99.978% ( 2900, 4400 ] 120 0.050% 100.028% ( 4400, 6600 ] 39 0.016% 100.044% ( 6600, 9900 ] 20 0.008% 100.053% ( 9900, 14000 ] 9 0.004% 100.056% ( 14000, 22000 ] 15 0.006% 100.063% ( 22000, 33000 ] 9 0.004% 100.066% ( 33000, 50000 ] 2 0.001% 100.067% ** Level 3 read latency histogram (micros): Count: 469496 Average: 15.2491 StdDev: 236.46 Min: 1 Median: 2.2120 Max: 40213 Percentiles: P50: 2.21 P75: 3.15 P99: 211.62 P99.9: 838.16 P99.99: 1348.88 ------------------------------------------------------ [ 0, 1 ] 5404 1.151% 1.151% ( 1, 2 ] 199774 42.551% 43.702% ######### ( 2, 3 ] 139449 29.702% 73.404% ###### ( 3, 4 ] 50724 10.804% 84.208% ## ( 4, 6 ] 51276 10.921% 95.129% ## ( 6, 10 ] 12918 2.751% 97.880% # ( 10, 15 ] 2520 0.537% 98.417% ( 15, 22 ] 353 0.075% 98.492% ( 22, 34 ] 82 0.017% 98.510% ( 34, 51 ] 182 0.039% 98.549% ( 51, 76 ] 137 0.029% 98.578% ( 76, 110 ] 75 0.016% 98.594% ( 110, 170 ] 801 0.171% 98.764% ( 170, 250 ] 2126 0.453% 99.217% ( 250, 380 ] 1200 0.256% 99.473% ( 380, 580 ] 1288 0.274% 99.747% ( 580, 870 ] 806 0.172% 99.919% ( 870, 1300 ] 318 0.068% 99.987% ( 1300, 1900 ] 197 0.042% 100.029% ( 1900, 2900 ] 274 0.058% 100.087% ( 2900, 4400 ] 273 0.058% 100.145% ( 4400, 6600 ] 58 0.012% 100.157% ( 6600, 9900 ] 39 0.008% 100.166% ( 9900, 14000 ] 13 0.003% 100.168% ( 14000, 22000 ] 17 0.004% 100.172% ( 22000, 33000 ] 8 0.002% 100.174% ( 33000, 50000 ] 2 0.000% 100.174% ** Level 4 read latency histogram (micros): Count: 522797 Average: 35.2999 StdDev: 371.62 Min: 0 Median: 2.1898 Max: 91762 Percentiles: P50: 2.19 P75: 3.39 P99: 551.11 P99.9: 1898.94 P99.99: 2781.28 ------------------------------------------------------ [ 0, 1 ] 7751 1.483% 1.483% ( 1, 2 ] 227516 43.519% 45.002% ######### ( 2, 3 ] 137664 26.332% 71.334% ##### ( 3, 4 ] 49593 9.486% 80.820% ## ( 4, 6 ] 48473 9.272% 90.092% ## ( 6, 10 ] 12936 2.474% 92.566% ( 10, 15 ] 2483 0.475% 93.041% ( 15, 22 ] 329 0.063% 93.104% ( 22, 34 ] 62 0.012% 93.116% ( 34, 51 ] 136 0.026% 93.142% ( 51, 76 ] 104 0.020% 93.162% ( 76, 110 ] 276 0.053% 93.215% ( 110, 170 ] 5671 1.085% 94.299% ( 170, 250 ] 14651 2.802% 97.102% # ( 250, 380 ] 6111 1.169% 98.271% ( 380, 580 ] 4458 0.853% 99.123% ( 580, 870 ] 2613 0.500% 99.623% ( 870, 1300 ] 996 0.191% 99.814% ( 1300, 1900 ] 453 0.087% 99.900% ( 1900, 2900 ] 533 0.102% 100.002% ( 2900, 4400 ] 565 0.108% 100.110% ( 4400, 6600 ] 126 0.024% 100.134% ( 6600, 9900 ] 33 0.006% 100.141% ( 9900, 14000 ] 14 0.003% 100.143% ( 14000, 22000 ] 18 0.003% 100.147% ( 22000, 33000 ] 18 0.003% 100.150% ( 33000, 50000 ] 8 0.002% 100.152% ( 75000, 110000 ] 2 0.000% 100.152% ** Level 5 read latency histogram (micros): Count: 27294 Average: 433.9943 StdDev: 1270.61 Min: 91 Median: 234.1336 Max: 71391 Percentiles: P50: 234.13 P75: 384.87 P99: 3791.44 P99.9: 11286.83 P99.99: 42075.02 ------------------------------------------------------ ( 76, 110 ] 190 0.696% 0.696% ( 110, 170 ] 4435 16.249% 16.945% ### ( 170, 250 ] 11254 41.233% 58.178% ######## ( 250, 380 ] 4512 16.531% 74.709% ### ( 380, 580 ] 3303 12.102% 86.810% ## ( 580, 870 ] 1852 6.785% 93.596% # ( 870, 1300 ] 696 2.550% 96.146% # ( 1300, 1900 ] 270 0.989% 97.135% ( 1900, 2900 ] 308 1.128% 98.263% ( 2900, 4400 ] 340 1.246% 99.509% ( 4400, 6600 ] 85 0.311% 99.820% ( 6600, 9900 ] 20 0.073% 99.894% ( 9900, 14000 ] 8 0.029% 99.923% ( 14000, 22000 ] 10 0.037% 99.960% ( 22000, 33000 ] 5 0.018% 99.978% ( 33000, 50000 ] 8 0.029% 100.007% ( 50000, 75000 ] 3 0.011% 100.018% ** DB Stats ** Uptime(secs): 9.8 total, 4.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 200.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.584 H:M:S, 16.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 248.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.321 H:M:S, 8.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-17:15:05 ... thread 0: (1000000,3000000) ops and (196915.2,202190.6) ops/second in (5.078329,14.837488) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.45 GB 125.1 2.6 0.0 2.6 5.4 2.8 0.0 2.0 105.8 215.9 25.57 18.95 52 0.492 2746K 13K 0.0 0.0 L1 7/7 593.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 999.84 MB 1.0 1.8 1.3 0.5 1.7 1.3 0.0 1.3 105.6 103.6 17.09 10.11 8 2.137 1114K 5009 0.0 0.0 L4 133/0 9.49 GB 1.0 3.8 1.8 2.0 3.5 1.5 0.3 1.9 137.7 127.3 28.01 18.53 16 1.751 770K 0 0.0 0.0 L5 144/0 11.75 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 320/20 26.25 GB 0.0 8.2 3.1 5.1 10.6 5.5 2.8 3.8 118.4 153.6 70.68 47.59 76 0.930 4631K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.2 3.1 5.1 10.6 5.5 2.8 3.8 118.4 153.6 70.68 47.59 76 0.930 4631K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.2 3.1 5.1 7.8 2.8 0.0 0.0 141.6 135.9 59.08 39.49 34 1.738 4631K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 244.1 11.60 8.10 42 0.276 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.9 total, 14.8 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.60 GB write, 728.10 MB/s write, 8.17 GB read, 561.01 MB/s read, 70.7 seconds Interval compaction: 10.60 GB write, 731.75 MB/s write, 8.17 GB read, 563.82 MB/s read, 70.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 22, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 805974 Average: 31.4702 StdDev: 241.00 Min: 0 Median: 1.6203 Max: 60814 Percentiles: P50: 1.62 P75: 2.39 P99: 435.17 P99.9: 1200.62 P99.99: 2450.01 ------------------------------------------------------ [ 0, 1 ] 134865 16.733% 16.733% ### ( 1, 2 ] 432264 53.632% 70.366% ########### ( 2, 3 ] 96797 12.010% 82.376% ## ( 3, 4 ] 31247 3.877% 86.253% # ( 4, 6 ] 23156 2.873% 89.126% # ( 6, 10 ] 7316 0.908% 90.033% ( 10, 15 ] 1319 0.164% 90.197% ( 15, 22 ] 223 0.028% 90.225% ( 22, 34 ] 74 0.009% 90.234% ( 34, 51 ] 35 0.004% 90.238% ( 51, 76 ] 26 0.003% 90.241% ( 76, 110 ] 830 0.103% 90.344% ( 110, 170 ] 18675 2.317% 92.661% ( 170, 250 ] 39180 4.861% 97.523% # ( 250, 380 ] 10370 1.287% 98.809% ( 380, 580 ] 5573 0.691% 99.501% ( 580, 870 ] 2586 0.321% 99.822% ( 870, 1300 ] 822 0.102% 99.924% ( 1300, 1900 ] 300 0.037% 99.961% ( 1900, 2900 ] 428 0.053% 100.014% ( 2900, 4400 ] 420 0.052% 100.066% ( 4400, 6600 ] 88 0.011% 100.077% ( 6600, 9900 ] 33 0.004% 100.081% ( 9900, 14000 ] 11 0.001% 100.082% ( 14000, 22000 ] 8 0.001% 100.083% ( 22000, 33000 ] 16 0.002% 100.085% ( 33000, 50000 ] 4 0.000% 100.086% ( 50000, 75000 ] 2 0.000% 100.086% ** Level 1 read latency histogram (micros): Count: 4383 Average: 344.1296 StdDev: 1172.36 Min: 91 Median: 212.1215 Max: 55025 Percentiles: P50: 212.12 P75: 262.48 P99: 3448.75 P99.9: 8759.03 P99.99: 30589.35 ------------------------------------------------------ ( 76, 110 ] 45 1.027% 1.027% ( 110, 170 ] 985 22.473% 23.500% #### ( 170, 250 ] 2206 50.331% 73.831% ########## ( 250, 380 ] 534 12.183% 86.014% ## ( 380, 580 ] 304 6.936% 92.950% # ( 580, 870 ] 154 3.514% 96.464% # ( 870, 1300 ] 56 1.278% 97.741% ( 1300, 1900 ] 14 0.319% 98.061% ( 1900, 2900 ] 28 0.639% 98.700% ( 2900, 4400 ] 36 0.821% 99.521% ( 4400, 6600 ] 14 0.319% 99.840% ( 6600, 9900 ] 4 0.091% 99.932% ( 9900, 14000 ] 1 0.023% 99.954% ( 22000, 33000 ] 2 0.046% 100.000% ( 50000, 75000 ] 1 0.023% 100.023% ** Level 2 read latency histogram (micros): Count: 239652 Average: 14.0126 StdDev: 286.87 Min: 1 Median: 2.2038 Max: 37228 Percentiles: P50: 2.20 P75: 3.17 P99: 13.60 P99.9: 1596.01 P99.99: 3262.93 ------------------------------------------------------ [ 0, 1 ] 2727 1.138% 1.138% ( 1, 2 ] 102915 42.944% 44.081% ######### ( 2, 3 ] 69593 29.039% 73.121% ###### ( 3, 4 ] 26287 10.969% 84.089% ## ( 4, 6 ] 27572 11.505% 95.594% ## ( 6, 10 ] 7012 2.926% 98.520% # ( 10, 15 ] 1598 0.667% 99.187% ( 15, 22 ] 271 0.113% 99.300% ( 22, 34 ] 68 0.028% 99.329% ( 34, 51 ] 66 0.028% 99.356% ( 51, 76 ] 50 0.021% 99.377% ( 76, 110 ] 21 0.009% 99.386% ( 110, 170 ] 13 0.005% 99.391% ( 170, 250 ] 67 0.028% 99.419% ( 250, 380 ] 235 0.098% 99.517% ( 380, 580 ] 393 0.164% 99.681% ( 580, 870 ] 319 0.133% 99.814% ( 870, 1300 ] 157 0.066% 99.880% ( 1300, 1900 ] 98 0.041% 99.921% ( 1900, 2900 ] 137 0.057% 99.978% ( 2900, 4400 ] 120 0.050% 100.028% ( 4400, 6600 ] 39 0.016% 100.044% ( 6600, 9900 ] 20 0.008% 100.053% ( 9900, 14000 ] 9 0.004% 100.056% ( 14000, 22000 ] 15 0.006% 100.063% ( 22000, 33000 ] 9 0.004% 100.066% ( 33000, 50000 ] 2 0.001% 100.067% ** Level 3 read latency histogram (micros): Count: 474164 Average: 17.0270 StdDev: 236.04 Min: 1 Median: 2.2288 Max: 40213 Percentiles: P50: 2.23 P75: 3.22 P99: 240.09 P99.9: 836.93 P99.99: 1347.46 ------------------------------------------------------ [ 0, 1 ] 5404 1.140% 1.140% ( 1, 2 ] 199774 42.132% 43.272% ######## ( 2, 3 ] 139449 29.409% 72.681% ###### ( 3, 4 ] 50724 10.698% 83.379% ## ( 4, 6 ] 51276 10.814% 94.193% ## ( 6, 10 ] 12918 2.724% 96.917% # ( 10, 15 ] 2520 0.531% 97.448% ( 15, 22 ] 353 0.074% 97.523% ( 22, 34 ] 82 0.017% 97.540% ( 34, 51 ] 182 0.038% 97.578% ( 51, 76 ] 137 0.029% 97.607% ( 76, 110 ] 147 0.031% 97.638% ( 110, 170 ] 2293 0.484% 98.122% ( 170, 250 ] 4752 1.002% 99.124% ( 250, 380 ] 1571 0.331% 99.455% ( 380, 580 ] 1384 0.292% 99.747% ( 580, 870 ] 817 0.172% 99.920% ( 870, 1300 ] 318 0.067% 99.987% ( 1300, 1900 ] 197 0.042% 100.028% ( 1900, 2900 ] 274 0.058% 100.086% ( 2900, 4400 ] 273 0.058% 100.144% ( 4400, 6600 ] 58 0.012% 100.156% ( 6600, 9900 ] 39 0.008% 100.164% ( 9900, 14000 ] 13 0.003% 100.167% ( 14000, 22000 ] 17 0.004% 100.170% ( 22000, 33000 ] 8 0.002% 100.172% ( 33000, 50000 ] 2 0.000% 100.173% ** Level 4 read latency histogram (micros): Count: 559761 Average: 45.8000 StdDev: 361.68 Min: 0 Median: 2.3238 Max: 91762 Percentiles: P50: 2.32 P75: 3.94 P99: 544.75 P99.9: 1848.89 P99.99: 2772.47 ------------------------------------------------------ [ 0, 1 ] 7751 1.385% 1.385% ( 1, 2 ] 227538 40.649% 42.034% ######## ( 2, 3 ] 137731 24.605% 66.639% ##### ( 3, 4 ] 49634 8.867% 75.506% ## ( 4, 6 ] 48516 8.667% 84.173% ## ( 6, 10 ] 12943 2.312% 86.486% ( 10, 15 ] 2486 0.444% 86.930% ( 15, 22 ] 329 0.059% 86.989% ( 22, 34 ] 63 0.011% 87.000% ( 34, 51 ] 136 0.024% 87.024% ( 51, 76 ] 104 0.019% 87.043% ( 76, 110 ] 793 0.142% 87.184% ( 110, 170 ] 17408 3.110% 90.294% # ( 170, 250 ] 35632 6.366% 96.660% # ( 250, 380 ] 8782 1.569% 98.229% ( 380, 580 ] 5242 0.936% 99.165% ( 580, 870 ] 2696 0.482% 99.647% ( 870, 1300 ] 1002 0.179% 99.826% ( 1300, 1900 ] 455 0.081% 99.907% ( 1900, 2900 ] 533 0.095% 100.002% ( 2900, 4400 ] 565 0.101% 100.103% ( 4400, 6600 ] 126 0.023% 100.126% ( 6600, 9900 ] 33 0.006% 100.132% ( 9900, 14000 ] 14 0.003% 100.134% ( 14000, 22000 ] 18 0.003% 100.137% ( 22000, 33000 ] 18 0.003% 100.141% ( 33000, 50000 ] 8 0.001% 100.142% ( 75000, 110000 ] 2 0.000% 100.142% ** Level 5 read latency histogram (micros): Count: 54002 Average: 315.8228 StdDev: 912.24 Min: 91 Median: 210.5264 Max: 71391 Percentiles: P50: 210.53 P75: 260.51 P99: 2688.90 P99.9: 6496.42 P99.99: 36399.57 ------------------------------------------------------ ( 76, 110 ] 608 1.126% 1.126% ( 110, 170 ] 13075 24.212% 25.338% ##### ( 170, 250 ] 26290 48.683% 74.021% ########## ( 250, 380 ] 6535 12.101% 86.123% ## ( 380, 580 ] 3828 7.089% 93.211% # ( 580, 870 ] 1909 3.535% 96.746% # ( 870, 1300 ] 703 1.302% 98.048% ( 1300, 1900 ] 271 0.502% 98.550% ( 1900, 2900 ] 308 0.570% 99.120% ( 2900, 4400 ] 340 0.630% 99.750% ( 4400, 6600 ] 85 0.157% 99.907% ( 6600, 9900 ] 20 0.037% 99.944% ( 9900, 14000 ] 8 0.015% 99.959% ( 14000, 22000 ] 10 0.019% 99.978% ( 22000, 33000 ] 5 0.009% 99.987% ( 33000, 50000 ] 8 0.015% 100.002% ( 50000, 75000 ] 3 0.006% 100.007% ** DB Stats ** Uptime(secs): 14.9 total, 5.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 197.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.092 H:M:S, 20.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.508 H:M:S, 29.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 325.747 micros/op 12234 ops/sec 20.188 seconds 246996 operations; 11.9 MB/s (60999 of 60999 found) Microseconds per read: Count: 246996 Average: 325.7577 StdDev: 1297.03 Min: 2 Median: 230.2869 Max: 306246 Percentiles: P50: 230.29 P75: 331.70 P99: 1730.32 P99.9: 10575.49 P99.99: 38221.91 ------------------------------------------------------ ( 1, 2 ] 3 0.001% 0.001% ( 2, 3 ] 50 0.020% 0.021% ( 3, 4 ] 86 0.035% 0.056% ( 4, 6 ] 208 0.084% 0.140% ( 6, 10 ] 442 0.179% 0.319% ( 10, 15 ] 2029 0.821% 1.141% ( 15, 22 ] 3554 1.439% 2.580% ( 22, 34 ] 5252 2.126% 4.706% ( 34, 51 ] 1828 0.740% 5.446% ( 51, 76 ] 365 0.148% 5.594% ( 76, 110 ] 122 0.049% 5.643% ( 110, 170 ] 19623 7.945% 13.588% ## ( 170, 250 ] 119344 48.318% 61.906% ########## ( 250, 380 ] 51459 20.834% 82.740% #### ( 380, 580 ] 27544 11.152% 93.892% ## ( 580, 870 ] 9275 3.755% 97.647% # ( 870, 1300 ] 2698 1.092% 98.739% ( 1300, 1900 ] 898 0.364% 99.103% ( 1900, 2900 ] 723 0.293% 99.396% ( 2900, 4400 ] 838 0.339% 99.735% ( 4400, 6600 ] 245 0.099% 99.834% ( 6600, 9900 ] 149 0.060% 99.894% ( 9900, 14000 ] 85 0.034% 99.929% ( 14000, 22000 ] 101 0.041% 99.970% ( 22000, 33000 ] 46 0.019% 99.988% ( 33000, 50000 ] 14 0.006% 99.994% ( 50000, 75000 ] 6 0.002% 99.996% ( 75000, 110000 ] 5 0.002% 99.998% ( 110000, 170000 ] 1 0.000% 99.999% ( 170000, 250000 ] 1 0.000% 99.999% ( 250000, 380000 ] 2 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 4267310 rocksdb.bloom.filter.full.positive COUNT : 287586 rocksdb.bloom.filter.full.true.positive COUNT : 246072 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 924 rocksdb.memtable.miss COUNT : 246072 rocksdb.l0.hit COUNT : 34478 rocksdb.l1.hit COUNT : 6333 rocksdb.l2andup.hit COUNT : 205261 rocksdb.compaction.key.drop.new COUNT : 368505 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3271812 rocksdb.number.keys.read COUNT : 246996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3376509984 rocksdb.bytes.read COUNT : 246996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 440 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7236787 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10015161095 rocksdb.compact.write.bytes COUNT : 9630947856 rocksdb.flush.write.bytes COUNT : 3363764397 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 592 rocksdb.number.superversion_releases COUNT : 558 rocksdb.number.superversion_cleanups COUNT : 143 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341768704 rocksdb.memtable.garbage.bytes.at.flush COUNT : 5999616 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10363342555 rocksdb.non.last.level.read.count COUNT : 2473048 rocksdb.block.checksum.compute.count COUNT : 2717260 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 229.650024 P95 : 664.352788 P99 : 1730.127090 P100 : 306244.000000 COUNT : 246996 SUM : 80251472 rocksdb.db.write.micros P50 : 1.539515 P95 : 5.061465 P99 : 8.162196 P100 : 421370.000000 COUNT : 3271812 SUM : 16102455 rocksdb.compaction.times.micros P50 : 1725000.000000 P95 : 2846428.571429 P99 : 3483890.000000 P100 : 3483890.000000 COUNT : 35 SUM : 60075429 rocksdb.compaction.times.cpu_micros P50 : 1094761.904762 P95 : 1669505.000000 P99 : 1669505.000000 P100 : 1669505.000000 COUNT : 35 SUM : 40455304 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 870.000000 P95 : 4100.000000 P99 : 11337.000000 P100 : 11337.000000 COUNT : 48 SUM : 67581 rocksdb.compaction.outfile.sync.micros P50 : 1750.000000 P95 : 8538.750000 P99 : 21520.000000 P100 : 52460.000000 COUNT : 106 SUM : 328963 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 189.259259 P95 : 2350.000000 P99 : 34190.000000 P100 : 34579.000000 COUNT : 93 SUM : 68850 rocksdb.table.open.io.micros P50 : 6348.571429 P95 : 18413.793103 P99 : 93666.666667 P100 : 231287.000000 COUNT : 440 SUM : 3672967 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.004402 P95 : 13.517509 P99 : 263.413015 P100 : 60822.000000 COUNT : 2425956 SUM : 48874713 rocksdb.read.block.get.micros P50 : 199.486350 P95 : 517.930741 P99 : 1336.571812 P100 : 91844.000000 COUNT : 290859 SUM : 70345490 rocksdb.write.raw.block.micros P50 : 0.536587 P95 : 1.419375 P99 : 4.605128 P100 : 92765.000000 COUNT : 3148842 SUM : 10910545 rocksdb.numfiles.in.singlecompaction P50 : 3.190476 P95 : 5.850000 P99 : 12.700000 P100 : 13.000000 COUNT : 46 SUM : 173 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564254 P95 : 1171.843846 P99 : 2478.702128 P100 : 421119.000000 COUNT : 40202 SUM : 7240351 rocksdb.sst.read.micros P50 : 1.967320 P95 : 227.123381 P99 : 498.035695 P100 : 91762.000000 COUNT : 2473085 SUM : 106764188 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 246996 SUM : 246996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3271812 SUM : 3376509984 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223333.333333 P95 : 628000.000000 P99 : 726740.000000 P100 : 726740.000000 COUNT : 48 SUM : 12819724 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 117 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0