[2024-11-20 07:18:59.996072] Starting SPDK v25.01-pre git sha1 a38267915 / DPDK 24.03.0 initialization... [2024-11-20 07:18:59.996193] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1118655 ] Set seed to 1732083539993477 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 07:19:00.137876] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 07:19:00.244696] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 07:19:00.244756] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1118655' to capture a snapshot of events at runtime. [2024-11-20 07:19:00.244770] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 07:19:00.244784] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 07:19:00.244793] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1118655 for offline analysis/debug. [2024-11-20 07:19:00.246049] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 07:19:03 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-07:19:10 ... thread 0: (1000000,1000000) ops and (148394.7,148394.7) ops/second in (6.738787,6.738787) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.26 GB 50.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 37.3 134.1 8.43 4.26 11 0.766 319K 1837 0.0 0.0 L1 5/5 389.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/7 1.45 GB 1.0 2.5 1.9 0.6 2.4 1.9 0.0 1.3 107.0 105.3 23.68 14.22 12 1.974 1514K 5356 0.0 0.0 L4 141/31 11.05 GB 0.9 2.2 1.4 0.8 2.1 1.4 0.4 1.5 114.7 111.5 19.49 12.35 11 1.771 895K 3638 0.0 0.0 L5 124/0 9.97 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 307/52 24.11 GB 0.0 5.0 3.4 1.6 5.7 4.0 1.4 7.1 98.5 112.3 51.59 30.83 34 1.517 2728K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 3.4 1.6 5.7 4.0 1.4 7.1 98.5 112.3 51.59 30.83 34 1.517 2728K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 3.4 1.6 4.9 3.3 0.0 0.0 111.3 109.0 45.69 28.24 24 1.904 2728K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 138.4 5.90 2.59 10 0.590 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.8 total, 6.7 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.66 GB write, 850.35 MB/s write, 4.96 GB read, 745.74 MB/s read, 51.6 seconds Interval compaction: 5.66 GB write, 859.87 MB/s write, 4.96 GB read, 754.09 MB/s read, 51.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 166819 Average: 60.9454 StdDev: 593.65 Min: 1 Median: 2.1768 Max: 51322 Percentiles: P50: 2.18 P75: 3.29 P99: 1161.98 P99.9: 5026.07 P99.99: 22604.13 ------------------------------------------------------ [ 0, 1 ] 4175 2.503% 2.503% # ( 1, 2 ] 71299 42.740% 45.243% ######### ( 2, 3 ] 44882 26.905% 72.148% ##### ( 3, 4 ] 16226 9.727% 81.874% ## ( 4, 6 ] 16940 10.155% 92.029% ## ( 6, 10 ] 3928 2.355% 94.384% ( 10, 15 ] 721 0.432% 94.816% ( 15, 22 ] 95 0.057% 94.873% ( 22, 34 ] 17 0.010% 94.883% ( 34, 51 ] 29 0.017% 94.900% ( 51, 76 ] 23 0.014% 94.914% ( 76, 110 ] 4 0.002% 94.917% ( 110, 170 ] 61 0.037% 94.953% ( 170, 250 ] 335 0.201% 95.154% ( 250, 380 ] 1098 0.658% 95.812% ( 380, 580 ] 2330 1.397% 97.209% ( 580, 870 ] 2321 1.391% 98.600% ( 870, 1300 ] 982 0.589% 99.189% ( 1300, 1900 ] 320 0.192% 99.381% ( 1900, 2900 ] 368 0.221% 99.601% ( 2900, 4400 ] 472 0.283% 99.884% ( 4400, 6600 ] 92 0.055% 99.939% ( 6600, 9900 ] 39 0.023% 99.963% ( 9900, 14000 ] 11 0.007% 99.969% ( 14000, 22000 ] 33 0.020% 99.989% ( 22000, 33000 ] 24 0.014% 100.004% ( 33000, 50000 ] 8 0.005% 100.008% ( 50000, 75000 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 395 Average: 1373.5367 StdDev: 2923.22 Min: 101 Median: 647.4752 Max: 28228 Percentiles: P50: 647.48 P75: 1073.06 P99: 19466.67 P99.9: 28228.00 P99.99: 28228.00 ------------------------------------------------------ ( 76, 110 ] 3 0.759% 0.759% ( 110, 170 ] 2 0.506% 1.266% ( 170, 250 ] 20 5.063% 6.329% # ( 250, 380 ] 52 13.165% 19.494% ### ( 380, 580 ] 97 24.557% 44.051% ##### ( 580, 870 ] 101 25.570% 69.620% ##### ( 870, 1300 ] 45 11.392% 81.013% ## ( 1300, 1900 ] 13 3.291% 84.304% # ( 1900, 2900 ] 21 5.316% 89.620% # ( 2900, 4400 ] 26 6.582% 96.203% # ( 4400, 6600 ] 3 0.759% 96.962% ( 6600, 9900 ] 6 1.519% 98.481% ( 14000, 22000 ] 3 0.759% 99.241% ( 22000, 33000 ] 3 0.759% 100.000% ** Level 2 read latency histogram (micros): Count: 335521 Average: 16.4387 StdDev: 382.46 Min: 1 Median: 2.2420 Max: 62291 Percentiles: P50: 2.24 P75: 3.18 P99: 11.86 P99.9: 926.72 P99.99: 2101.64 ------------------------------------------------------ [ 0, 1 ] 3104 0.925% 0.925% ( 1, 2 ] 139986 41.722% 42.647% ######## ( 2, 3 ] 101952 30.386% 73.033% ###### ( 3, 4 ] 36668 10.929% 83.962% ## ( 4, 6 ] 40262 12.000% 95.962% ## ( 6, 10 ] 9411 2.805% 98.767% # ( 10, 15 ] 2106 0.628% 99.394% ( 15, 22 ] 296 0.088% 99.483% ( 22, 34 ] 52 0.015% 99.498% ( 34, 51 ] 71 0.021% 99.519% ( 51, 76 ] 67 0.020% 99.539% ( 76, 110 ] 28 0.008% 99.548% ( 110, 170 ] 27 0.008% 99.556% ( 170, 250 ] 89 0.027% 99.582% ( 250, 380 ] 271 0.081% 99.663% ( 380, 580 ] 428 0.128% 99.790% ( 580, 870 ] 344 0.103% 99.893% ( 870, 1300 ] 178 0.053% 99.946% ( 1300, 1900 ] 117 0.035% 99.981% ( 1900, 2900 ] 151 0.045% 100.026% ( 2900, 4400 ] 215 0.064% 100.090% ( 4400, 6600 ] 59 0.018% 100.108% ( 6600, 9900 ] 43 0.013% 100.120% ( 9900, 14000 ] 20 0.006% 100.126% ( 14000, 22000 ] 52 0.015% 100.142% ( 22000, 33000 ] 18 0.005% 100.147% ( 33000, 50000 ] 1 0.000% 100.148% ( 50000, 75000 ] 2 0.001% 100.148% ** Level 3 read latency histogram (micros): Count: 491859 Average: 17.3163 StdDev: 334.19 Min: 1 Median: 2.3025 Max: 43897 Percentiles: P50: 2.30 P75: 3.26 P99: 13.46 P99.9: 971.30 P99.99: 1470.95 ------------------------------------------------------ [ 0, 1 ] 5045 1.026% 1.026% ( 1, 2 ] 193788 39.399% 40.425% ######## ( 2, 3 ] 155674 31.650% 72.075% ###### ( 3, 4 ] 56189 11.424% 83.499% ## ( 4, 6 ] 60561 12.313% 95.811% ## ( 6, 10 ] 13823 2.810% 98.622% # ( 10, 15 ] 2691 0.547% 99.169% ( 15, 22 ] 375 0.076% 99.245% ( 22, 34 ] 89 0.018% 99.263% ( 34, 51 ] 126 0.026% 99.289% ( 51, 76 ] 96 0.020% 99.308% ( 76, 110 ] 37 0.008% 99.316% ( 110, 170 ] 41 0.008% 99.324% ( 170, 250 ] 156 0.032% 99.356% ( 250, 380 ] 491 0.100% 99.456% ( 380, 580 ] 978 0.199% 99.655% ( 580, 870 ] 1092 0.222% 99.877% ( 870, 1300 ] 493 0.100% 99.977% ( 1300, 1900 ] 231 0.047% 100.024% ( 1900, 2900 ] 287 0.058% 100.082% ( 2900, 4400 ] 337 0.069% 100.151% ( 4400, 6600 ] 82 0.017% 100.167% ( 6600, 9900 ] 56 0.011% 100.179% ( 9900, 14000 ] 21 0.004% 100.183% ( 14000, 22000 ] 49 0.010% 100.193% ( 22000, 33000 ] 27 0.005% 100.198% ( 33000, 50000 ] 4 0.001% 100.199% ** Level 4 read latency histogram (micros): Count: 451710 Average: 35.2337 StdDev: 446.79 Min: 1 Median: 2.3501 Max: 51308 Percentiles: P50: 2.35 P75: 3.42 P99: 697.90 P99.9: 2439.09 P99.99: 3182.82 ------------------------------------------------------ [ 0, 1 ] 3557 0.787% 0.787% ( 1, 2 ] 173544 38.419% 39.207% ######## ( 2, 3 ] 139250 30.827% 70.034% ###### ( 3, 4 ] 52830 11.696% 81.730% ## ( 4, 6 ] 55781 12.349% 94.079% ## ( 6, 10 ] 12759 2.825% 96.903% # ( 10, 15 ] 2488 0.551% 97.454% ( 15, 22 ] 276 0.061% 97.515% ( 22, 34 ] 76 0.017% 97.532% ( 34, 51 ] 211 0.047% 97.579% ( 51, 76 ] 127 0.028% 97.607% ( 76, 110 ] 35 0.008% 97.614% ( 110, 170 ] 101 0.022% 97.637% ( 170, 250 ] 460 0.102% 97.739% ( 250, 380 ] 1444 0.320% 98.058% ( 380, 580 ] 3036 0.672% 98.730% ( 580, 870 ] 3003 0.665% 99.395% ( 870, 1300 ] 1419 0.314% 99.709% ( 1300, 1900 ] 550 0.122% 99.831% ( 1900, 2900 ] 583 0.129% 99.960% ( 2900, 4400 ] 731 0.162% 100.122% ( 4400, 6600 ] 174 0.039% 100.161% ( 6600, 9900 ] 47 0.010% 100.171% ( 9900, 14000 ] 28 0.006% 100.177% ( 14000, 22000 ] 67 0.015% 100.192% ( 22000, 33000 ] 36 0.008% 100.200% ( 33000, 50000 ] 10 0.002% 100.202% ( 50000, 75000 ] 1 0.000% 100.202% ** Level 5 read latency histogram (micros): Count: 7670 Average: 1160.9699 StdDev: 2264.64 Min: 109 Median: 646.4672 Max: 38955 Percentiles: P50: 646.47 P75: 1022.23 P99: 8295.00 P99.9: 31244.78 P99.99: 38955.00 ------------------------------------------------------ ( 76, 110 ] 1 0.013% 0.013% ( 110, 170 ] 36 0.469% 0.482% ( 170, 250 ] 249 3.246% 3.729% # ( 250, 380 ] 973 12.686% 16.415% ### ( 380, 580 ] 2105 27.445% 43.859% ##### ( 580, 870 ] 2055 26.793% 70.652% ##### ( 870, 1300 ] 942 12.282% 82.934% ## ( 1300, 1900 ] 326 4.250% 87.184% # ( 1900, 2900 ] 331 4.316% 91.499% # ( 2900, 4400 ] 446 5.815% 97.314% # ( 4400, 6600 ] 118 1.538% 98.853% ( 6600, 9900 ] 22 0.287% 99.140% ( 9900, 14000 ] 10 0.130% 99.270% ( 14000, 22000 ] 29 0.378% 99.648% ( 22000, 33000 ] 23 0.300% 99.948% ( 33000, 50000 ] 5 0.065% 100.013% ** DB Stats ** Uptime(secs): 6.8 total, 6.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 144.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.918 H:M:S, 28.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 145.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.918 H:M:S, 28.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/11/20-07:19:14 ... thread 0: (1000000,2000000) ops and (238611.0,182987.5) ops/second in (4.190922,10.929709) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 2.30 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.7 78.7 185.6 17.58 11.65 31 0.567 1405K 7301 0.0 0.0 L1 5/5 389.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 987.78 MB 1.0 2.5 1.9 0.6 2.4 1.9 0.0 1.3 107.0 105.3 23.68 14.22 12 1.974 1514K 5356 0.0 0.0 L4 133/0 9.60 GB 1.0 5.2 1.9 3.3 4.8 1.5 0.4 2.5 139.0 127.3 38.26 25.47 18 2.126 1274K 3638 0.0 0.0 L5 144/0 11.52 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 316/14 24.77 GB 0.0 9.0 3.8 5.2 10.4 5.2 2.9 5.6 116.2 133.6 79.53 51.34 61 1.304 4193K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 3.8 5.2 10.4 5.2 2.9 5.6 116.2 133.6 79.53 51.34 61 1.304 4193K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 3.8 5.2 8.5 3.4 0.0 0.0 132.8 125.6 69.58 45.77 35 1.988 4193K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 189.6 9.95 5.57 26 0.383 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.0 total, 10.9 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.38 GB write, 965.46 MB/s write, 9.02 GB read, 839.22 MB/s read, 79.5 seconds Interval compaction: 10.38 GB write, 972.12 MB/s write, 9.02 GB read, 845.01 MB/s read, 79.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 408817 Average: 41.7175 StdDev: 408.22 Min: 1 Median: 1.8191 Max: 51322 Percentiles: P50: 1.82 P75: 2.84 P99: 751.72 P99.9: 3604.95 P99.99: 5772.46 ------------------------------------------------------ [ 0, 1 ] 39019 9.544% 9.544% ## ( 1, 2 ] 201914 49.390% 58.934% ########## ( 2, 3 ] 78374 19.171% 78.105% #### ( 3, 4 ] 27042 6.615% 84.720% # ( 4, 6 ] 25413 6.216% 90.936% # ( 6, 10 ] 6296 1.540% 92.476% ( 10, 15 ] 1186 0.290% 92.766% ( 15, 22 ] 166 0.041% 92.807% ( 22, 34 ] 38 0.009% 92.816% ( 34, 51 ] 40 0.010% 92.826% ( 51, 76 ] 28 0.007% 92.833% ( 76, 110 ] 193 0.047% 92.880% ( 110, 170 ] 4587 1.122% 94.002% ( 170, 250 ] 10327 2.526% 96.528% # ( 250, 380 ] 4149 1.015% 97.543% ( 380, 580 ] 4073 0.996% 98.539% ( 580, 870 ] 3183 0.779% 99.318% ( 870, 1300 ] 1273 0.311% 99.629% ( 1300, 1900 ] 380 0.093% 99.722% ( 1900, 2900 ] 465 0.114% 99.836% ( 2900, 4400 ] 560 0.137% 99.973% ( 4400, 6600 ] 114 0.028% 100.001% ( 6600, 9900 ] 45 0.011% 100.012% ( 9900, 14000 ] 18 0.004% 100.016% ( 14000, 22000 ] 38 0.009% 100.025% ( 22000, 33000 ] 26 0.006% 100.032% ( 33000, 50000 ] 8 0.002% 100.034% ( 50000, 75000 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1303 Average: 611.2809 StdDev: 1708.91 Min: 100 Median: 241.0448 Max: 28228 Percentiles: P50: 241.04 P75: 517.35 P99: 6033.50 P99.9: 28222.33 P99.99: 28228.00 ------------------------------------------------------ ( 76, 110 ] 8 0.614% 0.614% ( 110, 170 ] 227 17.421% 18.035% ### ( 170, 250 ] 469 35.994% 54.029% ####### ( 250, 380 ] 162 12.433% 66.462% ## ( 380, 580 ] 162 12.433% 78.895% ## ( 580, 870 ] 129 9.900% 88.795% ## ( 870, 1300 ] 61 4.682% 93.477% # ( 1300, 1900 ] 14 1.074% 94.551% ( 1900, 2900 ] 25 1.919% 96.470% ( 2900, 4400 ] 30 2.302% 98.772% ( 4400, 6600 ] 4 0.307% 99.079% ( 6600, 9900 ] 6 0.460% 99.540% ( 14000, 22000 ] 3 0.230% 99.770% ( 22000, 33000 ] 3 0.230% 100.000% ** Level 2 read latency histogram (micros): Count: 335521 Average: 16.4387 StdDev: 382.46 Min: 1 Median: 2.2420 Max: 62291 Percentiles: P50: 2.24 P75: 3.18 P99: 11.86 P99.9: 926.72 P99.99: 2101.64 ------------------------------------------------------ [ 0, 1 ] 3104 0.925% 0.925% ( 1, 2 ] 139986 41.722% 42.647% ######## ( 2, 3 ] 101952 30.386% 73.033% ###### ( 3, 4 ] 36668 10.929% 83.962% ## ( 4, 6 ] 40262 12.000% 95.962% ## ( 6, 10 ] 9411 2.805% 98.767% # ( 10, 15 ] 2106 0.628% 99.394% ( 15, 22 ] 296 0.088% 99.483% ( 22, 34 ] 52 0.015% 99.498% ( 34, 51 ] 71 0.021% 99.519% ( 51, 76 ] 67 0.020% 99.539% ( 76, 110 ] 28 0.008% 99.548% ( 110, 170 ] 27 0.008% 99.556% ( 170, 250 ] 89 0.027% 99.582% ( 250, 380 ] 271 0.081% 99.663% ( 380, 580 ] 428 0.128% 99.790% ( 580, 870 ] 344 0.103% 99.893% ( 870, 1300 ] 178 0.053% 99.946% ( 1300, 1900 ] 117 0.035% 99.981% ( 1900, 2900 ] 151 0.045% 100.026% ( 2900, 4400 ] 215 0.064% 100.090% ( 4400, 6600 ] 59 0.018% 100.108% ( 6600, 9900 ] 43 0.013% 100.120% ( 9900, 14000 ] 20 0.006% 100.126% ( 14000, 22000 ] 52 0.015% 100.142% ( 22000, 33000 ] 18 0.005% 100.147% ( 33000, 50000 ] 1 0.000% 100.148% ( 50000, 75000 ] 2 0.001% 100.148% ** Level 3 read latency histogram (micros): Count: 580545 Average: 17.5159 StdDev: 318.96 Min: 1 Median: 2.2436 Max: 43897 Percentiles: P50: 2.24 P75: 3.19 P99: 186.14 P99.9: 1010.60 P99.99: 1649.87 ------------------------------------------------------ [ 0, 1 ] 10205 1.758% 1.758% ( 1, 2 ] 237083 40.838% 42.596% ######## ( 2, 3 ] 176439 30.392% 72.988% ###### ( 3, 4 ] 63115 10.872% 83.859% ## ( 4, 6 ] 67049 11.549% 95.409% ## ( 6, 10 ] 15913 2.741% 98.150% # ( 10, 15 ] 3024 0.521% 98.671% ( 15, 22 ] 416 0.072% 98.742% ( 22, 34 ] 98 0.017% 98.759% ( 34, 51 ] 143 0.025% 98.784% ( 51, 76 ] 104 0.018% 98.802% ( 76, 110 ] 66 0.011% 98.813% ( 110, 170 ] 742 0.128% 98.941% ( 170, 250 ] 1698 0.292% 99.233% ( 250, 380 ] 1038 0.179% 99.412% ( 380, 580 ] 1349 0.232% 99.645% ( 580, 870 ] 1300 0.224% 99.869% ( 870, 1300 ] 558 0.096% 99.965% ( 1300, 1900 ] 252 0.043% 100.008% ( 1900, 2900 ] 316 0.054% 100.063% ( 2900, 4400 ] 383 0.066% 100.128% ( 4400, 6600 ] 89 0.015% 100.144% ( 6600, 9900 ] 57 0.010% 100.154% ( 9900, 14000 ] 22 0.004% 100.157% ( 14000, 22000 ] 54 0.009% 100.167% ( 22000, 33000 ] 28 0.005% 100.172% ( 33000, 50000 ] 4 0.001% 100.172% ** Level 4 read latency histogram (micros): Count: 845497 Average: 29.2610 StdDev: 347.98 Min: 1 Median: 2.3276 Max: 51308 Percentiles: P50: 2.33 P75: 3.43 P99: 499.94 P99.9: 1271.68 P99.99: 1854.96 ------------------------------------------------------ [ 0, 1 ] 7221 0.854% 0.854% ( 1, 2 ] 332278 39.300% 40.154% ######## ( 2, 3 ] 254146 30.059% 70.213% ###### ( 3, 4 ] 94860 11.219% 81.432% ## ( 4, 6 ] 95457 11.290% 92.722% ## ( 6, 10 ] 23024 2.723% 95.445% # ( 10, 15 ] 4572 0.541% 95.986% ( 15, 22 ] 527 0.062% 96.048% ( 22, 34 ] 129 0.015% 96.063% ( 34, 51 ] 291 0.034% 96.098% ( 51, 76 ] 172 0.020% 96.118% ( 76, 110 ] 249 0.029% 96.148% ( 110, 170 ] 5032 0.595% 96.743% ( 170, 250 ] 11158 1.320% 98.063% ( 250, 380 ] 4883 0.578% 98.640% ( 380, 580 ] 5076 0.600% 99.240% ( 580, 870 ] 3968 0.469% 99.710% ( 870, 1300 ] 1723 0.204% 99.914% ( 1300, 1900 ] 700 0.083% 99.996% ( 1900, 2900 ] 758 0.090% 100.086% ( 2900, 4400 ] 889 0.105% 100.191% ( 4400, 6600 ] 214 0.025% 100.216% ( 6600, 9900 ] 60 0.007% 100.224% ( 9900, 14000 ] 34 0.004% 100.228% ( 14000, 22000 ] 78 0.009% 100.237% ( 22000, 33000 ] 37 0.004% 100.241% ( 33000, 50000 ] 10 0.001% 100.242% ( 50000, 75000 ] 1 0.000% 100.242% ** Level 5 read latency histogram (micros): Count: 24019 Average: 567.3740 StdDev: 1394.90 Min: 93 Median: 249.3242 Max: 38955 Percentiles: P50: 249.32 P75: 537.92 P99: 4364.50 P99.9: 23824.63 P99.99: 38433.54 ------------------------------------------------------ ( 76, 110 ] 139 0.579% 0.579% ( 110, 170 ] 3830 15.946% 16.524% ### ( 170, 250 ] 8109 33.761% 50.285% ####### ( 250, 380 ] 3310 13.781% 64.066% ### ( 380, 580 ] 3326 13.847% 77.913% ### ( 580, 870 ] 2670 11.116% 89.030% ## ( 870, 1300 ] 1113 4.634% 93.663% # ( 1300, 1900 ] 367 1.528% 95.191% ( 1900, 2900 ] 412 1.715% 96.907% ( 2900, 4400 ] 515 2.144% 99.051% ( 4400, 6600 ] 134 0.558% 99.609% ( 6600, 9900 ] 23 0.096% 99.704% ( 9900, 14000 ] 11 0.046% 99.750% ( 14000, 22000 ] 32 0.133% 99.883% ( 22000, 33000 ] 24 0.100% 99.983% ( 33000, 50000 ] 5 0.021% 100.004% ** DB Stats ** Uptime(secs): 11.0 total, 4.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 178.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.138 H:M:S, 19.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 234.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.219 H:M:S, 5.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-07:19:19 ... thread 0: (1000000,3000000) ops and (195996.4,187127.6) ops/second in (5.102134,16.031843) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 20/12 3.28 GB 131.5 2.3 0.0 2.3 5.1 2.8 0.0 1.8 97.3 214.6 24.56 18.18 51 0.482 2427K 12K 0.0 0.0 L1 5/5 389.61 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 987.78 MB 1.0 2.5 1.9 0.6 2.4 1.9 0.0 1.3 107.0 105.3 23.68 14.22 12 1.974 1514K 5356 0.0 0.0 L4 133/0 9.60 GB 1.0 5.2 1.9 3.3 4.8 1.5 0.4 2.5 139.0 127.3 38.26 25.47 18 2.126 1274K 3638 0.0 0.0 L5 144/0 11.52 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 320/17 25.75 GB 0.0 10.0 3.8 6.2 12.3 6.2 2.9 4.4 118.4 146.1 86.51 57.87 81 1.068 5215K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.0 3.8 6.2 12.3 6.2 2.9 4.4 118.4 146.1 86.51 57.87 81 1.068 5215K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.0 3.8 6.2 9.5 3.4 0.0 0.0 139.5 132.7 73.44 49.54 39 1.883 5215K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 221.4 13.07 8.32 42 0.311 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.1 total, 16.0 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.34 GB write, 784.34 MB/s write, 10.00 GB read, 635.90 MB/s read, 86.5 seconds Interval compaction: 12.34 GB write, 788.03 MB/s write, 10.00 GB read, 638.89 MB/s read, 86.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 17, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 749239 Average: 33.5835 StdDev: 304.86 Min: 0 Median: 1.6782 Max: 51322 Percentiles: P50: 1.68 P75: 2.60 P99: 512.99 P99.9: 2248.52 P99.99: 3891.28 ------------------------------------------------------ [ 0, 1 ] 112782 15.053% 15.053% ### ( 1, 2 ] 386079 51.529% 66.582% ########## ( 2, 3 ] 105456 14.075% 80.657% ### ( 3, 4 ] 37224 4.968% 85.626% # ( 4, 6 ] 30700 4.097% 89.723% # ( 6, 10 ] 7615 1.016% 90.740% ( 10, 15 ] 1552 0.207% 90.947% ( 15, 22 ] 252 0.034% 90.980% ( 22, 34 ] 63 0.008% 90.989% ( 34, 51 ] 43 0.006% 90.994% ( 51, 76 ] 29 0.004% 90.998% ( 76, 110 ] 787 0.105% 91.103% ( 110, 170 ] 17017 2.271% 93.375% ( 170, 250 ] 31775 4.241% 97.616% # ( 250, 380 ] 7131 0.952% 98.567% ( 380, 580 ] 4878 0.651% 99.218% ( 580, 870 ] 3274 0.437% 99.655% ( 870, 1300 ] 1289 0.172% 99.827% ( 1300, 1900 ] 383 0.051% 99.879% ( 1900, 2900 ] 467 0.062% 99.941% ( 2900, 4400 ] 560 0.075% 100.016% ( 4400, 6600 ] 114 0.015% 100.031% ( 6600, 9900 ] 45 0.006% 100.037% ( 9900, 14000 ] 18 0.002% 100.039% ( 14000, 22000 ] 38 0.005% 100.044% ( 22000, 33000 ] 26 0.003% 100.048% ( 33000, 50000 ] 8 0.001% 100.049% ( 50000, 75000 ] 1 0.000% 100.049% ** Level 1 read latency histogram (micros): Count: 2781 Average: 389.1010 StdDev: 1189.00 Min: 97 Median: 210.0000 Max: 28228 Percentiles: P50: 210.00 P75: 266.07 P99: 3809.50 P99.9: 22803.00 P99.99: 28228.00 ------------------------------------------------------ ( 76, 110 ] 33 1.187% 1.187% ( 110, 170 ] 695 24.991% 26.178% ##### ( 170, 250 ] 1325 47.645% 73.822% ########## ( 250, 380 ] 265 9.529% 83.351% ## ( 380, 580 ] 184 6.616% 89.968% # ( 580, 870 ] 132 4.746% 94.714% # ( 870, 1300 ] 62 2.229% 96.944% ( 1300, 1900 ] 14 0.503% 97.447% ( 1900, 2900 ] 25 0.899% 98.346% ( 2900, 4400 ] 30 1.079% 99.425% ( 4400, 6600 ] 4 0.144% 99.569% ( 6600, 9900 ] 6 0.216% 99.784% ( 14000, 22000 ] 3 0.108% 99.892% ( 22000, 33000 ] 3 0.108% 100.000% ** Level 2 read latency histogram (micros): Count: 335521 Average: 16.4387 StdDev: 382.46 Min: 1 Median: 2.2420 Max: 62291 Percentiles: P50: 2.24 P75: 3.18 P99: 11.86 P99.9: 926.72 P99.99: 2101.64 ------------------------------------------------------ [ 0, 1 ] 3104 0.925% 0.925% ( 1, 2 ] 139986 41.722% 42.647% ######## ( 2, 3 ] 101952 30.386% 73.033% ###### ( 3, 4 ] 36668 10.929% 83.962% ## ( 4, 6 ] 40262 12.000% 95.962% ## ( 6, 10 ] 9411 2.805% 98.767% # ( 10, 15 ] 2106 0.628% 99.394% ( 15, 22 ] 296 0.088% 99.483% ( 22, 34 ] 52 0.015% 99.498% ( 34, 51 ] 71 0.021% 99.519% ( 51, 76 ] 67 0.020% 99.539% ( 76, 110 ] 28 0.008% 99.548% ( 110, 170 ] 27 0.008% 99.556% ( 170, 250 ] 89 0.027% 99.582% ( 250, 380 ] 271 0.081% 99.663% ( 380, 580 ] 428 0.128% 99.790% ( 580, 870 ] 344 0.103% 99.893% ( 870, 1300 ] 178 0.053% 99.946% ( 1300, 1900 ] 117 0.035% 99.981% ( 1900, 2900 ] 151 0.045% 100.026% ( 2900, 4400 ] 215 0.064% 100.090% ( 4400, 6600 ] 59 0.018% 100.108% ( 6600, 9900 ] 43 0.013% 100.120% ( 9900, 14000 ] 20 0.006% 100.126% ( 14000, 22000 ] 52 0.015% 100.142% ( 22000, 33000 ] 18 0.005% 100.147% ( 33000, 50000 ] 1 0.000% 100.148% ( 50000, 75000 ] 2 0.001% 100.148% ** Level 3 read latency histogram (micros): Count: 585442 Average: 18.9887 StdDev: 318.08 Min: 1 Median: 2.2575 Max: 43897 Percentiles: P50: 2.26 P75: 3.24 P99: 232.95 P99.9: 1007.35 P99.99: 1648.70 ------------------------------------------------------ [ 0, 1 ] 10205 1.743% 1.743% ( 1, 2 ] 237083 40.496% 42.240% ######## ( 2, 3 ] 176439 30.138% 72.377% ###### ( 3, 4 ] 63115 10.781% 83.158% ## ( 4, 6 ] 67049 11.453% 94.611% ## ( 6, 10 ] 15913 2.718% 97.329% # ( 10, 15 ] 3024 0.517% 97.845% ( 15, 22 ] 416 0.071% 97.916% ( 22, 34 ] 98 0.017% 97.933% ( 34, 51 ] 143 0.024% 97.958% ( 51, 76 ] 104 0.018% 97.975% ( 76, 110 ] 162 0.028% 98.003% ( 110, 170 ] 2369 0.405% 98.408% ( 170, 250 ] 4407 0.753% 99.160% ( 250, 380 ] 1392 0.238% 99.398% ( 380, 580 ] 1451 0.248% 99.646% ( 580, 870 ] 1308 0.223% 99.870% ( 870, 1300 ] 559 0.095% 99.965% ( 1300, 1900 ] 252 0.043% 100.008% ( 1900, 2900 ] 316 0.054% 100.062% ( 2900, 4400 ] 383 0.065% 100.127% ( 4400, 6600 ] 89 0.015% 100.143% ( 6600, 9900 ] 57 0.010% 100.152% ( 9900, 14000 ] 22 0.004% 100.156% ( 14000, 22000 ] 54 0.009% 100.165% ( 22000, 33000 ] 28 0.005% 100.170% ( 33000, 50000 ] 4 0.001% 100.171% ** Level 4 read latency histogram (micros): Count: 884552 Average: 36.3752 StdDev: 342.12 Min: 1 Median: 2.4036 Max: 51308 Percentiles: P50: 2.40 P75: 3.73 P99: 499.98 P99.9: 1262.75 P99.99: 1851.75 ------------------------------------------------------ [ 0, 1 ] 7221 0.816% 0.816% ( 1, 2 ] 332358 37.574% 38.390% ######## ( 2, 3 ] 254437 28.765% 67.154% ###### ( 3, 4 ] 94998 10.740% 77.894% ## ( 4, 6 ] 95681 10.817% 88.711% ## ( 6, 10 ] 23038 2.604% 91.315% # ( 10, 15 ] 4577 0.517% 91.833% ( 15, 22 ] 528 0.060% 91.893% ( 22, 34 ] 130 0.015% 91.907% ( 34, 51 ] 292 0.033% 91.940% ( 51, 76 ] 172 0.019% 91.960% ( 76, 110 ] 876 0.099% 92.059% ( 110, 170 ] 17759 2.008% 94.066% ( 170, 250 ] 32495 3.674% 97.740% # ( 250, 380 ] 7665 0.867% 98.607% ( 380, 580 ] 5802 0.656% 99.263% ( 580, 870 ] 4052 0.458% 99.721% ( 870, 1300 ] 1738 0.196% 99.917% ( 1300, 1900 ] 702 0.079% 99.996% ( 1900, 2900 ] 759 0.086% 100.082% ( 2900, 4400 ] 889 0.101% 100.183% ( 4400, 6600 ] 214 0.024% 100.207% ( 6600, 9900 ] 60 0.007% 100.214% ( 9900, 14000 ] 34 0.004% 100.218% ( 14000, 22000 ] 78 0.009% 100.226% ( 22000, 33000 ] 37 0.004% 100.231% ( 33000, 50000 ] 10 0.001% 100.232% ( 50000, 75000 ] 1 0.000% 100.232% ** Level 5 read latency histogram (micros): Count: 51038 Average: 370.1645 StdDev: 975.98 Min: 91 Median: 212.1958 Max: 38955 Percentiles: P50: 212.20 P75: 294.11 P99: 3577.53 P99.9: 16240.50 P99.99: 32494.09 ------------------------------------------------------ ( 76, 110 ] 610 1.195% 1.195% ( 110, 170 ] 12668 24.821% 26.016% ##### ( 170, 250 ] 23208 45.472% 71.488% ######### ( 250, 380 ] 5283 10.351% 81.839% ## ( 380, 580 ] 3875 7.592% 89.431% ## ( 580, 870 ] 2741 5.371% 94.802% # ( 870, 1300 ] 1129 2.212% 97.014% ( 1300, 1900 ] 369 0.723% 97.737% ( 1900, 2900 ] 412 0.807% 98.544% ( 2900, 4400 ] 515 1.009% 99.553% ( 4400, 6600 ] 134 0.263% 99.816% ( 6600, 9900 ] 23 0.045% 99.861% ( 9900, 14000 ] 11 0.022% 99.882% ( 14000, 22000 ] 32 0.063% 99.945% ( 22000, 33000 ] 24 0.047% 99.992% ( 33000, 50000 ] 5 0.010% 100.002% ** DB Stats ** Uptime(secs): 16.1 total, 5.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 183.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.449 H:M:S, 21.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 192.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.311 H:M:S, 25.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 369.922 micros/op 10788 ops/sec 20.113 seconds 216996 operations; 10.5 MB/s (54999 of 54999 found) Microseconds per read: Count: 216996 Average: 369.9307 StdDev: 1131.04 Min: 1 Median: 232.0632 Max: 98733 Percentiles: P50: 232.06 P75: 347.16 P99: 2836.00 P99.9: 18124.42 P99.99: 45636.89 ------------------------------------------------------ [ 0, 1 ] 1 0.000% 0.000% ( 1, 2 ] 9 0.004% 0.005% ( 2, 3 ] 54 0.025% 0.029% ( 3, 4 ] 89 0.041% 0.071% ( 4, 6 ] 193 0.089% 0.159% ( 6, 10 ] 330 0.152% 0.312% ( 10, 15 ] 1727 0.796% 1.107% ( 15, 22 ] 2867 1.321% 2.429% ( 22, 34 ] 4483 2.066% 4.495% ( 34, 51 ] 1708 0.787% 5.282% ( 51, 76 ] 270 0.124% 5.406% ( 76, 110 ] 98 0.045% 5.451% ( 110, 170 ] 17156 7.906% 13.357% ## ( 170, 250 ] 102493 47.233% 60.590% ######### ( 250, 380 ] 41838 19.281% 79.871% #### ( 380, 580 ] 24411 11.250% 91.120% ## ( 580, 870 ] 10708 4.935% 96.055% # ( 870, 1300 ] 4047 1.865% 97.920% ( 1300, 1900 ] 1394 0.642% 98.562% ( 1900, 2900 ] 1015 0.468% 99.030% ( 2900, 4400 ] 1212 0.559% 99.588% ( 4400, 6600 ] 332 0.153% 99.741% ( 6600, 9900 ] 158 0.073% 99.814% ( 9900, 14000 ] 103 0.047% 99.862% ( 14000, 22000 ] 161 0.074% 99.936% ( 22000, 33000 ] 95 0.044% 99.980% ( 33000, 50000 ] 30 0.014% 99.994% ( 50000, 75000 ] 11 0.005% 99.999% ( 75000, 110000 ] 3 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3614125 rocksdb.bloom.filter.full.positive COUNT : 251719 rocksdb.bloom.filter.full.true.positive COUNT : 216129 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 867 rocksdb.memtable.miss COUNT : 216129 rocksdb.l0.hit COUNT : 27488 rocksdb.l1.hit COUNT : 3734 rocksdb.l2andup.hit COUNT : 184907 rocksdb.compaction.key.drop.new COUNT : 532549 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3202713 rocksdb.number.keys.read COUNT : 216996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3305199816 rocksdb.bytes.read COUNT : 216996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 458 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6577315 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11980156902 rocksdb.compact.write.bytes COUNT : 11427018700 rocksdb.flush.write.bytes COUNT : 3297645398 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 28 rocksdb.number.superversion_acquires COUNT : 597 rocksdb.number.superversion_releases COUNT : 579 rocksdb.number.superversion_cleanups COUNT : 148 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3276215296 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6001664 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 12095262668 rocksdb.non.last.level.read.count COUNT : 2893355 rocksdb.block.checksum.compute.count COUNT : 3157173 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 231.357487 P95 : 807.416479 P99 : 2836.000000 P100 : 98731.000000 COUNT : 216996 SUM : 80071813 rocksdb.db.write.micros P50 : 1.596952 P95 : 5.221789 P99 : 8.804752 P100 : 542058.000000 COUNT : 3202713 SUM : 15748788 rocksdb.compaction.times.micros P50 : 1846153.846154 P95 : 2844444.444444 P99 : 4612575.000000 P100 : 4612575.000000 COUNT : 40 SUM : 74386295 rocksdb.compaction.times.cpu_micros P50 : 1182105.263158 P95 : 1900000.000000 P99 : 3234691.000000 P100 : 3234691.000000 COUNT : 40 SUM : 50483328 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 870.000000 P95 : 5885.000000 P99 : 6838.000000 P100 : 6838.000000 COUNT : 46 SUM : 69901 rocksdb.compaction.outfile.sync.micros P50 : 2284.615385 P95 : 9372.000000 P99 : 43880.000000 P100 : 68868.000000 COUNT : 136 SUM : 506705 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 202.000000 P95 : 3230.000000 P99 : 4444.000000 P100 : 5354.000000 COUNT : 98 SUM : 54832 rocksdb.table.open.io.micros P50 : 6600.000000 P95 : 19051.428571 P99 : 29452.500000 P100 : 67357.000000 COUNT : 458 SUM : 3214150 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.369290 P95 : 10.143254 P99 : 241.114326 P100 : 56949.000000 COUNT : 2901859 SUM : 54950399 rocksdb.read.block.get.micros P50 : 201.341040 P95 : 684.774478 P99 : 2451.955157 P100 : 62296.000000 COUNT : 254857 SUM : 71645299 rocksdb.write.raw.block.micros P50 : 0.535580 P95 : 1.383999 P99 : 3.942761 P100 : 81932.000000 COUNT : 3567857 SUM : 14493488 rocksdb.numfiles.in.singlecompaction P50 : 3.052632 P95 : 6.400000 P99 : 9.280000 P100 : 10.000000 COUNT : 54 SUM : 192 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563415 P95 : 1140.686129 P99 : 2200.085653 P100 : 541837.000000 COUNT : 33486 SUM : 6581302 rocksdb.sst.read.micros P50 : 2.122883 P95 : 211.356056 P99 : 534.996204 P100 : 62291.000000 COUNT : 2893399 SUM : 113788871 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 216996 SUM : 216996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3202713 SUM : 3305199816 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 229354.838710 P95 : 734333.333333 P99 : 889695.000000 P100 : 889695.000000 COUNT : 46 SUM : 13857621 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 137 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0