[2024-10-12 17:19:17.646638] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... [2024-10-12 17:19:17.646777] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2029168 ] Set seed to 1728746357643155 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-12 17:19:17.747773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-12 17:19:17.949258] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-12 17:19:17.949302] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2029168' to capture a snapshot of events at runtime. [2024-10-12 17:19:17.949312] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2029168 for offline analysis/debug. [2024-10-12 17:19:17.949340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Oct 12 17:19:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/12-17:19:34 ... thread 0: (1000000,1000000) ops and (125066.5,125066.5) ops/second in (7.995744,7.995744) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/4 755.33 MB 37.7 0.4 0.0 0.4 1.2 0.8 0.0 1.5 38.6 122.3 9.78 4.02 10 0.978 383K 486 0.0 0.0 L1 1/0 86.73 MB 8.7 0.3 0.2 0.1 0.3 0.2 0.0 1.8 89.2 89.1 3.23 1.39 1 3.231 292K 294 0.0 0.0 L2 6/3 587.26 MB 2.0 0.2 0.1 0.1 0.2 0.1 0.1 3.2 121.6 121.5 1.54 0.86 1 1.536 189K 210 0.0 0.0 L3 59/14 4.03 GB 2.9 4.3 2.9 1.4 4.3 2.9 0.0 1.5 93.7 93.0 46.84 21.88 22 2.129 2330K 167 0.0 0.0 L4 179/10 11.17 GB 1.1 1.7 1.5 0.1 1.7 1.5 0.0 1.1 96.6 96.3 17.54 8.09 12 1.462 556K 0 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1334/31 105.79 GB 0.0 6.8 4.6 2.2 7.5 5.4 0.2 9.4 87.9 97.8 78.92 36.24 46 1.716 3753K 1157 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 4.6 2.2 7.5 5.4 0.2 9.4 87.9 97.8 78.92 36.24 46 1.716 3753K 1157 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 4.6 2.2 6.7 4.6 0.0 0.0 96.7 96.2 71.73 33.78 37 1.939 3753K 1157 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 113.9 7.19 2.46 9 0.799 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.2 total, 8.0 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.54 GB write, 943.04 MB/s write, 6.77 GB read, 847.44 MB/s read, 78.9 seconds Interval compaction: 7.54 GB write, 964.97 MB/s write, 6.77 GB read, 867.14 MB/s read, 78.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 33, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 147421 Average: 13.2732 StdDev: 170.21 Min: 1 Median: 1.8621 Max: 11312 Percentiles: P50: 1.86 P75: 2.86 P99: 11.98 P99.9: 2921.93 P99.99: 6050.50 ------------------------------------------------------ [ 0, 1 ] 6521 4.423% 4.423% # ( 1, 2 ] 77939 52.868% 57.292% ########### ( 2, 3 ] 30449 20.654% 77.946% #### ( 3, 4 ] 11952 8.107% 86.054% ## ( 4, 6 ] 15235 10.334% 96.388% ## ( 6, 10 ] 3515 2.384% 98.772% ( 10, 15 ] 848 0.575% 99.347% ( 15, 22 ] 86 0.058% 99.406% ( 22, 34 ] 6 0.004% 99.410% ( 34, 51 ] 7 0.005% 99.415% ( 51, 76 ] 9 0.006% 99.421% ( 76, 110 ] 1 0.001% 99.421% ( 110, 170 ] 4 0.003% 99.424% ( 170, 250 ] 13 0.009% 99.433% ( 250, 380 ] 27 0.018% 99.451% ( 380, 580 ] 53 0.036% 99.487% ( 580, 870 ] 134 0.091% 99.578% ( 870, 1300 ] 161 0.109% 99.687% ( 1300, 1900 ] 156 0.106% 99.793% ( 1900, 2900 ] 156 0.106% 99.899% ( 2900, 4400 ] 108 0.073% 99.972% ( 4400, 6600 ] 35 0.024% 99.996% ( 6600, 9900 ] 4 0.003% 99.999% ( 9900, 14000 ] 2 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 46328 Average: 18.3844 StdDev: 212.81 Min: 1 Median: 2.0412 Max: 8638 Percentiles: P50: 2.04 P75: 3.10 P99: 14.04 P99.9: 3671.00 P99.99: 6526.73 ------------------------------------------------------ [ 0, 1 ] 1211 2.614% 2.614% # ( 1, 2 ] 21475 46.354% 48.968% ######### ( 2, 3 ] 11611 25.063% 74.031% ##### ( 3, 4 ] 4492 9.696% 83.727% ## ( 4, 6 ] 5390 11.634% 95.361% ## ( 6, 10 ] 1366 2.949% 98.310% # ( 10, 15 ] 396 0.855% 99.165% ( 15, 22 ] 51 0.110% 99.275% ( 22, 34 ] 5 0.011% 99.286% ( 34, 51 ] 1 0.002% 99.288% ( 51, 76 ] 2 0.004% 99.292% ( 110, 170 ] 1 0.002% 99.294% ( 170, 250 ] 3 0.006% 99.301% ( 250, 380 ] 4 0.009% 99.309% ( 380, 580 ] 8 0.017% 99.327% ( 580, 870 ] 25 0.054% 99.381% ( 870, 1300 ] 45 0.097% 99.478% ( 1300, 1900 ] 82 0.177% 99.655% ( 1900, 2900 ] 89 0.192% 99.847% ( 2900, 4400 ] 48 0.104% 99.950% ( 4400, 6600 ] 19 0.041% 99.991% ( 6600, 9900 ] 4 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 688272 Average: 20.0682 StdDev: 259.12 Min: 1 Median: 1.9749 Max: 31857 Percentiles: P50: 1.97 P75: 3.06 P99: 13.66 P99.9: 2338.98 P99.99: 2818.80 ------------------------------------------------------ [ 0, 1 ] 22116 3.213% 3.213% # ( 1, 2 ] 330311 47.991% 51.205% ########## ( 2, 3 ] 160102 23.261% 74.466% ##### ( 3, 4 ] 65041 9.450% 83.916% ## ( 4, 6 ] 78690 11.433% 95.349% ## ( 6, 10 ] 20467 2.974% 98.323% # ( 10, 15 ] 6362 0.924% 99.247% ( 15, 22 ] 988 0.144% 99.391% ( 22, 34 ] 106 0.015% 99.406% ( 34, 51 ] 27 0.004% 99.410% ( 51, 76 ] 29 0.004% 99.414% ( 76, 110 ] 13 0.002% 99.416% ( 110, 170 ] 16 0.002% 99.418% ( 170, 250 ] 47 0.007% 99.425% ( 250, 380 ] 87 0.013% 99.438% ( 380, 580 ] 268 0.039% 99.477% ( 580, 870 ] 493 0.072% 99.548% ( 870, 1300 ] 797 0.116% 99.664% ( 1300, 1900 ] 1057 0.154% 99.818% ( 1900, 2900 ] 1291 0.188% 100.005% ( 2900, 4400 ] 814 0.118% 100.123% ( 4400, 6600 ] 263 0.038% 100.162% ( 6600, 9900 ] 84 0.012% 100.174% ( 9900, 14000 ] 30 0.004% 100.178% ( 14000, 22000 ] 18 0.003% 100.181% ( 22000, 33000 ] 6 0.001% 100.182% ** Level 3 read latency histogram (micros): Count: 759273 Average: 17.6903 StdDev: 239.13 Min: 1 Median: 2.0491 Max: 46439 Percentiles: P50: 2.05 P75: 3.07 P99: 12.64 P99.9: 1848.41 P99.99: 2367.47 ------------------------------------------------------ [ 0, 1 ] 14366 1.892% 1.892% ( 1, 2 ] 355724 46.851% 48.743% ######### ( 2, 3 ] 194397 25.603% 74.346% ##### ( 3, 4 ] 72998 9.614% 83.960% ## ( 4, 6 ] 90528 11.923% 95.883% ## ( 6, 10 ] 20421 2.690% 98.572% # ( 10, 15 ] 6163 0.812% 99.384% ( 15, 22 ] 769 0.101% 99.485% ( 22, 34 ] 77 0.010% 99.496% ( 34, 51 ] 27 0.004% 99.499% ( 51, 76 ] 48 0.006% 99.505% ( 76, 110 ] 16 0.002% 99.508% ( 110, 170 ] 32 0.004% 99.512% ( 170, 250 ] 68 0.009% 99.521% ( 250, 380 ] 133 0.018% 99.538% ( 380, 580 ] 275 0.036% 99.574% ( 580, 870 ] 551 0.073% 99.647% ( 870, 1300 ] 910 0.120% 99.767% ( 1300, 1900 ] 1109 0.146% 99.913% ( 1900, 2900 ] 1258 0.166% 100.079% ( 2900, 4400 ] 837 0.110% 100.189% ( 4400, 6600 ] 202 0.027% 100.215% ( 6600, 9900 ] 41 0.005% 100.221% ( 9900, 14000 ] 7 0.001% 100.222% ( 14000, 22000 ] 10 0.001% 100.223% ( 22000, 33000 ] 12 0.002% 100.225% ( 33000, 50000 ] 1 0.000% 100.225% ** Level 4 read latency histogram (micros): Count: 70826 Average: 83.6476 StdDev: 571.77 Min: 1 Median: 2.0259 Max: 54927 Percentiles: P50: 2.03 P75: 3.25 P99: 2735.95 P99.9: 5457.99 P99.99: 6405.53 ------------------------------------------------------ [ 0, 1 ] 1595 2.252% 2.252% ( 1, 2 ] 33395 47.151% 49.403% ######### ( 2, 3 ] 16355 23.092% 72.495% ##### ( 3, 4 ] 7091 10.012% 82.506% ## ( 4, 6 ] 7778 10.982% 93.488% ## ( 6, 10 ] 1464 2.067% 95.555% ( 10, 15 ] 434 0.613% 96.168% ( 15, 22 ] 48 0.068% 96.236% ( 22, 34 ] 6 0.008% 96.244% ( 34, 51 ] 3 0.004% 96.249% ( 51, 76 ] 5 0.007% 96.256% ( 76, 110 ] 1 0.001% 96.257% ( 110, 170 ] 16 0.023% 96.280% ( 170, 250 ] 37 0.052% 96.332% ( 250, 380 ] 66 0.093% 96.425% ( 380, 580 ] 137 0.193% 96.618% ( 580, 870 ] 287 0.405% 97.024% ( 870, 1300 ] 415 0.586% 97.610% ( 1300, 1900 ] 535 0.755% 98.365% ( 1900, 2900 ] 538 0.760% 99.125% ( 2900, 4400 ] 478 0.675% 99.800% ( 4400, 6600 ] 148 0.209% 100.008% ( 6600, 9900 ] 27 0.038% 100.047% ( 9900, 14000 ] 1 0.001% 100.048% ( 14000, 22000 ] 1 0.001% 100.049% ( 22000, 33000 ] 2 0.003% 100.052% ( 33000, 50000 ] 1 0.001% 100.054% ( 50000, 75000 ] 1 0.001% 100.055% ** Level 5 read latency histogram (micros): Count: 9527 Average: 2395.9796 StdDev: 2325.39 Min: 92 Median: 1856.5299 Max: 65900 Percentiles: P50: 1856.53 P75: 3345.08 P99: 9100.05 P99.9: 32355.89 P99.99: 63091.25 ------------------------------------------------------ ( 76, 110 ] 1 0.010% 0.010% ( 110, 170 ] 20 0.210% 0.220% ( 170, 250 ] 52 0.546% 0.766% ( 250, 380 ] 201 2.110% 2.876% ( 380, 580 ] 527 5.532% 8.408% # ( 580, 870 ] 1027 10.780% 19.188% ## ( 870, 1300 ] 1444 15.157% 34.344% ### ( 1300, 1900 ] 1608 16.878% 51.223% ### ( 1900, 2900 ] 1754 18.411% 69.634% #### ( 2900, 4400 ] 1723 18.085% 87.719% #### ( 4400, 6600 ] 927 9.730% 97.449% ## ( 6600, 9900 ] 195 2.047% 99.496% ( 9900, 14000 ] 21 0.220% 99.717% ( 14000, 22000 ] 9 0.094% 99.811% ( 22000, 33000 ] 9 0.094% 99.906% ( 33000, 50000 ] 7 0.073% 99.979% ( 50000, 75000 ] 2 0.021% 100.000% ** DB Stats ** Uptime(secs): 8.2 total, 8.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 120.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.145 H:M:S, 50.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 123.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.145 H:M:S, 51.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/12-17:19:41 ... thread 0: (1000000,2000000) ops and (150128.8,136456.4) ops/second in (6.660947,14.656691) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.78 GB 50.3 1.1 0.0 1.1 3.0 1.8 0.0 1.6 54.4 145.1 20.83 10.46 25 0.833 1151K 1579 0.0 0.0 L1 1/1 86.73 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.8 89.2 89.1 3.23 1.39 1 3.231 292K 294 0.0 0.0 L2 3/2 200.93 MB 1.3 0.2 0.1 0.1 0.2 0.1 0.1 3.2 121.6 121.5 1.54 0.86 1 1.536 189K 210 0.0 0.0 L3 33/19 1.80 GB 0.8 5.2 3.3 1.9 5.2 3.2 0.0 1.6 95.6 94.9 55.65 26.77 25 2.226 3219K 4465 0.0 0.0 L4 172/0 9.51 GB 1.0 6.1 4.1 1.9 6.0 4.0 0.0 1.5 111.9 110.5 55.42 29.84 41 1.352 3054K 0 0.0 0.0 L5 1140/0 93.38 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1361/31 106.76 GB 0.0 12.8 7.6 5.2 14.6 9.3 4.4 7.9 96.1 109.0 136.67 69.32 93 1.470 7907K 6548 0.0 0.0 Int 0/0 0.00 KB 0.0 12.8 7.6 5.2 14.6 9.3 4.4 7.9 96.1 109.0 136.67 69.32 93 1.470 7907K 6548 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.8 7.6 5.2 12.7 7.5 0.0 0.0 107.0 106.1 122.64 63.74 71 1.727 7907K 6548 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 134.7 14.03 5.58 22 0.638 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.7 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.55 GB write, 1003.72 MB/s write, 12.82 GB read, 884.35 MB/s read, 136.7 seconds Interval compaction: 14.55 GB write, 1016.46 MB/s write, 12.82 GB read, 895.57 MB/s read, 136.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 520685 Average: 10.1582 StdDev: 146.90 Min: 1 Median: 1.8640 Max: 22686 Percentiles: P50: 1.86 P75: 2.83 P99: 11.56 P99.9: 1785.10 P99.99: 3823.14 ------------------------------------------------------ [ 0, 1 ] 22628 4.346% 4.346% # ( 1, 2 ] 275120 52.838% 57.184% ########### ( 2, 3 ] 111282 21.372% 78.556% #### ( 3, 4 ] 42166 8.098% 86.654% ## ( 4, 6 ] 52093 10.005% 96.659% ## ( 6, 10 ] 11336 2.177% 98.836% ( 10, 15 ] 2738 0.526% 99.362% ( 15, 22 ] 247 0.047% 99.409% ( 22, 34 ] 24 0.005% 99.414% ( 34, 51 ] 12 0.002% 99.416% ( 51, 76 ] 26 0.005% 99.421% ( 76, 110 ] 14 0.003% 99.424% ( 110, 170 ] 131 0.025% 99.449% ( 170, 250 ] 259 0.050% 99.499% ( 250, 380 ] 320 0.061% 99.560% ( 380, 580 ] 446 0.086% 99.646% ( 580, 870 ] 580 0.111% 99.757% ( 870, 1300 ] 466 0.089% 99.847% ( 1300, 1900 ] 343 0.066% 99.913% ( 1900, 2900 ] 270 0.052% 99.965% ( 2900, 4400 ] 216 0.041% 100.006% ( 4400, 6600 ] 62 0.012% 100.018% ( 6600, 9900 ] 12 0.002% 100.020% ( 9900, 14000 ] 4 0.001% 100.021% ( 14000, 22000 ] 4 0.001% 100.022% ( 22000, 33000 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 90947 Average: 17.1575 StdDev: 200.28 Min: 1 Median: 2.0066 Max: 8638 Percentiles: P50: 2.01 P75: 3.05 P99: 14.36 P99.9: 3510.20 P99.99: 6591.67 ------------------------------------------------------ [ 0, 1 ] 2114 2.324% 2.324% ( 1, 2 ] 43211 47.512% 49.837% ########## ( 2, 3 ] 22488 24.726% 74.563% ##### ( 3, 4 ] 8474 9.318% 83.881% ## ( 4, 6 ] 10473 11.515% 95.396% ## ( 6, 10 ] 2636 2.898% 98.295% # ( 10, 15 ] 735 0.808% 99.103% ( 15, 22 ] 73 0.080% 99.183% ( 22, 34 ] 6 0.007% 99.190% ( 34, 51 ] 2 0.002% 99.192% ( 51, 76 ] 4 0.004% 99.196% ( 76, 110 ] 3 0.003% 99.200% ( 110, 170 ] 11 0.012% 99.212% ( 170, 250 ] 20 0.022% 99.234% ( 250, 380 ] 44 0.048% 99.282% ( 380, 580 ] 65 0.071% 99.353% ( 580, 870 ] 100 0.110% 99.463% ( 870, 1300 ] 104 0.114% 99.578% ( 1300, 1900 ] 111 0.122% 99.700% ( 1900, 2900 ] 143 0.157% 99.857% ( 2900, 4400 ] 96 0.106% 99.963% ( 4400, 6600 ] 25 0.027% 99.990% ( 6600, 9900 ] 9 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 730875 Average: 20.0838 StdDev: 272.12 Min: 1 Median: 1.9803 Max: 31857 Percentiles: P50: 1.98 P75: 3.07 P99: 13.65 P99.9: 2368.32 P99.99: 2865.89 ------------------------------------------------------ [ 0, 1 ] 22795 3.119% 3.119% # ( 1, 2 ] 349536 47.824% 50.943% ########## ( 2, 3 ] 170908 23.384% 74.327% ##### ( 3, 4 ] 69424 9.499% 83.826% ## ( 4, 6 ] 84185 11.518% 95.344% ## ( 6, 10 ] 21803 2.983% 98.327% # ( 10, 15 ] 6729 0.921% 99.248% ( 15, 22 ] 1037 0.142% 99.390% ( 22, 34 ] 109 0.015% 99.405% ( 34, 51 ] 29 0.004% 99.409% ( 51, 76 ] 35 0.005% 99.414% ( 76, 110 ] 16 0.002% 99.416% ( 110, 170 ] 21 0.003% 99.419% ( 170, 250 ] 56 0.008% 99.426% ( 250, 380 ] 98 0.013% 99.440% ( 380, 580 ] 294 0.040% 99.480% ( 580, 870 ] 541 0.074% 99.554% ( 870, 1300 ] 833 0.114% 99.668% ( 1300, 1900 ] 1076 0.147% 99.815% ( 1900, 2900 ] 1322 0.181% 99.996% ( 2900, 4400 ] 841 0.115% 100.111% ( 4400, 6600 ] 285 0.039% 100.150% ( 6600, 9900 ] 87 0.012% 100.162% ( 9900, 14000 ] 36 0.005% 100.167% ( 14000, 22000 ] 22 0.003% 100.170% ( 22000, 33000 ] 12 0.002% 100.172% ** Level 3 read latency histogram (micros): Count: 1660104 Average: 14.6384 StdDev: 248.13 Min: 1 Median: 2.0437 Max: 57013 Percentiles: P50: 2.04 P75: 3.07 P99: 11.77 P99.9: 1377.80 P99.99: 1952.93 ------------------------------------------------------ [ 0, 1 ] 27317 1.645% 1.645% ( 1, 2 ] 784271 47.242% 48.888% ######### ( 2, 3 ] 422181 25.431% 74.319% ##### ( 3, 4 ] 159610 9.614% 83.933% ## ( 4, 6 ] 200544 12.080% 96.013% ## ( 6, 10 ] 45048 2.714% 98.727% # ( 10, 15 ] 12812 0.772% 99.499% ( 15, 22 ] 1493 0.090% 99.589% ( 22, 34 ] 129 0.008% 99.596% ( 34, 51 ] 96 0.006% 99.602% ( 51, 76 ] 163 0.010% 99.612% ( 76, 110 ] 44 0.003% 99.615% ( 110, 170 ] 152 0.009% 99.624% ( 170, 250 ] 240 0.014% 99.638% ( 250, 380 ] 448 0.027% 99.665% ( 380, 580 ] 728 0.044% 99.709% ( 580, 870 ] 1272 0.077% 99.786% ( 870, 1300 ] 1688 0.102% 99.887% ( 1300, 1900 ] 1611 0.097% 99.985% ( 1900, 2900 ] 1738 0.105% 100.089% ( 2900, 4400 ] 1408 0.085% 100.174% ( 4400, 6600 ] 352 0.021% 100.195% ( 6600, 9900 ] 85 0.005% 100.200% ( 9900, 14000 ] 23 0.001% 100.202% ( 14000, 22000 ] 26 0.002% 100.203% ( 22000, 33000 ] 27 0.002% 100.205% ( 33000, 50000 ] 10 0.001% 100.206% ( 50000, 75000 ] 2 0.000% 100.206% ** Level 4 read latency histogram (micros): Count: 509914 Average: 27.0263 StdDev: 306.25 Min: 1 Median: 2.0522 Max: 54927 Percentiles: P50: 2.05 P75: 3.22 P99: 629.82 P99.9: 3188.54 P99.99: 3971.69 ------------------------------------------------------ [ 0, 1 ] 9569 1.877% 1.877% ( 1, 2 ] 238969 46.865% 48.741% ######### ( 2, 3 ] 122887 24.100% 72.841% ##### ( 3, 4 ] 49953 9.796% 82.637% ## ( 4, 6 ] 62619 12.280% 94.917% ## ( 6, 10 ] 14468 2.837% 97.755% # ( 10, 15 ] 3769 0.739% 98.494% ( 15, 22 ] 410 0.080% 98.574% ( 22, 34 ] 33 0.006% 98.581% ( 34, 51 ] 44 0.009% 98.589% ( 51, 76 ] 58 0.011% 98.601% ( 76, 110 ] 19 0.004% 98.604% ( 110, 170 ] 147 0.029% 98.633% ( 170, 250 ] 348 0.068% 98.702% ( 250, 380 ] 486 0.095% 98.797% ( 380, 580 ] 823 0.161% 98.958% ( 580, 870 ] 1239 0.243% 99.201% ( 870, 1300 ] 1317 0.258% 99.460% ( 1300, 1900 ] 1128 0.221% 99.681% ( 1900, 2900 ] 949 0.186% 99.867% ( 2900, 4400 ] 879 0.172% 100.039% ( 4400, 6600 ] 267 0.052% 100.092% ( 6600, 9900 ] 38 0.007% 100.099% ( 9900, 14000 ] 5 0.001% 100.100% ( 14000, 22000 ] 5 0.001% 100.101% ( 22000, 33000 ] 5 0.001% 100.102% ( 33000, 50000 ] 3 0.001% 100.103% ( 50000, 75000 ] 2 0.000% 100.103% ** Level 5 read latency histogram (micros): Count: 27584 Average: 1562.5520 StdDev: 2083.37 Min: 87 Median: 988.5879 Max: 65900 Percentiles: P50: 988.59 P75: 2028.78 P99: 7197.12 P99.9: 28092.71 P99.99: 60130.00 ------------------------------------------------------ ( 76, 110 ] 63 0.228% 0.228% ( 110, 170 ] 791 2.868% 3.096% # ( 170, 250 ] 1490 5.402% 8.498% # ( 250, 380 ] 2228 8.077% 16.575% ## ( 380, 580 ] 3377 12.243% 28.817% ## ( 580, 870 ] 4597 16.665% 45.483% ### ( 870, 1300 ] 4518 16.379% 61.862% ### ( 1300, 1900 ] 3249 11.779% 73.641% ## ( 1900, 2900 ] 2912 10.557% 84.197% ## ( 2900, 4400 ] 2822 10.231% 94.428% ## ( 4400, 6600 ] 1219 4.419% 98.847% # ( 6600, 9900 ] 233 0.845% 99.692% ( 9900, 14000 ] 31 0.112% 99.804% ( 14000, 22000 ] 17 0.062% 99.866% ( 22000, 33000 ] 17 0.062% 99.927% ( 33000, 50000 ] 14 0.051% 99.978% ( 50000, 75000 ] 8 0.029% 100.007% ** DB Stats ** Uptime(secs): 14.8 total, 6.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 132.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.972 H:M:S, 47.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.827 H:M:S, 42.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/10/12-17:19:44 ... thread 0: (1000000,3000000) ops and (270167.8,163415.6) ops/second in (3.701404,18.358095) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.72 GB 151.0 2.2 0.0 2.2 4.9 2.8 0.0 1.8 76.9 175.6 28.69 17.25 44 0.652 2238K 2687 0.0 0.0 L1 6/0 518.24 MB 51.8 1.3 1.1 0.2 1.3 1.1 0.0 1.2 144.2 143.6 9.58 6.41 2 4.792 1402K 4853 0.0 0.0 L2 4/3 441.70 MB 1.2 0.2 0.1 0.1 0.2 0.1 0.7 3.2 121.6 121.5 1.54 0.86 1 1.536 189K 210 0.0 0.0 L3 26/10 1.65 GB 1.0 7.1 3.6 3.5 7.1 3.5 0.0 2.0 109.0 108.4 66.94 35.80 29 2.308 5231K 10K 0.0 0.0 L4 175/9 9.66 GB 0.9 6.3 4.3 2.1 6.3 4.2 0.3 1.5 113.9 112.4 57.05 31.17 43 1.327 3225K 0 0.0 0.0 L5 1144/0 93.69 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/26 107.67 GB 0.0 17.2 9.1 8.1 19.8 11.7 5.5 7.1 107.2 123.7 163.79 91.48 119 1.376 12M 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.2 9.1 8.1 19.8 11.7 5.5 7.1 107.2 123.7 163.79 91.48 119 1.376 12M 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.2 9.1 8.1 17.0 8.9 0.0 0.0 120.1 119.2 146.26 83.31 82 1.784 12M 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 161.7 17.53 8.17 37 0.474 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.4 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.79 GB write, 1092.76 MB/s write, 17.16 GB read, 947.23 MB/s read, 163.8 seconds Interval compaction: 19.79 GB write, 1103.83 MB/s write, 17.16 GB read, 956.83 MB/s read, 163.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 58, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 886553 Average: 8.1974 StdDev: 118.82 Min: 1 Median: 1.8202 Max: 22686 Percentiles: P50: 1.82 P75: 2.73 P99: 9.97 P99.9: 1206.40 P99.99: 2803.78 ------------------------------------------------------ [ 0, 1 ] 43731 4.933% 4.933% # ( 1, 2 ] 487104 54.944% 59.876% ########### ( 2, 3 ] 183296 20.675% 80.551% #### ( 3, 4 ] 67586 7.623% 88.175% ## ( 4, 6 ] 79807 9.002% 97.177% ## ( 6, 10 ] 16287 1.837% 99.014% ( 10, 15 ] 3590 0.405% 99.419% ( 15, 22 ] 334 0.038% 99.457% ( 22, 34 ] 29 0.003% 99.460% ( 34, 51 ] 18 0.002% 99.462% ( 51, 76 ] 30 0.003% 99.465% ( 76, 110 ] 28 0.003% 99.468% ( 110, 170 ] 328 0.037% 99.505% ( 170, 250 ] 675 0.076% 99.582% ( 250, 380 ] 679 0.077% 99.658% ( 380, 580 ] 815 0.092% 99.750% ( 580, 870 ] 871 0.098% 99.848% ( 870, 1300 ] 586 0.066% 99.914% ( 1300, 1900 ] 373 0.042% 99.956% ( 1900, 2900 ] 329 0.037% 99.994% ( 2900, 4400 ] 236 0.027% 100.020% ( 4400, 6600 ] 66 0.007% 100.028% ( 6600, 9900 ] 14 0.002% 100.029% ( 9900, 14000 ] 4 0.000% 100.030% ( 14000, 22000 ] 4 0.000% 100.030% ( 22000, 33000 ] 2 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 210423 Average: 11.8782 StdDev: 155.88 Min: 1 Median: 1.9767 Max: 9015 Percentiles: P50: 1.98 P75: 2.94 P99: 12.05 P99.9: 2357.63 P99.99: 3839.69 ------------------------------------------------------ [ 0, 1 ] 3680 1.749% 1.749% ( 1, 2 ] 103953 49.402% 51.151% ########## ( 2, 3 ] 53404 25.379% 76.530% ##### ( 3, 4 ] 18983 9.021% 85.551% ## ( 4, 6 ] 22722 10.798% 96.350% ## ( 6, 10 ] 5080 2.414% 98.764% ( 10, 15 ] 1216 0.578% 99.342% ( 15, 22 ] 121 0.058% 99.399% ( 22, 34 ] 10 0.005% 99.404% ( 34, 51 ] 10 0.005% 99.409% ( 51, 76 ] 7 0.003% 99.412% ( 76, 110 ] 7 0.003% 99.415% ( 110, 170 ] 46 0.022% 99.437% ( 170, 250 ] 99 0.047% 99.484% ( 250, 380 ] 135 0.064% 99.549% ( 380, 580 ] 163 0.077% 99.626% ( 580, 870 ] 193 0.092% 99.718% ( 870, 1300 ] 165 0.078% 99.796% ( 1300, 1900 ] 133 0.063% 99.859% ( 1900, 2900 ] 187 0.089% 99.948% ( 2900, 4400 ] 142 0.067% 100.016% ( 4400, 6600 ] 29 0.014% 100.029% ( 6600, 9900 ] 14 0.007% 100.036% ** Level 2 read latency histogram (micros): Count: 763818 Average: 19.4209 StdDev: 266.32 Min: 1 Median: 1.9779 Max: 31857 Percentiles: P50: 1.98 P75: 3.05 P99: 13.56 P99.9: 2344.58 P99.99: 2864.19 ------------------------------------------------------ [ 0, 1 ] 23349 3.057% 3.057% # ( 1, 2 ] 366655 48.003% 51.060% ########## ( 2, 3 ] 179172 23.457% 74.517% ##### ( 3, 4 ] 72106 9.440% 83.957% ## ( 4, 6 ] 87389 11.441% 95.399% ## ( 6, 10 ] 22603 2.959% 98.358% # ( 10, 15 ] 6888 0.902% 99.260% ( 15, 22 ] 1046 0.137% 99.396% ( 22, 34 ] 112 0.015% 99.411% ( 34, 51 ] 38 0.005% 99.416% ( 51, 76 ] 37 0.005% 99.421% ( 76, 110 ] 18 0.002% 99.423% ( 110, 170 ] 46 0.006% 99.429% ( 170, 250 ] 82 0.011% 99.440% ( 250, 380 ] 124 0.016% 99.456% ( 380, 580 ] 329 0.043% 99.499% ( 580, 870 ] 554 0.073% 99.572% ( 870, 1300 ] 840 0.110% 99.682% ( 1300, 1900 ] 1078 0.141% 99.823% ( 1900, 2900 ] 1323 0.173% 99.996% ( 2900, 4400 ] 842 0.110% 100.106% ( 4400, 6600 ] 285 0.037% 100.144% ( 6600, 9900 ] 87 0.011% 100.155% ( 9900, 14000 ] 36 0.005% 100.160% ( 14000, 22000 ] 22 0.003% 100.163% ( 22000, 33000 ] 12 0.002% 100.164% ** Level 3 read latency histogram (micros): Count: 2011169 Average: 13.0841 StdDev: 226.88 Min: 1 Median: 2.0087 Max: 57013 Percentiles: P50: 2.01 P75: 2.99 P99: 11.64 P99.9: 1240.65 P99.99: 1863.18 ------------------------------------------------------ [ 0, 1 ] 32193 1.601% 1.601% ( 1, 2 ] 968968 48.179% 49.780% ########## ( 2, 3 ] 510983 25.407% 75.187% ##### ( 3, 4 ] 188433 9.369% 84.557% ## ( 4, 6 ] 232854 11.578% 96.135% ## ( 6, 10 ] 52813 2.626% 98.761% # ( 10, 15 ] 14667 0.729% 99.490% ( 15, 22 ] 1679 0.083% 99.573% ( 22, 34 ] 142 0.007% 99.580% ( 34, 51 ] 108 0.005% 99.586% ( 51, 76 ] 176 0.009% 99.595% ( 76, 110 ] 57 0.003% 99.597% ( 110, 170 ] 387 0.019% 99.617% ( 170, 250 ] 682 0.034% 99.651% ( 250, 380 ] 848 0.042% 99.693% ( 380, 580 ] 1102 0.055% 99.748% ( 580, 870 ] 1516 0.075% 99.823% ( 870, 1300 ] 1798 0.089% 99.912% ( 1300, 1900 ] 1664 0.083% 99.995% ( 1900, 2900 ] 1762 0.088% 100.083% ( 2900, 4400 ] 1433 0.071% 100.154% ( 4400, 6600 ] 361 0.018% 100.172% ( 6600, 9900 ] 86 0.004% 100.176% ( 9900, 14000 ] 23 0.001% 100.177% ( 14000, 22000 ] 26 0.001% 100.179% ( 22000, 33000 ] 27 0.001% 100.180% ( 33000, 50000 ] 10 0.000% 100.180% ( 50000, 75000 ] 2 0.000% 100.181% ** Level 4 read latency histogram (micros): Count: 567407 Average: 28.7244 StdDev: 301.13 Min: 1 Median: 2.0429 Max: 54927 Percentiles: P50: 2.04 P75: 3.22 P99: 714.59 P99.9: 3210.68 P99.99: 4013.62 ------------------------------------------------------ [ 0, 1 ] 10763 1.897% 1.897% ( 1, 2 ] 267134 47.080% 48.977% ######### ( 2, 3 ] 135448 23.871% 72.848% ##### ( 3, 4 ] 54822 9.662% 82.510% ## ( 4, 6 ] 67989 11.982% 94.492% ## ( 6, 10 ] 15760 2.778% 97.270% # ( 10, 15 ] 4095 0.722% 97.992% ( 15, 22 ] 447 0.079% 98.070% ( 22, 34 ] 36 0.006% 98.077% ( 34, 51 ] 50 0.009% 98.086% ( 51, 76 ] 63 0.011% 98.097% ( 76, 110 ] 44 0.008% 98.104% ( 110, 170 ] 476 0.084% 98.188% ( 170, 250 ] 1013 0.179% 98.367% ( 250, 380 ] 1184 0.209% 98.575% ( 380, 580 ] 1556 0.274% 98.850% ( 580, 870 ] 1840 0.324% 99.174% ( 870, 1300 ] 1631 0.287% 99.461% ( 1300, 1900 ] 1228 0.216% 99.678% ( 1900, 2900 ] 1064 0.188% 99.865% ( 2900, 4400 ] 954 0.168% 100.033% ( 4400, 6600 ] 288 0.051% 100.084% ( 6600, 9900 ] 44 0.008% 100.092% ( 9900, 14000 ] 5 0.001% 100.093% ( 14000, 22000 ] 5 0.001% 100.094% ( 22000, 33000 ] 5 0.001% 100.095% ( 33000, 50000 ] 3 0.001% 100.095% ( 50000, 75000 ] 2 0.000% 100.096% ** Level 5 read latency histogram (micros): Count: 46361 Average: 1161.6085 StdDev: 1727.42 Min: 86 Median: 658.7762 Max: 65900 Percentiles: P50: 658.78 P75: 1339.34 P99: 6367.17 P99.9: 17594.82 P99.99: 54262.19 ------------------------------------------------------ ( 76, 110 ] 214 0.462% 0.462% ( 110, 170 ] 2651 5.718% 6.180% # ( 170, 250 ] 4912 10.595% 16.775% ## ( 250, 380 ] 6110 13.179% 29.954% ### ( 380, 580 ] 7257 15.653% 45.607% ### ( 580, 870 ] 7497 16.171% 61.778% ### ( 870, 1300 ] 5888 12.700% 74.479% ### ( 1300, 1900 ] 3687 7.953% 82.431% ## ( 1900, 2900 ] 3470 7.485% 89.916% # ( 2900, 4400 ] 3091 6.667% 96.583% # ( 4400, 6600 ] 1253 2.703% 99.286% # ( 6600, 9900 ] 245 0.528% 99.814% ( 9900, 14000 ] 32 0.069% 99.884% ( 14000, 22000 ] 17 0.037% 99.920% ( 22000, 33000 ] 17 0.037% 99.957% ( 33000, 50000 ] 14 0.030% 99.987% ( 50000, 75000 ] 8 0.017% 100.004% ** DB Stats ** Uptime(secs): 18.5 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 159.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.972 H:M:S, 37.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 265.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/10/12-17:19:49 ... thread 0: (1000000,4000000) ops and (220406.9,174709.4) ops/second in (4.537064,22.895159) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.70 GB 69.2 2.9 0.0 2.9 6.6 3.7 0.0 1.8 82.0 188.2 36.13 22.98 62 0.583 3006K 3406 0.0 0.0 L1 6/6 518.24 MB 0.0 1.3 1.1 0.2 1.3 1.1 0.0 1.2 144.2 143.6 9.58 6.41 2 4.792 1402K 4853 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 3.2 121.6 121.5 1.54 0.86 1 1.536 189K 210 0.0 0.0 L3 16/0 972.27 MB 1.0 7.9 4.0 3.9 7.9 4.0 0.0 2.0 112.3 111.6 72.13 39.50 33 2.186 6043K 12K 0.0 0.0 L4 175/0 9.76 GB 1.0 9.2 5.4 3.8 9.1 5.3 0.3 1.7 121.4 119.6 77.54 44.67 60 1.292 5069K 234 0.0 0.0 L5 1156/0 94.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1369/18 108.60 GB 0.0 21.5 10.6 10.9 25.1 14.2 6.5 6.7 111.9 130.5 196.92 114.43 158 1.246 15M 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.5 10.6 10.9 25.1 14.2 6.5 6.7 111.9 130.5 196.92 114.43 158 1.246 15M 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.5 10.6 10.9 21.3 10.4 0.0 0.0 125.9 124.8 175.04 103.47 106 1.651 15M 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 175.6 21.88 10.96 52 0.421 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.1 total, 22.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.09 GB write, 1113.02 MB/s write, 21.52 GB read, 954.78 MB/s read, 196.9 seconds Interval compaction: 25.09 GB write, 1122.06 MB/s write, 21.52 GB read, 962.53 MB/s read, 196.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 64, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 64, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1088214 Average: 11.3757 StdDev: 126.57 Min: 1 Median: 1.7884 Max: 22686 Percentiles: P50: 1.79 P75: 2.68 P99: 208.47 P99.9: 1318.49 P99.99: 2859.31 ------------------------------------------------------ [ 0, 1 ] 68116 6.259% 6.259% # ( 1, 2 ] 603750 55.481% 61.740% ########### ( 2, 3 ] 211033 19.393% 81.133% #### ( 3, 4 ] 77416 7.114% 88.247% # ( 4, 6 ] 89917 8.263% 96.510% ## ( 6, 10 ] 17914 1.646% 98.156% ( 10, 15 ] 3776 0.347% 98.503% ( 15, 22 ] 359 0.033% 98.536% ( 22, 34 ] 32 0.003% 98.539% ( 34, 51 ] 19 0.002% 98.541% ( 51, 76 ] 35 0.003% 98.544% ( 76, 110 ] 222 0.020% 98.564% ( 110, 170 ] 2962 0.272% 98.836% ( 170, 250 ] 3703 0.340% 99.177% ( 250, 380 ] 2471 0.227% 99.404% ( 380, 580 ] 2330 0.214% 99.618% ( 580, 870 ] 1950 0.179% 99.797% ( 870, 1300 ] 1103 0.101% 99.898% ( 1300, 1900 ] 577 0.053% 99.951% ( 1900, 2900 ] 438 0.040% 99.992% ( 2900, 4400 ] 348 0.032% 100.024% ( 4400, 6600 ] 87 0.008% 100.032% ( 6600, 9900 ] 16 0.001% 100.033% ( 9900, 14000 ] 4 0.000% 100.033% ( 14000, 22000 ] 4 0.000% 100.034% ( 22000, 33000 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 250170 Average: 11.7930 StdDev: 152.18 Min: 1 Median: 1.9722 Max: 9015 Percentiles: P50: 1.97 P75: 2.93 P99: 12.91 P99.9: 2344.16 P99.99: 3915.37 ------------------------------------------------------ [ 0, 1 ] 4192 1.676% 1.676% ( 1, 2 ] 124355 49.708% 51.384% ########## ( 2, 3 ] 63438 25.358% 76.742% ##### ( 3, 4 ] 22396 8.952% 85.694% ## ( 4, 6 ] 26362 10.538% 96.232% ## ( 6, 10 ] 6062 2.423% 98.655% ( 10, 15 ] 1482 0.592% 99.247% ( 15, 22 ] 146 0.058% 99.306% ( 22, 34 ] 14 0.006% 99.311% ( 34, 51 ] 11 0.004% 99.316% ( 51, 76 ] 8 0.003% 99.319% ( 76, 110 ] 16 0.006% 99.325% ( 110, 170 ] 120 0.048% 99.373% ( 170, 250 ] 186 0.074% 99.448% ( 250, 380 ] 193 0.077% 99.525% ( 380, 580 ] 243 0.097% 99.622% ( 580, 870 ] 253 0.101% 99.723% ( 870, 1300 ] 207 0.083% 99.806% ( 1300, 1900 ] 143 0.057% 99.863% ( 1900, 2900 ] 209 0.084% 99.946% ( 2900, 4400 ] 161 0.064% 100.011% ( 4400, 6600 ] 31 0.012% 100.023% ( 6600, 9900 ] 17 0.007% 100.030% ** Level 2 read latency histogram (micros): Count: 763818 Average: 19.4209 StdDev: 266.32 Min: 1 Median: 1.9779 Max: 31857 Percentiles: P50: 1.98 P75: 3.05 P99: 13.56 P99.9: 2344.58 P99.99: 2864.19 ------------------------------------------------------ [ 0, 1 ] 23349 3.057% 3.057% # ( 1, 2 ] 366655 48.003% 51.060% ########## ( 2, 3 ] 179172 23.457% 74.517% ##### ( 3, 4 ] 72106 9.440% 83.957% ## ( 4, 6 ] 87389 11.441% 95.399% ## ( 6, 10 ] 22603 2.959% 98.358% # ( 10, 15 ] 6888 0.902% 99.260% ( 15, 22 ] 1046 0.137% 99.396% ( 22, 34 ] 112 0.015% 99.411% ( 34, 51 ] 38 0.005% 99.416% ( 51, 76 ] 37 0.005% 99.421% ( 76, 110 ] 18 0.002% 99.423% ( 110, 170 ] 46 0.006% 99.429% ( 170, 250 ] 82 0.011% 99.440% ( 250, 380 ] 124 0.016% 99.456% ( 380, 580 ] 329 0.043% 99.499% ( 580, 870 ] 554 0.073% 99.572% ( 870, 1300 ] 840 0.110% 99.682% ( 1300, 1900 ] 1078 0.141% 99.823% ( 1900, 2900 ] 1323 0.173% 99.996% ( 2900, 4400 ] 842 0.110% 100.106% ( 4400, 6600 ] 285 0.037% 100.144% ( 6600, 9900 ] 87 0.011% 100.155% ( 9900, 14000 ] 36 0.005% 100.160% ( 14000, 22000 ] 22 0.003% 100.163% ( 22000, 33000 ] 12 0.002% 100.164% ** Level 3 read latency histogram (micros): Count: 2315106 Average: 12.3920 StdDev: 215.07 Min: 1 Median: 1.9978 Max: 57013 Percentiles: P50: 2.00 P75: 2.99 P99: 11.42 P99.9: 1164.69 P99.99: 1798.24 ------------------------------------------------------ [ 0, 1 ] 38383 1.658% 1.658% ( 1, 2 ] 1121633 48.448% 50.106% ########## ( 2, 3 ] 583718 25.213% 75.320% ##### ( 3, 4 ] 215834 9.323% 84.643% ## ( 4, 6 ] 267386 11.550% 96.192% ## ( 6, 10 ] 60337 2.606% 98.799% # ( 10, 15 ] 16371 0.707% 99.506% ( 15, 22 ] 1863 0.080% 99.586% ( 22, 34 ] 158 0.007% 99.593% ( 34, 51 ] 127 0.005% 99.598% ( 51, 76 ] 225 0.010% 99.608% ( 76, 110 ] 74 0.003% 99.611% ( 110, 170 ] 517 0.022% 99.634% ( 170, 250 ] 868 0.037% 99.671% ( 250, 380 ] 989 0.043% 99.714% ( 380, 580 ] 1260 0.054% 99.768% ( 580, 870 ] 1693 0.073% 99.841% ( 870, 1300 ] 1977 0.085% 99.927% ( 1300, 1900 ] 1760 0.076% 100.003% ( 1900, 2900 ] 1866 0.081% 100.083% ( 2900, 4400 ] 1551 0.067% 100.150% ( 4400, 6600 ] 384 0.017% 100.167% ( 6600, 9900 ] 92 0.004% 100.171% ( 9900, 14000 ] 23 0.001% 100.172% ( 14000, 22000 ] 26 0.001% 100.173% ( 22000, 33000 ] 27 0.001% 100.174% ( 33000, 50000 ] 10 0.000% 100.175% ( 50000, 75000 ] 2 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 994211 Average: 22.9719 StdDev: 249.76 Min: 1 Median: 1.9920 Max: 54927 Percentiles: P50: 1.99 P75: 3.08 P99: 453.99 P99.9: 2459.99 P99.99: 3254.05 ------------------------------------------------------ [ 0, 1 ] 19375 1.949% 1.949% ( 1, 2 ] 481589 48.439% 50.388% ########## ( 2, 3 ] 236988 23.837% 74.225% ##### ( 3, 4 ] 92425 9.296% 83.521% ## ( 4, 6 ] 111855 11.251% 94.772% ## ( 6, 10 ] 27076 2.723% 97.495% # ( 10, 15 ] 7116 0.716% 98.211% ( 15, 22 ] 744 0.075% 98.286% ( 22, 34 ] 73 0.007% 98.293% ( 34, 51 ] 92 0.009% 98.302% ( 51, 76 ] 117 0.012% 98.314% ( 76, 110 ] 108 0.011% 98.325% ( 110, 170 ] 1434 0.144% 98.469% ( 170, 250 ] 2250 0.226% 98.696% ( 250, 380 ] 2106 0.212% 98.907% ( 380, 580 ] 2492 0.251% 99.158% ( 580, 870 ] 2707 0.272% 99.430% ( 870, 1300 ] 2316 0.233% 99.663% ( 1300, 1900 ] 1596 0.161% 99.824% ( 1900, 2900 ] 1355 0.136% 99.960% ( 2900, 4400 ] 1265 0.127% 100.087% ( 4400, 6600 ] 362 0.036% 100.124% ( 6600, 9900 ] 57 0.006% 100.129% ( 9900, 14000 ] 5 0.001% 100.130% ( 14000, 22000 ] 5 0.001% 100.130% ( 22000, 33000 ] 5 0.001% 100.131% ( 33000, 50000 ] 3 0.000% 100.131% ( 50000, 75000 ] 2 0.000% 100.131% ** Level 5 read latency histogram (micros): Count: 71821 Average: 928.2909 StdDev: 1478.88 Min: 86 Median: 490.7802 Max: 65900 Percentiles: P50: 490.78 P75: 1044.27 P99: 5988.01 P99.9: 11588.56 P99.99: 47350.31 ------------------------------------------------------ ( 76, 110 ] 654 0.911% 0.911% ( 110, 170 ] 8216 11.440% 12.350% ## ( 170, 250 ] 11165 15.546% 27.896% ### ( 250, 380 ] 9905 13.791% 41.687% ### ( 380, 580 ] 10779 15.008% 56.695% ### ( 580, 870 ] 10140 14.118% 70.814% ### ( 870, 1300 ] 7419 10.330% 81.143% ## ( 1300, 1900 ] 4356 6.065% 87.208% # ( 1900, 2900 ] 3940 5.486% 92.694% # ( 2900, 4400 ] 3550 4.943% 97.637% # ( 4400, 6600 ] 1356 1.888% 99.525% ( 6600, 9900 ] 256 0.356% 99.882% ( 9900, 14000 ] 32 0.045% 99.926% ( 14000, 22000 ] 17 0.024% 99.950% ( 22000, 33000 ] 17 0.024% 99.974% ( 33000, 50000 ] 14 0.019% 99.993% ( 50000, 75000 ] 8 0.011% 100.004% ** DB Stats ** Uptime(secs): 23.1 total, 4.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 170.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.863 H:M:S, 34.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 216.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.890 H:M:S, 19.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/12-17:19:54 ... thread 0: (1000000,5000000) ops and (200614.0,179341.0) ops/second in (4.984697,27.879856) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.75 GB 201.4 4.1 0.0 4.1 8.9 4.8 0.0 1.9 95.2 205.8 44.36 30.61 84 0.528 4285K 4689 0.0 0.0 L1 6/6 518.24 MB 0.0 1.3 1.1 0.2 1.3 1.1 0.0 1.2 144.2 143.6 9.58 6.41 2 4.792 1402K 4853 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 3.2 121.6 121.5 1.54 0.86 1 1.536 189K 210 0.0 0.0 L3 16/0 972.27 MB 1.0 7.9 4.0 3.9 7.9 4.0 0.0 2.0 112.3 111.6 72.13 39.50 33 2.186 6043K 12K 0.0 0.0 L4 175/0 9.76 GB 1.0 9.2 5.4 3.8 9.1 5.3 0.3 1.7 121.4 119.6 77.54 44.67 60 1.292 5069K 234 0.0 0.0 L5 1156/0 94.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/14 109.64 GB 0.0 22.8 10.6 12.1 27.4 15.2 6.5 5.7 113.6 136.6 205.15 122.05 180 1.140 16M 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.8 10.6 12.1 27.4 15.2 6.5 5.7 113.6 136.6 205.15 122.05 180 1.140 16M 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.8 10.6 12.1 22.6 10.4 0.0 0.0 129.6 128.5 179.82 108.16 111 1.620 16M 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.8 4.8 0.0 0.0 0.0 194.0 25.33 13.89 69 0.367 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.1 total, 27.9 interval Flush(GB): cumulative 4.799, interval 4.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.36 GB write, 998.35 MB/s write, 22.75 GB read, 830.10 MB/s read, 205.1 seconds Interval compaction: 27.36 GB write, 1005.01 MB/s write, 22.75 GB read, 835.64 MB/s read, 205.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 64, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 64, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1425526 Average: 13.5427 StdDev: 116.13 Min: 0 Median: 1.7106 Max: 22686 Percentiles: P50: 1.71 P75: 2.54 P99: 248.24 P99.9: 1138.24 P99.99: 2452.40 ------------------------------------------------------ [ 0, 1 ] 148724 10.433% 10.433% ## ( 1, 2 ] 793772 55.683% 66.116% ########### ( 2, 3 ] 232968 16.343% 82.458% ### ( 3, 4 ] 84975 5.961% 88.419% # ( 4, 6 ] 95489 6.699% 95.118% # ( 6, 10 ] 18798 1.319% 96.436% ( 10, 15 ] 4098 0.287% 96.724% ( 15, 22 ] 411 0.029% 96.753% ( 22, 34 ] 40 0.003% 96.756% ( 34, 51 ] 22 0.002% 96.757% ( 51, 76 ] 37 0.003% 96.760% ( 76, 110 ] 1333 0.094% 96.853% ( 110, 170 ] 16818 1.180% 98.033% ( 170, 250 ] 14097 0.989% 99.022% ( 250, 380 ] 5279 0.370% 99.392% ( 380, 580 ] 4018 0.282% 99.674% ( 580, 870 ] 2492 0.175% 99.849% ( 870, 1300 ] 1171 0.082% 99.931% ( 1300, 1900 ] 590 0.041% 99.972% ( 1900, 2900 ] 457 0.032% 100.004% ( 2900, 4400 ] 358 0.025% 100.030% ( 4400, 6600 ] 87 0.006% 100.036% ( 6600, 9900 ] 16 0.001% 100.037% ( 9900, 14000 ] 4 0.000% 100.037% ( 14000, 22000 ] 4 0.000% 100.037% ( 22000, 33000 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 250894 Average: 12.3211 StdDev: 152.40 Min: 1 Median: 1.9751 Max: 9015 Percentiles: P50: 1.98 P75: 2.94 P99: 19.70 P99.9: 2340.70 P99.99: 3914.70 ------------------------------------------------------ [ 0, 1 ] 4192 1.671% 1.671% ( 1, 2 ] 124355 49.565% 51.236% ########## ( 2, 3 ] 63438 25.285% 76.520% ##### ( 3, 4 ] 22396 8.926% 85.447% ## ( 4, 6 ] 26362 10.507% 95.954% ## ( 6, 10 ] 6062 2.416% 98.370% ( 10, 15 ] 1482 0.591% 98.961% ( 15, 22 ] 146 0.058% 99.019% ( 22, 34 ] 14 0.006% 99.025% ( 34, 51 ] 11 0.004% 99.029% ( 51, 76 ] 8 0.003% 99.032% ( 76, 110 ] 49 0.020% 99.052% ( 110, 170 ] 485 0.193% 99.245% ( 170, 250 ] 415 0.165% 99.411% ( 250, 380 ] 244 0.097% 99.508% ( 380, 580 ] 276 0.110% 99.618% ( 580, 870 ] 264 0.105% 99.723% ( 870, 1300 ] 209 0.083% 99.806% ( 1300, 1900 ] 143 0.057% 99.863% ( 1900, 2900 ] 209 0.083% 99.947% ( 2900, 4400 ] 161 0.064% 100.011% ( 4400, 6600 ] 31 0.012% 100.023% ( 6600, 9900 ] 17 0.007% 100.030% ** Level 2 read latency histogram (micros): Count: 763818 Average: 19.4209 StdDev: 266.32 Min: 1 Median: 1.9779 Max: 31857 Percentiles: P50: 1.98 P75: 3.05 P99: 13.56 P99.9: 2344.58 P99.99: 2864.19 ------------------------------------------------------ [ 0, 1 ] 23349 3.057% 3.057% # ( 1, 2 ] 366655 48.003% 51.060% ########## ( 2, 3 ] 179172 23.457% 74.517% ##### ( 3, 4 ] 72106 9.440% 83.957% ## ( 4, 6 ] 87389 11.441% 95.399% ## ( 6, 10 ] 22603 2.959% 98.358% # ( 10, 15 ] 6888 0.902% 99.260% ( 15, 22 ] 1046 0.137% 99.396% ( 22, 34 ] 112 0.015% 99.411% ( 34, 51 ] 38 0.005% 99.416% ( 51, 76 ] 37 0.005% 99.421% ( 76, 110 ] 18 0.002% 99.423% ( 110, 170 ] 46 0.006% 99.429% ( 170, 250 ] 82 0.011% 99.440% ( 250, 380 ] 124 0.016% 99.456% ( 380, 580 ] 329 0.043% 99.499% ( 580, 870 ] 554 0.073% 99.572% ( 870, 1300 ] 840 0.110% 99.682% ( 1300, 1900 ] 1078 0.141% 99.823% ( 1900, 2900 ] 1323 0.173% 99.996% ( 2900, 4400 ] 842 0.110% 100.106% ( 4400, 6600 ] 285 0.037% 100.144% ( 6600, 9900 ] 87 0.011% 100.155% ( 9900, 14000 ] 36 0.005% 100.160% ( 14000, 22000 ] 22 0.003% 100.163% ( 22000, 33000 ] 12 0.002% 100.164% ** Level 3 read latency histogram (micros): Count: 2316483 Average: 12.4863 StdDev: 215.06 Min: 1 Median: 1.9984 Max: 57013 Percentiles: P50: 2.00 P75: 2.99 P99: 11.78 P99.9: 1164.53 P99.99: 1798.19 ------------------------------------------------------ [ 0, 1 ] 38383 1.657% 1.657% ( 1, 2 ] 1121644 48.420% 50.077% ########## ( 2, 3 ] 583754 25.200% 75.277% ##### ( 3, 4 ] 215894 9.320% 84.597% ## ( 4, 6 ] 267477 11.547% 96.144% ## ( 6, 10 ] 60348 2.605% 98.749% # ( 10, 15 ] 16373 0.707% 99.456% ( 15, 22 ] 1865 0.081% 99.536% ( 22, 34 ] 158 0.007% 99.543% ( 34, 51 ] 127 0.005% 99.548% ( 51, 76 ] 225 0.010% 99.558% ( 76, 110 ] 119 0.005% 99.563% ( 110, 170 ] 1035 0.045% 99.608% ( 170, 250 ] 1270 0.055% 99.663% ( 250, 380 ] 1109 0.048% 99.711% ( 380, 580 ] 1327 0.057% 99.768% ( 580, 870 ] 1703 0.074% 99.841% ( 870, 1300 ] 1979 0.085% 99.927% ( 1300, 1900 ] 1760 0.076% 100.003% ( 1900, 2900 ] 1866 0.081% 100.083% ( 2900, 4400 ] 1551 0.067% 100.150% ( 4400, 6600 ] 384 0.017% 100.167% ( 6600, 9900 ] 92 0.004% 100.171% ( 9900, 14000 ] 23 0.001% 100.172% ( 14000, 22000 ] 26 0.001% 100.173% ( 22000, 33000 ] 27 0.001% 100.174% ( 33000, 50000 ] 10 0.000% 100.175% ( 50000, 75000 ] 2 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 1005178 Average: 24.7030 StdDev: 249.35 Min: 1 Median: 2.0067 Max: 54927 Percentiles: P50: 2.01 P75: 3.17 P99: 482.20 P99.9: 2454.20 P99.99: 3252.75 ------------------------------------------------------ [ 0, 1 ] 19375 1.928% 1.928% ( 1, 2 ] 481634 47.915% 49.843% ########## ( 2, 3 ] 237275 23.605% 73.448% ##### ( 3, 4 ] 92673 9.220% 82.668% ## ( 4, 6 ] 112362 11.178% 93.846% ## ( 6, 10 ] 27125 2.699% 96.544% # ( 10, 15 ] 7135 0.710% 97.254% ( 15, 22 ] 744 0.074% 97.328% ( 22, 34 ] 73 0.007% 97.336% ( 34, 51 ] 92 0.009% 97.345% ( 51, 76 ] 117 0.012% 97.356% ( 76, 110 ] 516 0.051% 97.408% ( 110, 170 ] 6131 0.610% 98.018% ( 170, 250 ] 5447 0.542% 98.560% ( 250, 380 ] 2886 0.287% 98.847% ( 380, 580 ] 3016 0.300% 99.147% ( 580, 870 ] 2885 0.287% 99.434% ( 870, 1300 ] 2333 0.232% 99.666% ( 1300, 1900 ] 1599 0.159% 99.825% ( 1900, 2900 ] 1362 0.135% 99.960% ( 2900, 4400 ] 1265 0.126% 100.086% ( 4400, 6600 ] 362 0.036% 100.122% ( 6600, 9900 ] 57 0.006% 100.128% ( 9900, 14000 ] 5 0.000% 100.128% ( 14000, 22000 ] 5 0.000% 100.129% ( 22000, 33000 ] 5 0.000% 100.129% ( 33000, 50000 ] 3 0.000% 100.130% ( 50000, 75000 ] 2 0.000% 100.130% ** Level 5 read latency histogram (micros): Count: 131766 Average: 598.0526 StdDev: 1153.14 Min: 84 Median: 237.7765 Max: 65900 Percentiles: P50: 237.78 P75: 570.76 P99: 5013.83 P99.9: 9284.27 P99.99: 38856.99 ------------------------------------------------------ ( 76, 110 ] 3104 2.356% 2.356% ( 110, 170 ] 36885 27.993% 30.348% ###### ( 170, 250 ] 30564 23.196% 53.544% ##### ( 250, 380 ] 14798 11.231% 64.775% ## ( 380, 580 ] 14126 10.721% 75.495% ## ( 580, 870 ] 11158 8.468% 83.963% ## ( 870, 1300 ] 7554 5.733% 89.696% # ( 1300, 1900 ] 4367 3.314% 93.010% # ( 1900, 2900 ] 3961 3.006% 96.016% # ( 2900, 4400 ] 3553 2.696% 98.713% # ( 4400, 6600 ] 1356 1.029% 99.742% ( 6600, 9900 ] 256 0.194% 99.936% ( 9900, 14000 ] 32 0.024% 99.961% ( 14000, 22000 ] 17 0.013% 99.973% ( 22000, 33000 ] 17 0.013% 99.986% ( 33000, 50000 ] 14 0.011% 99.997% ( 50000, 75000 ] 8 0.006% 100.003% ** DB Stats ** Uptime(secs): 28.1 total, 5.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 175.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.326 H:M:S, 33.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.463 H:M:S, 29.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/10/12-17:20:03 ... thread 0: (1000000,6000000) ops and (110683.2,162537.1) ops/second in (9.034798,36.914654) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.60 GB 263.4 6.3 0.0 6.3 12.0 5.6 0.0 2.1 116.3 219.9 55.78 41.46 102 0.547 6586K 15K 0.0 0.0 L1 6/6 518.24 MB 0.0 1.3 1.1 0.2 1.3 1.1 0.0 1.2 144.2 143.6 9.58 6.41 2 4.792 1402K 4853 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.7 3.2 121.6 121.5 1.54 0.86 1 1.536 189K 210 0.0 0.0 L3 16/0 972.27 MB 1.0 7.9 4.0 3.9 7.9 4.0 0.0 2.0 112.3 111.6 72.13 39.50 33 2.186 6043K 12K 0.0 0.0 L4 175/0 9.76 GB 1.0 9.2 5.4 3.8 9.1 5.3 0.3 1.7 121.4 119.6 77.54 44.67 60 1.292 5069K 234 0.0 0.0 L5 1156/0 94.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/18 110.49 GB 0.0 25.0 10.6 14.3 30.4 16.1 6.5 5.4 118.0 143.9 216.57 132.90 198 1.094 19M 33K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.0 10.6 14.3 30.4 16.1 6.5 5.4 118.0 143.9 216.57 132.90 198 1.094 19M 33K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.0 10.6 14.3 24.8 10.4 0.0 0.0 135.7 134.7 188.36 116.57 115 1.638 19M 33K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 205.4 28.21 16.33 83 0.340 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.1 total, 36.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.43 GB write, 839.82 MB/s write, 24.97 GB read, 689.05 MB/s read, 216.6 seconds Interval compaction: 30.43 GB write, 844.05 MB/s write, 24.97 GB read, 692.52 MB/s read, 216.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 64, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 64, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2095536 Average: 15.0041 StdDev: 102.49 Min: 0 Median: 1.6316 Max: 22686 Percentiles: P50: 1.63 P75: 2.33 P99: 252.13 P99.9: 849.35 P99.99: 1685.87 ------------------------------------------------------ [ 0, 1 ] 308229 14.709% 14.709% ### ( 1, 2 ] 1170848 55.873% 70.582% ########### ( 2, 3 ] 281050 13.412% 83.994% ### ( 3, 4 ] 101197 4.829% 88.823% # ( 4, 6 ] 106650 5.089% 93.913% # ( 6, 10 ] 20760 0.991% 94.903% ( 10, 15 ] 4829 0.230% 95.134% ( 15, 22 ] 490 0.023% 95.157% ( 22, 34 ] 45 0.002% 95.159% ( 34, 51 ] 27 0.001% 95.161% ( 51, 76 ] 38 0.002% 95.162% ( 76, 110 ] 3563 0.170% 95.332% ( 110, 170 ] 44182 2.108% 97.441% ( 170, 250 ] 32520 1.552% 98.993% ( 250, 380 ] 9442 0.451% 99.443% ( 380, 580 ] 6566 0.313% 99.757% ( 580, 870 ] 3237 0.154% 99.911% ( 870, 1300 ] 1267 0.060% 99.972% ( 1300, 1900 ] 604 0.029% 100.000% ( 1900, 2900 ] 478 0.023% 100.023% ( 2900, 4400 ] 366 0.017% 100.041% ( 4400, 6600 ] 88 0.004% 100.045% ( 6600, 9900 ] 16 0.001% 100.046% ( 9900, 14000 ] 4 0.000% 100.046% ( 14000, 22000 ] 4 0.000% 100.046% ( 22000, 33000 ] 2 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 271145 Average: 12.6904 StdDev: 147.36 Min: 1 Median: 2.0777 Max: 9015 Percentiles: P50: 2.08 P75: 3.22 P99: 158.49 P99.9: 2246.93 P99.99: 3895.83 ------------------------------------------------------ [ 0, 1 ] 4228 1.559% 1.559% ( 1, 2 ] 126143 46.522% 48.082% ######### ( 2, 3 ] 66942 24.689% 72.770% ##### ( 3, 4 ] 27620 10.186% 82.957% ## ( 4, 6 ] 32720 12.067% 95.024% ## ( 6, 10 ] 7410 2.733% 97.757% # ( 10, 15 ] 1824 0.673% 98.430% ( 15, 22 ] 355 0.131% 98.561% ( 22, 34 ] 54 0.020% 98.580% ( 34, 51 ] 13 0.005% 98.585% ( 51, 76 ] 9 0.003% 98.589% ( 76, 110 ] 119 0.044% 98.632% ( 110, 170 ] 1233 0.455% 99.087% ( 170, 250 ] 829 0.306% 99.393% ( 250, 380 ] 342 0.126% 99.519% ( 380, 580 ] 330 0.122% 99.641% ( 580, 870 ] 276 0.102% 99.743% ( 870, 1300 ] 211 0.078% 99.820% ( 1300, 1900 ] 143 0.053% 99.873% ( 1900, 2900 ] 210 0.077% 99.951% ( 2900, 4400 ] 161 0.059% 100.010% ( 4400, 6600 ] 31 0.011% 100.021% ( 6600, 9900 ] 17 0.006% 100.028% ** Level 2 read latency histogram (micros): Count: 763818 Average: 19.4209 StdDev: 266.32 Min: 1 Median: 1.9779 Max: 31857 Percentiles: P50: 1.98 P75: 3.05 P99: 13.56 P99.9: 2344.58 P99.99: 2864.19 ------------------------------------------------------ [ 0, 1 ] 23349 3.057% 3.057% # ( 1, 2 ] 366655 48.003% 51.060% ########## ( 2, 3 ] 179172 23.457% 74.517% ##### ( 3, 4 ] 72106 9.440% 83.957% ## ( 4, 6 ] 87389 11.441% 95.399% ## ( 6, 10 ] 22603 2.959% 98.358% # ( 10, 15 ] 6888 0.902% 99.260% ( 15, 22 ] 1046 0.137% 99.396% ( 22, 34 ] 112 0.015% 99.411% ( 34, 51 ] 38 0.005% 99.416% ( 51, 76 ] 37 0.005% 99.421% ( 76, 110 ] 18 0.002% 99.423% ( 110, 170 ] 46 0.006% 99.429% ( 170, 250 ] 82 0.011% 99.440% ( 250, 380 ] 124 0.016% 99.456% ( 380, 580 ] 329 0.043% 99.499% ( 580, 870 ] 554 0.073% 99.572% ( 870, 1300 ] 840 0.110% 99.682% ( 1300, 1900 ] 1078 0.141% 99.823% ( 1900, 2900 ] 1323 0.173% 99.996% ( 2900, 4400 ] 842 0.110% 100.106% ( 4400, 6600 ] 285 0.037% 100.144% ( 6600, 9900 ] 87 0.011% 100.155% ( 9900, 14000 ] 36 0.005% 100.160% ( 14000, 22000 ] 22 0.003% 100.163% ( 22000, 33000 ] 12 0.002% 100.164% ** Level 3 read latency histogram (micros): Count: 2319120 Average: 12.6773 StdDev: 215.05 Min: 1 Median: 1.9996 Max: 57013 Percentiles: P50: 2.00 P75: 2.99 P99: 12.52 P99.9: 1164.46 P99.99: 1798.78 ------------------------------------------------------ [ 0, 1 ] 38383 1.655% 1.655% ( 1, 2 ] 1121653 48.365% 50.021% ########## ( 2, 3 ] 583816 25.174% 75.195% ##### ( 3, 4 ] 215932 9.311% 84.506% ## ( 4, 6 ] 267546 11.537% 96.042% ## ( 6, 10 ] 60355 2.602% 98.645% # ( 10, 15 ] 16375 0.706% 99.351% ( 15, 22 ] 1865 0.080% 99.431% ( 22, 34 ] 158 0.007% 99.438% ( 34, 51 ] 127 0.005% 99.443% ( 51, 76 ] 225 0.010% 99.453% ( 76, 110 ] 239 0.010% 99.463% ( 110, 170 ] 2285 0.099% 99.562% ( 170, 250 ] 2027 0.087% 99.649% ( 250, 380 ] 1285 0.055% 99.705% ( 380, 580 ] 1443 0.062% 99.767% ( 580, 870 ] 1731 0.075% 99.842% ( 870, 1300 ] 1980 0.085% 99.927% ( 1300, 1900 ] 1760 0.076% 100.003% ( 1900, 2900 ] 1868 0.081% 100.083% ( 2900, 4400 ] 1551 0.067% 100.150% ( 4400, 6600 ] 384 0.017% 100.167% ( 6600, 9900 ] 92 0.004% 100.171% ( 9900, 14000 ] 23 0.001% 100.172% ( 14000, 22000 ] 26 0.001% 100.173% ( 22000, 33000 ] 27 0.001% 100.174% ( 33000, 50000 ] 10 0.000% 100.174% ( 50000, 75000 ] 2 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 1026347 Average: 27.9580 StdDev: 248.34 Min: 1 Median: 2.0509 Max: 54927 Percentiles: P50: 2.05 P75: 3.33 P99: 509.66 P99.9: 2440.01 P99.99: 3250.24 ------------------------------------------------------ [ 0, 1 ] 19375 1.888% 1.888% ( 1, 2 ] 481702 46.934% 48.821% ######### ( 2, 3 ] 237654 23.155% 71.977% ##### ( 3, 4 ] 92892 9.051% 81.027% ## ( 4, 6 ] 112729 10.984% 92.011% ## ( 6, 10 ] 27175 2.648% 94.659% # ( 10, 15 ] 7147 0.696% 95.355% ( 15, 22 ] 745 0.073% 95.428% ( 22, 34 ] 73 0.007% 95.435% ( 34, 51 ] 92 0.009% 95.444% ( 51, 76 ] 117 0.011% 95.455% ( 76, 110 ] 1523 0.148% 95.604% ( 110, 170 ] 16513 1.609% 97.212% ( 170, 250 ] 11521 1.123% 98.335% ( 250, 380 ] 4281 0.417% 98.752% ( 380, 580 ] 3925 0.382% 99.135% ( 580, 870 ] 3148 0.307% 99.441% ( 870, 1300 ] 2370 0.231% 99.672% ( 1300, 1900 ] 1601 0.156% 99.828% ( 1900, 2900 ] 1366 0.133% 99.961% ( 2900, 4400 ] 1265 0.123% 100.084% ( 4400, 6600 ] 362 0.035% 100.120% ( 6600, 9900 ] 57 0.006% 100.125% ( 9900, 14000 ] 5 0.000% 100.126% ( 14000, 22000 ] 5 0.000% 100.126% ( 22000, 33000 ] 5 0.000% 100.127% ( 33000, 50000 ] 3 0.000% 100.127% ( 50000, 75000 ] 2 0.000% 100.127% ** Level 5 read latency histogram (micros): Count: 246500 Average: 408.6133 StdDev: 870.36 Min: 82 Median: 192.6263 Max: 65900 Percentiles: P50: 192.63 P75: 330.68 P99: 4075.11 P99.9: 7792.38 P99.99: 28050.00 ------------------------------------------------------ ( 76, 110 ] 8809 3.574% 3.574% # ( 110, 170 ] 95668 38.811% 42.384% ######## ( 170, 250 ] 66376 26.927% 69.312% ##### ( 250, 380 ] 22595 9.166% 78.478% ## ( 380, 580 ] 19181 7.781% 86.259% ## ( 580, 870 ] 12506 5.073% 91.333% # ( 870, 1300 ] 7738 3.139% 94.472% # ( 1300, 1900 ] 4391 1.781% 96.253% ( 1900, 2900 ] 3986 1.617% 97.870% ( 2900, 4400 ] 3555 1.442% 99.312% ( 4400, 6600 ] 1356 0.550% 99.862% ( 6600, 9900 ] 256 0.104% 99.966% ( 9900, 14000 ] 32 0.013% 99.979% ( 14000, 22000 ] 17 0.007% 99.986% ( 22000, 33000 ] 17 0.007% 99.993% ( 33000, 50000 ] 14 0.006% 99.999% ( 50000, 75000 ] 8 0.003% 100.002% ** DB Stats ** Uptime(secs): 37.1 total, 9.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 159.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.699 H:M:S, 39.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 108.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.373 H:M:S, 59.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 320.661 micros/op 12458 ops/sec 60.200 seconds 749996 operations; 12.1 MB/s (182999 of 182999 found) Microseconds per read: Count: 749996 Average: 320.6640 StdDev: 1101.13 Min: 2 Median: 207.5971 Max: 196575 Percentiles: P50: 207.60 P75: 263.58 P99: 2327.10 P99.9: 18255.13 P99.99: 40183.19 ------------------------------------------------------ ( 1, 2 ] 5 0.001% 0.001% ( 2, 3 ] 34 0.005% 0.005% ( 3, 4 ] 41 0.005% 0.011% ( 4, 6 ] 71 0.009% 0.020% ( 6, 10 ] 309 0.041% 0.061% ( 10, 15 ] 3318 0.442% 0.504% ( 15, 22 ] 3388 0.452% 0.955% ( 22, 34 ] 9188 1.225% 2.181% ( 34, 51 ] 2792 0.372% 2.553% ( 51, 76 ] 430 0.057% 2.610% ( 76, 110 ] 1981 0.264% 2.874% ( 110, 170 ] 196294 26.173% 29.047% ##### ( 170, 250 ] 334381 44.584% 73.631% ######### ( 250, 380 ] 98260 13.101% 86.733% ### ( 380, 580 ] 52293 6.972% 93.705% # ( 580, 870 ] 22274 2.970% 96.675% # ( 870, 1300 ] 10871 1.449% 98.125% ( 1300, 1900 ] 4955 0.661% 98.785% ( 1900, 2900 ] 3772 0.503% 99.288% ( 2900, 4400 ] 2963 0.395% 99.683% ( 4400, 6600 ] 873 0.116% 99.800% ( 6600, 9900 ] 187 0.025% 99.825% ( 9900, 14000 ] 174 0.023% 99.848% ( 14000, 22000 ] 737 0.098% 99.946% ( 22000, 33000 ] 300 0.040% 99.986% ( 33000, 50000 ] 71 0.009% 99.995% ( 50000, 75000 ] 23 0.003% 99.999% ( 75000, 110000 ] 5 0.001% 99.999% ( 110000, 170000 ] 5 0.001% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14446358 rocksdb.bloom.filter.full.positive COUNT : 890719 rocksdb.bloom.filter.full.true.positive COUNT : 749622 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 374 rocksdb.memtable.miss COUNT : 749622 rocksdb.l0.hit COUNT : 33185 rocksdb.l1.hit COUNT : 3611 rocksdb.l2andup.hit COUNT : 712826 rocksdb.compaction.key.drop.new COUNT : 213633 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6385512 rocksdb.number.keys.read COUNT : 749996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6589848384 rocksdb.bytes.read COUNT : 749996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1746 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36277086 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28266845207 rocksdb.compact.write.bytes COUNT : 28044438164 rocksdb.flush.write.bytes COUNT : 6539729722 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 1301 rocksdb.number.superversion_releases COUNT : 1274 rocksdb.number.superversion_cleanups COUNT : 329 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 272 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6486975488 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2506752 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31735862547 rocksdb.non.last.level.read.count COUNT : 7525661 rocksdb.block.checksum.compute.count COUNT : 7747261 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 206.766319 P95 : 705.375163 P99 : 2326.801061 P100 : 196572.000000 COUNT : 749996 SUM : 239825322 rocksdb.db.write.micros P50 : 1.536587 P95 : 3.998853 P99 : 7.220899 P100 : 949989.000000 COUNT : 6385512 SUM : 51912773 rocksdb.compaction.times.micros P50 : 1398333.333333 P95 : 3530000.000000 P99 : 5213000.000000 P100 : 6352993.000000 COUNT : 117 SUM : 190269912 rocksdb.compaction.times.cpu_micros P50 : 887674.418605 P95 : 1857500.000000 P99 : 5213000.000000 P100 : 5595567.000000 COUNT : 117 SUM : 118454817 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1002.307692 P95 : 37250.000000 P99 : 93712.000000 P100 : 93712.000000 COUNT : 90 SUM : 623007 rocksdb.compaction.outfile.sync.micros P50 : 15090.909091 P95 : 155461.538462 P99 : 285100.000000 P100 : 446513.000000 COUNT : 346 SUM : 13209220 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 304.736842 P95 : 4522.222222 P99 : 7755.000000 P100 : 23936.000000 COUNT : 230 SUM : 257768 rocksdb.table.open.io.micros P50 : 11513.747646 P95 : 21601.639344 P99 : 31451.698113 P100 : 132044.000000 COUNT : 1746 SUM : 19596432 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.103451 P95 : 10.203595 P99 : 215.601481 P100 : 57016.000000 COUNT : 6844989 SUM : 117634997 rocksdb.read.block.get.micros P50 : 157.052798 P95 : 553.696404 P99 : 2208.049897 P100 : 65955.000000 COUNT : 900513 SUM : 206746140 rocksdb.write.raw.block.micros P50 : 0.531735 P95 : 1.249710 P99 : 3.646237 P100 : 110881.000000 COUNT : 8376457 SUM : 27791054 rocksdb.numfiles.in.singlecompaction P50 : 2.612500 P95 : 5.100000 P99 : 12.616667 P100 : 14.000000 COUNT : 143 SUM : 473 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563957 P95 : 2009.955132 P99 : 2723.606282 P100 : 949834.000000 COUNT : 159055 SUM : 36287396 rocksdb.sst.read.micros P50 : 2.003212 P95 : 181.442381 P99 : 533.617857 P100 : 65900.000000 COUNT : 7525686 SUM : 304683542 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 749996 SUM : 749996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6385512 SUM : 6589848384 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226250.000000 P95 : 1001666.666667 P99 : 1205185.000000 P100 : 1205185.000000 COUNT : 90 SUM : 29658985 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 376 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0