[2024-11-17 03:28:24.840405] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-17 03:28:24.840667] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1997304 ] Set seed to 1731810504833728 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 03:28:24.959859] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 03:28:25.173698] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 03:28:25.173740] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1997304' to capture a snapshot of events at runtime. [2024-11-17 03:28:25.173750] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1997304 for offline analysis/debug. [2024-11-17 03:28:25.173778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 03:28:33 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-03:28:41 ... thread 0: (1000000,1000000) ops and (123425.2,123425.2) ops/second in (8.102074,8.102074) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/7 629.91 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 112.8 7.26 2.52 9 0.807 0 0 0.0 0.0 L1 3/3 230.62 MB 0.0 0.5 0.3 0.3 0.5 0.3 0.0 1.9 122.4 122.3 4.56 2.56 3 1.521 566K 353 0.0 0.0 L2 4/1 358.05 MB 2.3 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 47/9 3.85 GB 3.1 2.8 2.0 0.8 2.8 2.0 0.0 1.4 97.3 96.0 29.70 13.42 11 2.700 1900K 0 0.0 0.0 L4 190/13 12.13 GB 1.2 2.9 2.4 0.5 2.8 2.4 0.1 1.2 95.5 95.0 30.61 14.59 20 1.531 1482K 0 0.0 0.0 L5 1084/0 89.14 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/33 106.30 GB 0.0 6.2 4.7 1.5 7.0 5.4 0.2 8.7 88.3 98.9 72.13 33.09 43 1.677 3949K 353 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 4.7 1.5 7.0 5.4 0.2 8.7 88.3 98.9 72.13 33.09 43 1.677 3949K 353 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 4.7 1.5 6.2 4.6 0.0 0.0 98.2 97.3 64.87 30.57 34 1.908 3949K 353 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 112.8 7.26 2.52 9 0.807 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.3 total, 8.1 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.97 GB write, 863.32 MB/s write, 6.22 GB read, 771.05 MB/s read, 72.1 seconds Interval compaction: 6.97 GB write, 880.23 MB/s write, 6.22 GB read, 786.15 MB/s read, 72.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 33, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 151507 Average: 9.2271 StdDev: 192.71 Min: 1 Median: 1.8474 Max: 38143 Percentiles: P50: 1.85 P75: 2.84 P99: 9.74 P99.9: 2106.16 P99.99: 5656.23 ------------------------------------------------------ [ 0, 1 ] 7289 4.811% 4.811% # ( 1, 2 ] 80796 53.328% 58.139% ########### ( 2, 3 ] 30324 20.015% 78.154% #### ( 3, 4 ] 13795 9.105% 87.259% ## ( 4, 6 ] 15181 10.020% 97.279% ## ( 6, 10 ] 2791 1.842% 99.121% ( 10, 15 ] 720 0.475% 99.597% ( 15, 22 ] 105 0.069% 99.666% ( 22, 34 ] 4 0.003% 99.669% ( 34, 51 ] 3 0.002% 99.671% ( 51, 76 ] 15 0.010% 99.681% ( 76, 110 ] 1 0.001% 99.681% ( 170, 250 ] 10 0.007% 99.688% ( 250, 380 ] 20 0.013% 99.701% ( 380, 580 ] 43 0.028% 99.729% ( 580, 870 ] 79 0.052% 99.782% ( 870, 1300 ] 85 0.056% 99.838% ( 1300, 1900 ] 79 0.052% 99.890% ( 1900, 2900 ] 80 0.053% 99.943% ( 2900, 4400 ] 62 0.041% 99.983% ( 4400, 6600 ] 19 0.013% 99.996% ( 6600, 9900 ] 6 0.004% 100.000% ( 14000, 22000 ] 2 0.001% 100.001% ( 22000, 33000 ] 1 0.001% 100.002% ( 33000, 50000 ] 1 0.001% 100.003% ** Level 1 read latency histogram (micros): Count: 123392 Average: 6.4308 StdDev: 162.63 Min: 1 Median: 1.8233 Max: 25350 Percentiles: P50: 1.82 P75: 2.78 P99: 8.61 P99.9: 1140.41 P99.99: 5446.70 ------------------------------------------------------ [ 0, 1 ] 5955 4.826% 4.826% # ( 1, 2 ] 67701 54.867% 59.693% ########### ( 2, 3 ] 24318 19.708% 79.401% #### ( 3, 4 ] 10640 8.623% 88.024% ## ( 4, 6 ] 12311 9.977% 98.001% ## ( 6, 10 ] 1891 1.533% 99.533% ( 10, 15 ] 353 0.286% 99.819% ( 15, 22 ] 44 0.036% 99.855% ( 22, 34 ] 2 0.002% 99.857% ( 51, 76 ] 2 0.002% 99.858% ( 110, 170 ] 2 0.002% 99.860% ( 170, 250 ] 2 0.002% 99.861% ( 250, 380 ] 7 0.006% 99.867% ( 380, 580 ] 11 0.009% 99.876% ( 580, 870 ] 12 0.010% 99.886% ( 870, 1300 ] 28 0.023% 99.908% ( 1300, 1900 ] 36 0.029% 99.938% ( 1900, 2900 ] 26 0.021% 99.959% ( 2900, 4400 ] 32 0.026% 99.985% ( 4400, 6600 ] 14 0.011% 99.996% ( 6600, 9900 ] 1 0.001% 99.997% ( 14000, 22000 ] 1 0.001% 99.998% ( 22000, 33000 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 438374 Average: 19.2091 StdDev: 222.63 Min: 1 Median: 1.9275 Max: 11268 Percentiles: P50: 1.93 P75: 3.01 P99: 13.52 P99.9: 2270.74 P99.99: 2768.89 ------------------------------------------------------ [ 0, 1 ] 17440 3.978% 3.978% # ( 1, 2 ] 217520 49.620% 53.598% ########## ( 2, 3 ] 93569 21.345% 74.943% #### ( 3, 4 ] 43731 9.976% 84.918% ## ( 4, 6 ] 47261 10.781% 95.699% ## ( 6, 10 ] 11820 2.696% 98.396% # ( 10, 15 ] 3768 0.860% 99.255% ( 15, 22 ] 573 0.131% 99.386% ( 22, 34 ] 56 0.013% 99.399% ( 34, 51 ] 12 0.003% 99.401% ( 51, 76 ] 11 0.003% 99.404% ( 76, 110 ] 7 0.002% 99.406% ( 110, 170 ] 15 0.003% 99.409% ( 170, 250 ] 30 0.007% 99.416% ( 250, 380 ] 95 0.022% 99.437% ( 380, 580 ] 188 0.043% 99.480% ( 580, 870 ] 301 0.069% 99.549% ( 870, 1300 ] 525 0.120% 99.669% ( 1300, 1900 ] 720 0.164% 99.833% ( 1900, 2900 ] 792 0.181% 100.014% ( 2900, 4400 ] 545 0.124% 100.138% ( 4400, 6600 ] 175 0.040% 100.178% ( 6600, 9900 ] 50 0.011% 100.189% ( 9900, 14000 ] 3 0.001% 100.190% ** Level 3 read latency histogram (micros): Count: 790202 Average: 19.0119 StdDev: 293.48 Min: 1 Median: 1.9698 Max: 44648 Percentiles: P50: 1.97 P75: 2.99 P99: 12.10 P99.9: 1744.33 P99.99: 2267.10 ------------------------------------------------------ [ 0, 1 ] 17792 2.252% 2.252% ( 1, 2 ] 389044 49.233% 51.485% ########## ( 2, 3 ] 188490 23.853% 75.338% ##### ( 3, 4 ] 78811 9.974% 85.312% ## ( 4, 6 ] 86105 10.897% 96.209% ## ( 6, 10 ] 19612 2.482% 98.690% ( 10, 15 ] 5837 0.739% 99.429% ( 15, 22 ] 777 0.098% 99.527% ( 22, 34 ] 52 0.007% 99.534% ( 34, 51 ] 27 0.003% 99.537% ( 51, 76 ] 43 0.005% 99.543% ( 76, 110 ] 17 0.002% 99.545% ( 110, 170 ] 25 0.003% 99.548% ( 170, 250 ] 50 0.006% 99.555% ( 250, 380 ] 109 0.014% 99.568% ( 380, 580 ] 282 0.036% 99.604% ( 580, 870 ] 591 0.075% 99.679% ( 870, 1300 ] 949 0.120% 99.799% ( 1300, 1900 ] 1080 0.137% 99.936% ( 1900, 2900 ] 1174 0.149% 100.084% ( 2900, 4400 ] 921 0.117% 100.201% ( 4400, 6600 ] 309 0.039% 100.240% ( 6600, 9900 ] 61 0.008% 100.248% ( 9900, 14000 ] 14 0.002% 100.249% ( 14000, 22000 ] 20 0.003% 100.252% ( 22000, 33000 ] 13 0.002% 100.253% ( 33000, 50000 ] 11 0.001% 100.255% ** Level 4 read latency histogram (micros): Count: 218994 Average: 41.9181 StdDev: 396.48 Min: 1 Median: 1.9511 Max: 47421 Percentiles: P50: 1.95 P75: 2.98 P99: 1433.69 P99.9: 4121.12 P99.99: 5227.17 ------------------------------------------------------ [ 0, 1 ] 6204 2.833% 2.833% # ( 1, 2 ] 108609 49.595% 52.427% ########## ( 2, 3 ] 50666 23.136% 75.563% ##### ( 3, 4 ] 22267 10.168% 85.731% ## ( 4, 6 ] 21051 9.613% 95.344% ## ( 6, 10 ] 4692 2.143% 97.486% ( 10, 15 ] 1265 0.578% 98.064% ( 15, 22 ] 157 0.072% 98.136% ( 22, 34 ] 24 0.011% 98.147% ( 34, 51 ] 6 0.003% 98.149% ( 51, 76 ] 15 0.007% 98.156% ( 76, 110 ] 7 0.003% 98.159% ( 110, 170 ] 11 0.005% 98.164% ( 170, 250 ] 71 0.032% 98.197% ( 250, 380 ] 106 0.048% 98.245% ( 380, 580 ] 224 0.102% 98.347% ( 580, 870 ] 489 0.223% 98.571% ( 870, 1300 ] 752 0.343% 98.914% ( 1300, 1900 ] 844 0.385% 99.300% ( 1900, 2900 ] 829 0.379% 99.678% ( 2900, 4400 ] 597 0.273% 99.951% ( 4400, 6600 ] 229 0.105% 100.055% ( 6600, 9900 ] 32 0.015% 100.070% ( 9900, 14000 ] 7 0.003% 100.073% ( 14000, 22000 ] 5 0.002% 100.075% ( 22000, 33000 ] 5 0.002% 100.078% ( 33000, 50000 ] 3 0.001% 100.079% ** Level 5 read latency histogram (micros): Count: 9791 Average: 2390.0921 StdDev: 2495.48 Min: 80 Median: 1819.5896 Max: 97852 Percentiles: P50: 1819.59 P75: 3365.10 P99: 8827.31 P99.9: 37546.08 P99.99: 75731.50 ------------------------------------------------------ ( 76, 110 ] 10 0.102% 0.102% ( 110, 170 ] 18 0.184% 0.286% ( 170, 250 ] 79 0.807% 1.093% ( 250, 380 ] 242 2.472% 3.564% ( 380, 580 ] 571 5.832% 9.396% # ( 580, 870 ] 1071 10.939% 20.335% ## ( 870, 1300 ] 1512 15.443% 35.778% ### ( 1300, 1900 ] 1608 16.423% 52.201% ### ( 1900, 2900 ] 1698 17.342% 69.543% ### ( 2900, 4400 ] 1723 17.598% 87.141% #### ( 4400, 6600 ] 1045 10.673% 97.814% ## ( 6600, 9900 ] 172 1.757% 99.571% ( 9900, 14000 ] 15 0.153% 99.724% ( 14000, 22000 ] 8 0.082% 99.806% ( 22000, 33000 ] 6 0.061% 99.867% ( 33000, 50000 ] 12 0.123% 99.990% ( 75000, 110000 ] 1 0.010% 100.000% ** DB Stats ** Uptime(secs): 8.3 total, 8.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 119.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.179 H:M:S, 50.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.179 H:M:S, 51.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/17-03:28:48 ... thread 0: (1000000,2000000) ops and (149506.8,135219.8) ops/second in (6.688657,14.790731) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.35 GB 18.9 0.4 0.0 0.4 2.2 1.8 0.0 1.2 23.4 136.6 16.13 6.89 22 0.733 383K 536 0.0 0.0 L1 1/1 43.53 MB 0.0 1.0 0.5 0.5 1.0 0.5 0.0 1.9 128.1 128.0 8.12 4.93 4 2.030 1056K 1137 0.0 0.0 L2 2/2 194.58 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.3 2.3 122.7 122.4 3.34 1.93 2 1.671 416K 1100 0.0 0.0 L3 23/8 1.58 GB 1.0 4.0 2.5 1.5 4.0 2.5 0.1 1.6 103.0 101.9 40.25 19.39 17 2.368 2657K 734 0.0 0.0 L4 171/2 9.61 GB 1.0 7.6 4.7 2.9 7.6 4.6 0.6 1.6 108.3 107.0 72.30 38.01 43 1.681 3116K 3856 0.0 0.0 L5 1148/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1358/23 107.20 GB 0.0 13.5 7.9 5.5 15.1 9.6 6.3 8.5 98.5 110.5 140.15 71.15 88 1.593 7630K 7363 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 7.9 5.5 15.1 9.6 6.3 8.5 98.5 110.5 140.15 71.15 88 1.593 7630K 7363 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 7.9 5.5 13.3 7.8 0.0 0.0 109.4 108.3 126.19 65.80 67 1.883 7630K 7363 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 130.9 13.96 5.35 21 0.665 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.13 GB write, 1036.06 MB/s write, 13.48 GB read, 923.39 MB/s read, 140.1 seconds Interval compaction: 15.13 GB write, 1047.18 MB/s write, 13.48 GB read, 933.30 MB/s read, 140.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 66, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 413670 Average: 11.2575 StdDev: 179.94 Min: 1 Median: 1.8426 Max: 38143 Percentiles: P50: 1.84 P75: 2.81 P99: 10.84 P99.9: 2192.15 P99.99: 4317.23 ------------------------------------------------------ [ 0, 1 ] 19436 4.698% 4.698% # ( 1, 2 ] 222405 53.764% 58.462% ########### ( 2, 3 ] 83975 20.300% 78.762% #### ( 3, 4 ] 36067 8.719% 87.481% ## ( 4, 6 ] 39218 9.481% 96.962% ## ( 6, 10 ] 8126 1.964% 98.926% ( 10, 15 ] 1824 0.441% 99.367% ( 15, 22 ] 211 0.051% 99.418% ( 22, 34 ] 12 0.003% 99.421% ( 34, 51 ] 26 0.006% 99.427% ( 51, 76 ] 33 0.008% 99.435% ( 76, 110 ] 7 0.002% 99.437% ( 110, 170 ] 18 0.004% 99.441% ( 170, 250 ] 91 0.022% 99.463% ( 250, 380 ] 179 0.043% 99.506% ( 380, 580 ] 345 0.083% 99.590% ( 580, 870 ] 453 0.110% 99.699% ( 870, 1300 ] 454 0.110% 99.809% ( 1300, 1900 ] 303 0.073% 99.882% ( 1900, 2900 ] 251 0.061% 99.943% ( 2900, 4400 ] 206 0.050% 99.993% ( 4400, 6600 ] 71 0.017% 100.010% ( 6600, 9900 ] 8 0.002% 100.012% ( 9900, 14000 ] 1 0.000% 100.012% ( 14000, 22000 ] 7 0.002% 100.014% ( 22000, 33000 ] 2 0.000% 100.014% ( 33000, 50000 ] 1 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 227527 Average: 9.5670 StdDev: 161.20 Min: 1 Median: 1.8913 Max: 25350 Percentiles: P50: 1.89 P75: 2.89 P99: 9.88 P99.9: 2129.32 P99.99: 4873.93 ------------------------------------------------------ [ 0, 1 ] 7929 3.485% 3.485% # ( 1, 2 ] 118737 52.186% 55.671% ########## ( 2, 3 ] 49315 21.674% 77.345% #### ( 3, 4 ] 21067 9.259% 86.604% ## ( 4, 6 ] 23789 10.455% 97.060% ## ( 6, 10 ] 4550 2.000% 99.059% ( 10, 15 ] 1086 0.477% 99.537% ( 15, 22 ] 113 0.050% 99.586% ( 22, 34 ] 4 0.002% 99.588% ( 34, 51 ] 8 0.004% 99.592% ( 51, 76 ] 14 0.006% 99.598% ( 76, 110 ] 3 0.001% 99.599% ( 110, 170 ] 12 0.005% 99.604% ( 170, 250 ] 28 0.012% 99.617% ( 250, 380 ] 52 0.023% 99.640% ( 380, 580 ] 107 0.047% 99.687% ( 580, 870 ] 161 0.071% 99.757% ( 870, 1300 ] 172 0.076% 99.833% ( 1300, 1900 ] 131 0.058% 99.891% ( 1900, 2900 ] 98 0.043% 99.934% ( 2900, 4400 ] 123 0.054% 99.988% ( 4400, 6600 ] 29 0.013% 100.000% ( 6600, 9900 ] 2 0.001% 100.001% ( 9900, 14000 ] 1 0.000% 100.002% ( 14000, 22000 ] 1 0.000% 100.002% ( 22000, 33000 ] 3 0.001% 100.004% ** Level 2 read latency histogram (micros): Count: 600671 Average: 17.1527 StdDev: 206.36 Min: 1 Median: 1.9355 Max: 11268 Percentiles: P50: 1.94 P75: 2.99 P99: 13.14 P99.9: 2317.30 P99.99: 2924.55 ------------------------------------------------------ [ 0, 1 ] 20256 3.372% 3.372% # ( 1, 2 ] 299396 49.844% 53.216% ########## ( 2, 3 ] 132479 22.055% 75.271% #### ( 3, 4 ] 59493 9.904% 85.175% ## ( 4, 6 ] 64327 10.709% 95.885% ## ( 6, 10 ] 15703 2.614% 98.499% # ( 10, 15 ] 4792 0.798% 99.297% ( 15, 22 ] 683 0.114% 99.410% ( 22, 34 ] 61 0.010% 99.420% ( 34, 51 ] 24 0.004% 99.424% ( 51, 76 ] 18 0.003% 99.427% ( 76, 110 ] 14 0.002% 99.430% ( 110, 170 ] 18 0.003% 99.433% ( 170, 250 ] 48 0.008% 99.441% ( 250, 380 ] 147 0.024% 99.465% ( 380, 580 ] 283 0.047% 99.512% ( 580, 870 ] 462 0.077% 99.589% ( 870, 1300 ] 676 0.113% 99.702% ( 1300, 1900 ] 811 0.135% 99.837% ( 1900, 2900 ] 909 0.151% 99.988% ( 2900, 4400 ] 668 0.111% 100.099% ( 4400, 6600 ] 206 0.034% 100.134% ( 6600, 9900 ] 54 0.009% 100.143% ( 9900, 14000 ] 4 0.001% 100.143% ** Level 3 read latency histogram (micros): Count: 1534145 Average: 15.1342 StdDev: 236.87 Min: 1 Median: 1.9598 Max: 44648 Percentiles: P50: 1.96 P75: 2.97 P99: 11.52 P99.9: 1527.08 P99.99: 2170.91 ------------------------------------------------------ [ 0, 1 ] 33212 2.165% 2.165% ( 1, 2 ] 764626 49.841% 52.005% ########## ( 2, 3 ] 362416 23.623% 75.629% ##### ( 3, 4 ] 150815 9.831% 85.459% ## ( 4, 6 ] 165656 10.798% 96.257% ## ( 6, 10 ] 38815 2.530% 98.787% # ( 10, 15 ] 10752 0.701% 99.488% ( 15, 22 ] 1270 0.083% 99.571% ( 22, 34 ] 93 0.006% 99.577% ( 34, 51 ] 94 0.006% 99.583% ( 51, 76 ] 124 0.008% 99.591% ( 76, 110 ] 31 0.002% 99.593% ( 110, 170 ] 84 0.005% 99.599% ( 170, 250 ] 155 0.010% 99.609% ( 250, 380 ] 326 0.021% 99.630% ( 380, 580 ] 686 0.045% 99.675% ( 580, 870 ] 1260 0.082% 99.757% ( 870, 1300 ] 1627 0.106% 99.863% ( 1300, 1900 ] 1511 0.098% 99.961% ( 1900, 2900 ] 1630 0.106% 100.068% ( 2900, 4400 ] 1414 0.092% 100.160% ( 4400, 6600 ] 452 0.029% 100.189% ( 6600, 9900 ] 76 0.005% 100.194% ( 9900, 14000 ] 17 0.001% 100.195% ( 14000, 22000 ] 24 0.002% 100.197% ( 22000, 33000 ] 14 0.001% 100.198% ( 33000, 50000 ] 11 0.001% 100.199% ** Level 4 read latency histogram (micros): Count: 786140 Average: 24.5400 StdDev: 276.79 Min: 1 Median: 1.9479 Max: 47421 Percentiles: P50: 1.95 P75: 2.98 P99: 487.17 P99.9: 2840.24 P99.99: 3715.24 ------------------------------------------------------ [ 0, 1 ] 18976 2.414% 2.414% ( 1, 2 ] 394676 50.204% 52.618% ########## ( 2, 3 ] 179638 22.851% 75.469% ##### ( 3, 4 ] 77275 9.830% 85.298% ## ( 4, 6 ] 81572 10.376% 95.675% ## ( 6, 10 ] 19062 2.425% 98.099% ( 10, 15 ] 4939 0.628% 98.728% ( 15, 22 ] 538 0.068% 98.796% ( 22, 34 ] 50 0.006% 98.803% ( 34, 51 ] 60 0.008% 98.810% ( 51, 76 ] 70 0.009% 98.819% ( 76, 110 ] 28 0.004% 98.823% ( 110, 170 ] 60 0.008% 98.830% ( 170, 250 ] 288 0.037% 98.867% ( 250, 380 ] 522 0.066% 98.933% ( 380, 580 ] 979 0.125% 99.058% ( 580, 870 ] 1772 0.225% 99.283% ( 870, 1300 ] 1922 0.244% 99.528% ( 1300, 1900 ] 1603 0.204% 99.732% ( 1900, 2900 ] 1408 0.179% 99.911% ( 2900, 4400 ] 1147 0.146% 100.057% ( 4400, 6600 ] 376 0.048% 100.104% ( 6600, 9900 ] 51 0.006% 100.111% ( 9900, 14000 ] 12 0.002% 100.112% ( 14000, 22000 ] 13 0.002% 100.114% ( 22000, 33000 ] 11 0.001% 100.116% ( 33000, 50000 ] 3 0.000% 100.116% ** Level 5 read latency histogram (micros): Count: 26042 Average: 1675.7241 StdDev: 1898.06 Min: 80 Median: 1118.5868 Max: 97852 Percentiles: P50: 1118.59 P75: 2238.95 P99: 6672.32 P99.9: 20479.00 P99.99: 47727.38 ------------------------------------------------------ ( 76, 110 ] 27 0.104% 0.104% ( 110, 170 ] 222 0.852% 0.956% ( 170, 250 ] 672 2.580% 3.537% # ( 250, 380 ] 1549 5.948% 9.485% # ( 380, 580 ] 3113 11.954% 21.438% ## ( 580, 870 ] 4644 17.833% 39.271% #### ( 870, 1300 ] 4833 18.558% 57.830% #### ( 1300, 1900 ] 3476 13.348% 71.177% ### ( 1900, 2900 ] 2937 11.278% 82.455% ## ( 2900, 4400 ] 2943 11.301% 93.756% ## ( 4400, 6600 ] 1361 5.226% 98.982% # ( 6600, 9900 ] 209 0.803% 99.785% ( 9900, 14000 ] 17 0.065% 99.850% ( 14000, 22000 ] 16 0.061% 99.912% ( 22000, 33000 ] 10 0.038% 99.950% ( 33000, 50000 ] 12 0.046% 99.996% ( 75000, 110000 ] 1 0.004% 100.000% ** DB Stats ** Uptime(secs): 15.0 total, 6.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 131.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.931 H:M:S, 46.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.752 H:M:S, 41.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/17-03:28:53 ... thread 0: (1000000,3000000) ops and (208399.4,153145.5) ops/second in (4.798478,19.589209) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.54 GB 12.6 1.5 0.0 1.5 4.4 2.8 0.0 1.5 59.4 168.5 26.53 14.85 41 0.647 1598K 1974 0.0 0.0 L1 6/6 553.87 MB 0.0 1.9 1.3 0.5 1.9 1.3 0.0 1.4 132.5 132.2 14.36 9.11 5 2.873 1931K 4108 0.0 0.0 L2 1/0 69.65 MB 0.7 0.4 0.2 0.2 0.4 0.2 0.6 2.3 122.7 122.4 3.34 1.93 2 1.671 416K 1100 0.0 0.0 L3 18/1 1.02 GB 1.0 5.3 3.0 2.4 5.3 2.9 0.1 1.8 111.3 110.3 49.11 25.60 22 2.232 3546K 3343 0.0 0.0 L4 175/2 9.86 GB 1.0 9.8 5.6 4.2 9.7 5.5 0.7 1.7 116.1 114.4 86.50 48.26 56 1.545 4751K 11K 0.0 0.0 L5 1156/0 95.11 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/16 108.13 GB 0.0 18.9 10.1 8.9 21.6 12.7 7.3 7.6 107.8 122.9 179.84 99.74 126 1.427 12M 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.9 10.1 8.9 21.6 12.7 7.3 7.6 107.8 122.9 179.84 99.74 126 1.427 12M 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.9 10.1 8.9 18.7 9.9 0.0 0.0 120.4 119.2 161.05 91.39 90 1.789 12M 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 154.2 18.79 8.36 36 0.522 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.7 total, 19.6 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.58 GB write, 1118.73 MB/s write, 18.94 GB read, 982.03 MB/s read, 179.8 seconds Interval compaction: 21.58 GB write, 1127.80 MB/s write, 18.94 GB read, 989.99 MB/s read, 179.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 79, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 776512 Average: 9.9497 StdDev: 162.40 Min: 1 Median: 1.8098 Max: 38143 Percentiles: P50: 1.81 P75: 2.74 P99: 10.85 P99.9: 1545.31 P99.99: 3557.12 ------------------------------------------------------ [ 0, 1 ] 43909 5.655% 5.655% # ( 1, 2 ] 425224 54.761% 60.415% ########### ( 2, 3 ] 152235 19.605% 80.020% #### ( 3, 4 ] 64826 8.348% 88.369% ## ( 4, 6 ] 68731 8.851% 97.220% ## ( 6, 10 ] 13326 1.716% 98.936% ( 10, 15 ] 2927 0.377% 99.313% ( 15, 22 ] 303 0.039% 99.352% ( 22, 34 ] 19 0.002% 99.355% ( 34, 51 ] 36 0.005% 99.359% ( 51, 76 ] 52 0.007% 99.366% ( 76, 110 ] 40 0.005% 99.371% ( 110, 170 ] 359 0.046% 99.417% ( 170, 250 ] 608 0.078% 99.496% ( 250, 380 ] 645 0.083% 99.579% ( 380, 580 ] 793 0.102% 99.681% ( 580, 870 ] 846 0.109% 99.790% ( 870, 1300 ] 687 0.088% 99.878% ( 1300, 1900 ] 417 0.054% 99.932% ( 1900, 2900 ] 331 0.043% 99.975% ( 2900, 4400 ] 277 0.036% 100.010% ( 4400, 6600 ] 100 0.013% 100.023% ( 6600, 9900 ] 20 0.003% 100.026% ( 9900, 14000 ] 7 0.001% 100.027% ( 14000, 22000 ] 14 0.002% 100.028% ( 22000, 33000 ] 3 0.000% 100.029% ( 33000, 50000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 324257 Average: 9.9808 StdDev: 168.63 Min: 1 Median: 1.8942 Max: 25350 Percentiles: P50: 1.89 P75: 2.89 P99: 10.49 P99.9: 1905.67 P99.99: 4591.79 ------------------------------------------------------ [ 0, 1 ] 10392 3.205% 3.205% # ( 1, 2 ] 169684 52.330% 55.535% ########## ( 2, 3 ] 71005 21.898% 77.433% #### ( 3, 4 ] 29791 9.187% 86.620% ## ( 4, 6 ] 33075 10.200% 96.820% ## ( 6, 10 ] 6907 2.130% 98.951% ( 10, 15 ] 1644 0.507% 99.458% ( 15, 22 ] 151 0.047% 99.504% ( 22, 34 ] 10 0.003% 99.507% ( 34, 51 ] 11 0.003% 99.511% ( 51, 76 ] 22 0.007% 99.517% ( 76, 110 ] 7 0.002% 99.520% ( 110, 170 ] 49 0.015% 99.535% ( 170, 250 ] 100 0.031% 99.565% ( 250, 380 ] 139 0.043% 99.608% ( 380, 580 ] 221 0.068% 99.676% ( 580, 870 ] 287 0.089% 99.765% ( 870, 1300 ] 270 0.083% 99.848% ( 1300, 1900 ] 167 0.052% 99.900% ( 1900, 2900 ] 131 0.040% 99.940% ( 2900, 4400 ] 158 0.049% 99.989% ( 4400, 6600 ] 41 0.013% 100.002% ( 6600, 9900 ] 11 0.003% 100.005% ( 9900, 14000 ] 5 0.002% 100.006% ( 14000, 22000 ] 2 0.001% 100.007% ( 22000, 33000 ] 4 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 605288 Average: 17.0998 StdDev: 206.77 Min: 1 Median: 1.9356 Max: 15710 Percentiles: P50: 1.94 P75: 2.99 P99: 13.12 P99.9: 2316.99 P99.99: 2928.00 ------------------------------------------------------ [ 0, 1 ] 20327 3.358% 3.358% # ( 1, 2 ] 301761 49.854% 53.212% ########## ( 2, 3 ] 133586 22.070% 75.282% #### ( 3, 4 ] 59922 9.900% 85.182% ## ( 4, 6 ] 64810 10.707% 95.889% ## ( 6, 10 ] 15813 2.612% 98.502% # ( 10, 15 ] 4830 0.798% 99.300% ( 15, 22 ] 685 0.113% 99.413% ( 22, 34 ] 61 0.010% 99.423% ( 34, 51 ] 24 0.004% 99.427% ( 51, 76 ] 18 0.003% 99.430% ( 76, 110 ] 14 0.002% 99.432% ( 110, 170 ] 18 0.003% 99.435% ( 170, 250 ] 49 0.008% 99.443% ( 250, 380 ] 148 0.024% 99.468% ( 380, 580 ] 285 0.047% 99.515% ( 580, 870 ] 463 0.076% 99.591% ( 870, 1300 ] 677 0.112% 99.703% ( 1300, 1900 ] 811 0.134% 99.837% ( 1900, 2900 ] 913 0.151% 99.988% ( 2900, 4400 ] 668 0.110% 100.098% ( 4400, 6600 ] 207 0.034% 100.132% ( 6600, 9900 ] 54 0.009% 100.141% ( 9900, 14000 ] 4 0.001% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1873650 Average: 13.6731 StdDev: 220.32 Min: 1 Median: 1.9422 Max: 44648 Percentiles: P50: 1.94 P75: 2.95 P99: 10.98 P99.9: 1359.94 P99.99: 2041.31 ------------------------------------------------------ [ 0, 1 ] 43512 2.322% 2.322% ( 1, 2 ] 948089 50.601% 52.923% ########## ( 2, 3 ] 436169 23.279% 76.203% ##### ( 3, 4 ] 180950 9.658% 85.860% ## ( 4, 6 ] 198364 10.587% 96.447% ## ( 6, 10 ] 45482 2.427% 98.875% ( 10, 15 ] 11956 0.638% 99.513% ( 15, 22 ] 1370 0.073% 99.586% ( 22, 34 ] 101 0.005% 99.591% ( 34, 51 ] 109 0.006% 99.597% ( 51, 76 ] 156 0.008% 99.605% ( 76, 110 ] 44 0.002% 99.608% ( 110, 170 ] 208 0.011% 99.619% ( 170, 250 ] 338 0.018% 99.637% ( 250, 380 ] 529 0.028% 99.665% ( 380, 580 ] 918 0.049% 99.714% ( 580, 870 ] 1523 0.081% 99.795% ( 870, 1300 ] 1798 0.096% 99.891% ( 1300, 1900 ] 1605 0.086% 99.977% ( 1900, 2900 ] 1710 0.091% 100.068% ( 2900, 4400 ] 1487 0.079% 100.148% ( 4400, 6600 ] 468 0.025% 100.173% ( 6600, 9900 ] 79 0.004% 100.177% ( 9900, 14000 ] 22 0.001% 100.178% ( 14000, 22000 ] 27 0.001% 100.180% ( 22000, 33000 ] 15 0.001% 100.180% ( 33000, 50000 ] 11 0.001% 100.181% ** Level 4 read latency histogram (micros): Count: 1119844 Average: 22.0344 StdDev: 253.90 Min: 1 Median: 1.9292 Max: 47421 Percentiles: P50: 1.93 P75: 2.95 P99: 372.52 P99.9: 2618.32 P99.99: 3536.04 ------------------------------------------------------ [ 0, 1 ] 28910 2.582% 2.582% # ( 1, 2 ] 571495 51.033% 53.615% ########## ( 2, 3 ] 251033 22.417% 76.032% #### ( 3, 4 ] 106844 9.541% 85.573% ## ( 4, 6 ] 112715 10.065% 95.638% ## ( 6, 10 ] 26502 2.367% 98.005% ( 10, 15 ] 6663 0.595% 98.600% ( 15, 22 ] 662 0.059% 98.659% ( 22, 34 ] 66 0.006% 98.665% ( 34, 51 ] 78 0.007% 98.672% ( 51, 76 ] 90 0.008% 98.680% ( 76, 110 ] 112 0.010% 98.690% ( 110, 170 ] 827 0.074% 98.763% ( 170, 250 ] 1347 0.120% 98.884% ( 250, 380 ] 1381 0.123% 99.007% ( 380, 580 ] 1842 0.164% 99.172% ( 580, 870 ] 2556 0.228% 99.400% ( 870, 1300 ] 2534 0.226% 99.626% ( 1300, 1900 ] 1920 0.171% 99.798% ( 1900, 2900 ] 1597 0.143% 99.940% ( 2900, 4400 ] 1316 0.118% 100.058% ( 4400, 6600 ] 440 0.039% 100.097% ( 6600, 9900 ] 70 0.006% 100.103% ( 9900, 14000 ] 13 0.001% 100.104% ( 14000, 22000 ] 25 0.002% 100.107% ( 22000, 33000 ] 11 0.001% 100.108% ( 33000, 50000 ] 3 0.000% 100.108% ** Level 5 read latency histogram (micros): Count: 49470 Average: 1161.3951 StdDev: 1628.48 Min: 80 Median: 677.0533 Max: 97852 Percentiles: P50: 677.05 P75: 1362.02 P99: 6328.95 P99.9: 17240.00 P99.99: 44408.42 ------------------------------------------------------ ( 76, 110 ] 377 0.762% 0.762% ( 110, 170 ] 4062 8.211% 8.973% ## ( 170, 250 ] 5429 10.974% 19.947% ## ( 250, 380 ] 5377 10.869% 30.817% ## ( 380, 580 ] 6896 13.940% 44.756% ### ( 580, 870 ] 7751 15.668% 60.424% ### ( 870, 1300 ] 6768 13.681% 74.106% ### ( 1300, 1900 ] 4281 8.654% 82.759% ## ( 1900, 2900 ] 3395 6.863% 89.622% # ( 2900, 4400 ] 3332 6.735% 96.357% # ( 4400, 6600 ] 1491 3.014% 99.371% # ( 6600, 9900 ] 232 0.469% 99.840% ( 9900, 14000 ] 19 0.038% 99.879% ( 14000, 22000 ] 26 0.053% 99.931% ( 22000, 33000 ] 21 0.042% 99.974% ( 33000, 50000 ] 12 0.024% 99.998% ( 75000, 110000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 19.7 total, 4.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 149.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.920 H:M:S, 40.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.989 H:M:S, 20.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-03:28:56 ... thread 0: (1000000,4000000) ops and (288012.0,173450.9) ops/second in (3.472078,23.061287) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.52 GB 88.1 2.3 0.0 2.3 6.0 3.7 0.0 1.6 71.5 189.3 32.60 20.42 59 0.552 2366K 2707 0.0 0.0 L1 6/6 553.87 MB 0.0 1.9 1.3 0.5 1.9 1.3 0.0 1.4 132.5 132.2 14.36 9.11 5 2.873 1931K 4108 0.0 0.0 L2 1/0 69.65 MB 0.7 0.4 0.2 0.2 0.4 0.2 0.6 2.3 122.7 122.4 3.34 1.93 2 1.671 416K 1100 0.0 0.0 L3 17/0 977.34 MB 1.0 5.3 3.0 2.4 5.3 2.9 0.1 1.8 111.3 110.3 49.11 25.60 22 2.232 3546K 3343 0.0 0.0 L4 172/0 9.55 GB 1.0 10.0 5.7 4.3 9.8 5.5 0.7 1.7 117.0 115.4 87.34 49.04 57 1.532 4934K 14K 0.0 0.0 L5 1160/0 95.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1372/17 109.11 GB 0.0 19.9 10.1 9.7 23.4 13.7 7.7 6.2 108.9 128.4 186.75 106.09 145 1.288 13M 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.9 10.1 9.7 23.4 13.7 7.7 6.2 108.9 128.4 186.75 106.09 145 1.288 13M 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.9 10.1 9.7 19.7 9.9 0.0 0.0 123.3 122.1 164.83 95.05 94 1.754 13M 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 175.3 21.92 11.04 51 0.430 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.2 total, 23.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.41 GB write, 1032.28 MB/s write, 19.85 GB read, 875.51 MB/s read, 186.7 seconds Interval compaction: 23.41 GB write, 1039.38 MB/s write, 19.85 GB read, 881.53 MB/s read, 186.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 79, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1155546 Average: 8.5188 StdDev: 134.82 Min: 1 Median: 1.6977 Max: 38143 Percentiles: P50: 1.70 P75: 2.45 P99: 13.81 P99.9: 1056.17 P99.99: 2500.73 ------------------------------------------------------ [ 0, 1 ] 110788 9.588% 9.588% ## ( 1, 2 ] 669298 57.920% 67.508% ############ ( 2, 3 ] 192617 16.669% 84.177% ### ( 3, 4 ] 76716 6.639% 90.816% # ( 4, 6 ] 76579 6.627% 97.443% # ( 6, 10 ] 15463 1.338% 98.781% ( 10, 15 ] 3323 0.288% 99.069% ( 15, 22 ] 357 0.031% 99.100% ( 22, 34 ] 23 0.002% 99.102% ( 34, 51 ] 37 0.003% 99.105% ( 51, 76 ] 56 0.005% 99.110% ( 76, 110 ] 235 0.020% 99.130% ( 110, 170 ] 2496 0.216% 99.346% ( 170, 250 ] 2462 0.213% 99.559% ( 250, 380 ] 1360 0.118% 99.677% ( 380, 580 ] 1250 0.108% 99.785% ( 580, 870 ] 1020 0.088% 99.873% ( 870, 1300 ] 724 0.063% 99.936% ( 1300, 1900 ] 427 0.037% 99.973% ( 1900, 2900 ] 337 0.029% 100.002% ( 2900, 4400 ] 280 0.024% 100.026% ( 4400, 6600 ] 101 0.009% 100.035% ( 6600, 9900 ] 20 0.002% 100.037% ( 9900, 14000 ] 7 0.001% 100.037% ( 14000, 22000 ] 14 0.001% 100.038% ( 22000, 33000 ] 3 0.000% 100.039% ( 33000, 50000 ] 1 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 342568 Average: 10.0566 StdDev: 164.54 Min: 1 Median: 1.8840 Max: 25350 Percentiles: P50: 1.88 P75: 2.88 P99: 12.32 P99.9: 1836.88 P99.99: 4493.54 ------------------------------------------------------ [ 0, 1 ] 11739 3.427% 3.427% # ( 1, 2 ] 180472 52.682% 56.109% ########### ( 2, 3 ] 73774 21.536% 77.644% #### ( 3, 4 ] 30970 9.041% 86.685% ## ( 4, 6 ] 34075 9.947% 96.632% ## ( 6, 10 ] 7306 2.133% 98.765% ( 10, 15 ] 1740 0.508% 99.273% ( 15, 22 ] 169 0.049% 99.322% ( 22, 34 ] 18 0.005% 99.327% ( 34, 51 ] 12 0.004% 99.331% ( 51, 76 ] 23 0.007% 99.337% ( 76, 110 ] 44 0.013% 99.350% ( 110, 170 ] 352 0.103% 99.453% ( 170, 250 ] 300 0.088% 99.541% ( 250, 380 ] 219 0.064% 99.604% ( 380, 580 ] 277 0.081% 99.685% ( 580, 870 ] 307 0.090% 99.775% ( 870, 1300 ] 279 0.081% 99.856% ( 1300, 1900 ] 167 0.049% 99.905% ( 1900, 2900 ] 131 0.038% 99.943% ( 2900, 4400 ] 158 0.046% 99.989% ( 4400, 6600 ] 41 0.012% 100.001% ( 6600, 9900 ] 11 0.003% 100.005% ( 9900, 14000 ] 5 0.001% 100.006% ( 14000, 22000 ] 2 0.001% 100.007% ( 22000, 33000 ] 4 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 605288 Average: 17.0998 StdDev: 206.77 Min: 1 Median: 1.9356 Max: 15710 Percentiles: P50: 1.94 P75: 2.99 P99: 13.12 P99.9: 2316.99 P99.99: 2928.00 ------------------------------------------------------ [ 0, 1 ] 20327 3.358% 3.358% # ( 1, 2 ] 301761 49.854% 53.212% ########## ( 2, 3 ] 133586 22.070% 75.282% #### ( 3, 4 ] 59922 9.900% 85.182% ## ( 4, 6 ] 64810 10.707% 95.889% ## ( 6, 10 ] 15813 2.612% 98.502% # ( 10, 15 ] 4830 0.798% 99.300% ( 15, 22 ] 685 0.113% 99.413% ( 22, 34 ] 61 0.010% 99.423% ( 34, 51 ] 24 0.004% 99.427% ( 51, 76 ] 18 0.003% 99.430% ( 76, 110 ] 14 0.002% 99.432% ( 110, 170 ] 18 0.003% 99.435% ( 170, 250 ] 49 0.008% 99.443% ( 250, 380 ] 148 0.024% 99.468% ( 380, 580 ] 285 0.047% 99.515% ( 580, 870 ] 463 0.076% 99.591% ( 870, 1300 ] 677 0.112% 99.703% ( 1300, 1900 ] 811 0.134% 99.837% ( 1900, 2900 ] 913 0.151% 99.988% ( 2900, 4400 ] 668 0.110% 100.098% ( 4400, 6600 ] 207 0.034% 100.132% ( 6600, 9900 ] 54 0.009% 100.141% ( 9900, 14000 ] 4 0.001% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1875575 Average: 13.7618 StdDev: 220.28 Min: 1 Median: 1.9426 Max: 44648 Percentiles: P50: 1.94 P75: 2.95 P99: 11.30 P99.9: 1359.19 P99.99: 2040.61 ------------------------------------------------------ [ 0, 1 ] 43586 2.324% 2.324% ( 1, 2 ] 948675 50.580% 52.904% ########## ( 2, 3 ] 436402 23.268% 76.172% ##### ( 3, 4 ] 181039 9.652% 85.824% ## ( 4, 6 ] 198498 10.583% 96.408% ## ( 6, 10 ] 45503 2.426% 98.834% ( 10, 15 ] 11958 0.638% 99.471% ( 15, 22 ] 1373 0.073% 99.545% ( 22, 34 ] 101 0.005% 99.550% ( 34, 51 ] 109 0.006% 99.556% ( 51, 76 ] 156 0.008% 99.564% ( 76, 110 ] 83 0.004% 99.569% ( 110, 170 ] 510 0.027% 99.596% ( 170, 250 ] 574 0.031% 99.626% ( 250, 380 ] 627 0.033% 99.660% ( 380, 580 ] 988 0.053% 99.712% ( 580, 870 ] 1549 0.083% 99.795% ( 870, 1300 ] 1810 0.097% 99.892% ( 1300, 1900 ] 1606 0.086% 99.977% ( 1900, 2900 ] 1710 0.091% 100.068% ( 2900, 4400 ] 1487 0.079% 100.148% ( 4400, 6600 ] 468 0.025% 100.173% ( 6600, 9900 ] 79 0.004% 100.177% ( 9900, 14000 ] 22 0.001% 100.178% ( 14000, 22000 ] 27 0.001% 100.179% ( 22000, 33000 ] 15 0.001% 100.180% ( 33000, 50000 ] 11 0.001% 100.181% ** Level 4 read latency histogram (micros): Count: 1132448 Average: 23.2263 StdDev: 253.38 Min: 1 Median: 1.9333 Max: 47421 Percentiles: P50: 1.93 P75: 2.97 P99: 438.03 P99.9: 2612.13 P99.99: 3535.26 ------------------------------------------------------ [ 0, 1 ] 29360 2.593% 2.593% # ( 1, 2 ] 575225 50.795% 53.387% ########## ( 2, 3 ] 251953 22.249% 75.636% #### ( 3, 4 ] 107091 9.457% 85.093% ## ( 4, 6 ] 112997 9.978% 95.071% ## ( 6, 10 ] 26621 2.351% 97.421% ( 10, 15 ] 6685 0.590% 98.012% ( 15, 22 ] 666 0.059% 98.071% ( 22, 34 ] 66 0.006% 98.076% ( 34, 51 ] 78 0.007% 98.083% ( 51, 76 ] 90 0.008% 98.091% ( 76, 110 ] 455 0.040% 98.131% ( 110, 170 ] 3529 0.312% 98.443% ( 170, 250 ] 3407 0.301% 98.744% ( 250, 380 ] 2192 0.194% 98.937% ( 380, 580 ] 2442 0.216% 99.153% ( 580, 870 ] 2804 0.248% 99.401% ( 870, 1300 ] 2587 0.228% 99.629% ( 1300, 1900 ] 1926 0.170% 99.799% ( 1900, 2900 ] 1603 0.142% 99.941% ( 2900, 4400 ] 1317 0.116% 100.057% ( 4400, 6600 ] 440 0.039% 100.096% ( 6600, 9900 ] 70 0.006% 100.102% ( 9900, 14000 ] 13 0.001% 100.103% ( 14000, 22000 ] 25 0.002% 100.105% ( 22000, 33000 ] 11 0.001% 100.106% ( 33000, 50000 ] 3 0.000% 100.107% ** Level 5 read latency histogram (micros): Count: 88196 Average: 753.8434 StdDev: 1308.25 Min: 80 Median: 317.7778 Max: 97852 Percentiles: P50: 317.78 P75: 800.78 P99: 5757.54 P99.9: 9769.19 P99.99: 38922.23 ------------------------------------------------------ ( 76, 110 ] 2239 2.539% 2.539% # ( 110, 170 ] 19715 22.354% 24.892% #### ( 170, 250 ] 16959 19.229% 44.121% #### ( 250, 380 ] 9945 11.276% 55.397% ## ( 380, 580 ] 10387 11.777% 67.174% ## ( 580, 870 ] 9066 10.279% 77.454% ## ( 870, 1300 ] 7014 7.953% 85.406% ## ( 1300, 1900 ] 4313 4.890% 90.297% # ( 1900, 2900 ] 3420 3.878% 94.174% # ( 2900, 4400 ] 3336 3.782% 97.957% # ( 4400, 6600 ] 1491 1.691% 99.647% ( 6600, 9900 ] 232 0.263% 99.910% ( 9900, 14000 ] 19 0.022% 99.932% ( 14000, 22000 ] 26 0.029% 99.961% ( 22000, 33000 ] 21 0.024% 99.985% ( 33000, 50000 ] 12 0.014% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% ** DB Stats ** Uptime(secs): 23.2 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 169.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.920 H:M:S, 34.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/17-03:29:01 ... thread 0: (1000000,5000000) ops and (232423.0,182723.2) ops/second in (4.302500,27.363787) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 3.50 GB 214.0 3.5 0.0 3.5 8.2 4.7 0.0 1.7 88.2 207.4 40.69 27.91 80 0.509 3645K 3928 0.0 0.0 L1 6/6 553.87 MB 0.0 1.9 1.3 0.5 1.9 1.3 0.0 1.4 132.5 132.2 14.36 9.11 5 2.873 1931K 4108 0.0 0.0 L2 1/0 69.65 MB 0.7 0.4 0.2 0.2 0.4 0.2 0.6 2.3 122.7 122.4 3.34 1.93 2 1.671 416K 1100 0.0 0.0 L3 17/0 977.34 MB 1.0 5.3 3.0 2.4 5.3 2.9 0.1 1.8 111.3 110.3 49.11 25.60 22 2.232 3546K 3343 0.0 0.0 L4 172/0 9.55 GB 1.0 10.0 5.7 4.3 9.8 5.5 0.7 1.7 117.0 115.4 87.34 49.04 57 1.532 4934K 14K 0.0 0.0 L5 1160/0 95.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1373/13 110.09 GB 0.0 21.1 10.1 10.9 25.6 14.7 7.7 5.4 110.8 134.7 194.84 113.58 166 1.174 14M 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 10.1 10.9 25.6 14.7 7.7 5.4 110.8 134.7 194.84 113.58 166 1.174 14M 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 10.1 10.9 20.9 9.9 0.0 0.0 127.2 126.0 169.72 99.82 99 1.714 14M 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 193.1 25.12 13.76 67 0.375 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.5 total, 27.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.62 GB write, 953.27 MB/s write, 21.08 GB read, 784.43 MB/s read, 194.8 seconds Interval compaction: 25.62 GB write, 958.80 MB/s write, 21.08 GB read, 788.98 MB/s read, 194.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 79, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1478541 Average: 9.9705 StdDev: 123.10 Min: 0 Median: 1.6506 Max: 38143 Percentiles: P50: 1.65 P75: 2.33 P99: 196.17 P99.9: 845.86 P99.99: 1882.31 ------------------------------------------------------ [ 0, 1 ] 184369 12.470% 12.470% ## ( 1, 2 ] 852917 57.686% 70.156% ############ ( 2, 3 ] 219339 14.835% 84.991% ### ( 3, 4 ] 86847 5.874% 90.865% # ( 4, 6 ] 84283 5.700% 96.565% # ( 6, 10 ] 16933 1.145% 97.710% ( 10, 15 ] 3661 0.248% 97.958% ( 15, 22 ] 408 0.028% 97.986% ( 22, 34 ] 30 0.002% 97.988% ( 34, 51 ] 38 0.003% 97.990% ( 51, 76 ] 60 0.004% 97.994% ( 76, 110 ] 957 0.065% 98.059% ( 110, 170 ] 10947 0.740% 98.799% ( 170, 250 ] 9067 0.613% 99.413% ( 250, 380 ] 3285 0.222% 99.635% ( 380, 580 ] 2550 0.172% 99.807% ( 580, 870 ] 1496 0.101% 99.908% ( 870, 1300 ] 783 0.053% 99.961% ( 1300, 1900 ] 436 0.029% 99.991% ( 1900, 2900 ] 359 0.024% 100.015% ( 2900, 4400 ] 289 0.020% 100.035% ( 4400, 6600 ] 101 0.007% 100.042% ( 6600, 9900 ] 20 0.001% 100.043% ( 9900, 14000 ] 7 0.000% 100.043% ( 14000, 22000 ] 14 0.001% 100.044% ( 22000, 33000 ] 3 0.000% 100.045% ( 33000, 50000 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 359076 Average: 10.2540 StdDev: 161.29 Min: 1 Median: 1.9021 Max: 25350 Percentiles: P50: 1.90 P75: 2.93 P99: 14.64 P99.9: 1789.01 P99.99: 4404.96 ------------------------------------------------------ [ 0, 1 ] 12252 3.412% 3.412% # ( 1, 2 ] 185441 51.644% 55.056% ########## ( 2, 3 ] 76861 21.405% 76.461% #### ( 3, 4 ] 33608 9.360% 85.821% ## ( 4, 6 ] 37338 10.398% 96.219% ## ( 6, 10 ] 8190 2.281% 98.500% ( 10, 15 ] 1933 0.538% 99.038% ( 15, 22 ] 282 0.079% 99.117% ( 22, 34 ] 40 0.011% 99.128% ( 34, 51 ] 12 0.003% 99.131% ( 51, 76 ] 23 0.006% 99.138% ( 76, 110 ] 79 0.022% 99.160% ( 110, 170 ] 746 0.208% 99.368% ( 170, 250 ] 548 0.153% 99.520% ( 250, 380 ] 298 0.083% 99.603% ( 380, 580 ] 333 0.093% 99.696% ( 580, 870 ] 316 0.088% 99.784% ( 870, 1300 ] 280 0.078% 99.862% ( 1300, 1900 ] 168 0.047% 99.909% ( 1900, 2900 ] 133 0.037% 99.946% ( 2900, 4400 ] 159 0.044% 99.990% ( 4400, 6600 ] 41 0.011% 100.001% ( 6600, 9900 ] 11 0.003% 100.004% ( 9900, 14000 ] 5 0.001% 100.006% ( 14000, 22000 ] 2 0.001% 100.006% ( 22000, 33000 ] 4 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 605288 Average: 17.0998 StdDev: 206.77 Min: 1 Median: 1.9356 Max: 15710 Percentiles: P50: 1.94 P75: 2.99 P99: 13.12 P99.9: 2316.99 P99.99: 2928.00 ------------------------------------------------------ [ 0, 1 ] 20327 3.358% 3.358% # ( 1, 2 ] 301761 49.854% 53.212% ########## ( 2, 3 ] 133586 22.070% 75.282% #### ( 3, 4 ] 59922 9.900% 85.182% ## ( 4, 6 ] 64810 10.707% 95.889% ## ( 6, 10 ] 15813 2.612% 98.502% # ( 10, 15 ] 4830 0.798% 99.300% ( 15, 22 ] 685 0.113% 99.413% ( 22, 34 ] 61 0.010% 99.423% ( 34, 51 ] 24 0.004% 99.427% ( 51, 76 ] 18 0.003% 99.430% ( 76, 110 ] 14 0.002% 99.432% ( 110, 170 ] 18 0.003% 99.435% ( 170, 250 ] 49 0.008% 99.443% ( 250, 380 ] 148 0.024% 99.468% ( 380, 580 ] 285 0.047% 99.515% ( 580, 870 ] 463 0.076% 99.591% ( 870, 1300 ] 677 0.112% 99.703% ( 1300, 1900 ] 811 0.134% 99.837% ( 1900, 2900 ] 913 0.151% 99.988% ( 2900, 4400 ] 668 0.110% 100.098% ( 4400, 6600 ] 207 0.034% 100.132% ( 6600, 9900 ] 54 0.009% 100.141% ( 9900, 14000 ] 4 0.001% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1877139 Average: 13.9045 StdDev: 220.29 Min: 1 Median: 1.9434 Max: 44648 Percentiles: P50: 1.94 P75: 2.95 P99: 11.87 P99.9: 1359.28 P99.99: 2040.52 ------------------------------------------------------ [ 0, 1 ] 43586 2.322% 2.322% ( 1, 2 ] 948685 50.539% 52.861% ########## ( 2, 3 ] 436444 23.250% 76.111% ##### ( 3, 4 ] 181087 9.647% 85.758% ## ( 4, 6 ] 198579 10.579% 96.337% ## ( 6, 10 ] 45516 2.425% 98.762% ( 10, 15 ] 11959 0.637% 99.399% ( 15, 22 ] 1373 0.073% 99.472% ( 22, 34 ] 101 0.005% 99.477% ( 34, 51 ] 109 0.006% 99.483% ( 51, 76 ] 156 0.008% 99.492% ( 76, 110 ] 134 0.007% 99.499% ( 110, 170 ] 1144 0.061% 99.560% ( 170, 250 ] 1012 0.054% 99.614% ( 250, 380 ] 746 0.040% 99.653% ( 380, 580 ] 1079 0.057% 99.711% ( 580, 870 ] 1580 0.084% 99.795% ( 870, 1300 ] 1813 0.097% 99.892% ( 1300, 1900 ] 1608 0.086% 99.977% ( 1900, 2900 ] 1710 0.091% 100.068% ( 2900, 4400 ] 1487 0.079% 100.148% ( 4400, 6600 ] 468 0.025% 100.172% ( 6600, 9900 ] 79 0.004% 100.177% ( 9900, 14000 ] 22 0.001% 100.178% ( 14000, 22000 ] 27 0.001% 100.179% ( 22000, 33000 ] 15 0.001% 100.180% ( 33000, 50000 ] 11 0.001% 100.181% ** Level 4 read latency histogram (micros): Count: 1141769 Average: 24.7306 StdDev: 253.23 Min: 1 Median: 1.9414 Max: 47421 Percentiles: P50: 1.94 P75: 3.00 P99: 474.84 P99.9: 2608.58 P99.99: 3534.85 ------------------------------------------------------ [ 0, 1 ] 29360 2.571% 2.571% # ( 1, 2 ] 575235 50.381% 52.952% ########## ( 2, 3 ] 252004 22.071% 75.024% #### ( 3, 4 ] 107122 9.382% 84.406% ## ( 4, 6 ] 113099 9.906% 94.312% ## ( 6, 10 ] 26635 2.333% 96.644% ( 10, 15 ] 6687 0.586% 97.230% ( 15, 22 ] 666 0.058% 97.288% ( 22, 34 ] 66 0.006% 97.294% ( 34, 51 ] 78 0.007% 97.301% ( 51, 76 ] 90 0.008% 97.309% ( 76, 110 ] 797 0.070% 97.379% ( 110, 170 ] 7699 0.674% 98.053% ( 170, 250 ] 6321 0.554% 98.607% ( 250, 380 ] 3047 0.267% 98.873% ( 380, 580 ] 3048 0.267% 99.140% ( 580, 870 ] 2988 0.262% 99.402% ( 870, 1300 ] 2614 0.229% 99.631% ( 1300, 1900 ] 1929 0.169% 99.800% ( 1900, 2900 ] 1612 0.141% 99.941% ( 2900, 4400 ] 1318 0.115% 100.057% ( 4400, 6600 ] 440 0.039% 100.095% ( 6600, 9900 ] 70 0.006% 100.101% ( 9900, 14000 ] 13 0.001% 100.102% ( 14000, 22000 ] 25 0.002% 100.105% ( 22000, 33000 ] 11 0.001% 100.106% ( 33000, 50000 ] 3 0.000% 100.106% ** Level 5 read latency histogram (micros): Count: 137721 Average: 558.8659 StdDev: 1081.92 Min: 80 Median: 224.5967 Max: 97852 Percentiles: P50: 224.60 P75: 518.22 P99: 5026.79 P99.9: 9064.74 P99.99: 32595.57 ------------------------------------------------------ ( 76, 110 ] 4278 3.106% 3.106% # ( 110, 170 ] 42103 30.571% 33.678% ###### ( 170, 250 ] 32939 23.917% 57.595% ##### ( 250, 380 ] 14545 10.561% 68.156% ## ( 380, 580 ] 13639 9.903% 78.059% ## ( 580, 870 ] 10145 7.366% 85.426% # ( 870, 1300 ] 7157 5.197% 90.622% # ( 1300, 1900 ] 4330 3.144% 93.766% # ( 1900, 2900 ] 3441 2.499% 96.265% ( 2900, 4400 ] 3342 2.427% 98.692% ( 4400, 6600 ] 1491 1.083% 99.774% ( 6600, 9900 ] 232 0.168% 99.943% ( 9900, 14000 ] 19 0.014% 99.956% ( 14000, 22000 ] 26 0.019% 99.975% ( 22000, 33000 ] 21 0.015% 99.991% ( 33000, 50000 ] 12 0.009% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% ** DB Stats ** Uptime(secs): 27.5 total, 4.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 178.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.674 H:M:S, 31.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 228.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.754 H:M:S, 17.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-03:29:17 ... thread 0: (1000000,6000000) ops and (61388.5,137446.1) ops/second in (16.289687,43.653474) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 4.48 GB 313.6 6.0 0.0 6.0 11.7 5.7 0.0 2.1 115.0 223.9 53.66 40.24 101 0.531 6267K 15K 0.0 0.0 L1 6/6 553.87 MB 0.0 1.9 1.3 0.5 1.9 1.3 0.0 1.4 132.5 132.2 14.36 9.11 5 2.873 1931K 4108 0.0 0.0 L2 1/0 69.65 MB 0.7 0.4 0.2 0.2 0.4 0.2 0.6 2.3 122.7 122.4 3.34 1.93 2 1.671 416K 1100 0.0 0.0 L3 17/0 977.34 MB 1.0 5.3 3.0 2.4 5.3 2.9 0.1 1.8 111.3 110.3 49.11 25.60 22 2.232 3546K 3343 0.0 0.0 L4 172/0 9.55 GB 1.0 10.0 5.7 4.3 9.8 5.5 0.7 1.7 117.0 115.4 87.34 49.04 57 1.532 4934K 14K 0.0 0.0 L5 1160/0 95.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/13 111.07 GB 0.0 23.6 10.1 13.5 29.1 15.6 7.7 5.1 116.3 143.5 207.81 125.91 187 1.111 17M 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.6 10.1 13.5 29.1 15.6 7.7 5.1 116.3 143.5 207.81 125.91 187 1.111 17M 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.6 10.1 13.5 23.4 9.9 0.0 0.0 134.7 133.5 179.45 109.41 104 1.726 17M 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 206.6 28.36 16.50 83 0.342 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.8 total, 43.7 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.12 GB write, 680.51 MB/s write, 23.61 GB read, 551.70 MB/s read, 207.8 seconds Interval compaction: 29.12 GB write, 682.98 MB/s write, 23.61 GB read, 553.71 MB/s read, 207.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 79, interval: 94 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2268276 Average: 15.7568 StdDev: 108.98 Min: 0 Median: 1.5928 Max: 38143 Percentiles: P50: 1.59 P75: 2.22 P99: 240.11 P99.9: 721.74 P99.99: 1296.65 ------------------------------------------------------ [ 0, 1 ] 393528 17.349% 17.349% ### ( 1, 2 ] 1249390 55.081% 72.430% ########### ( 2, 3 ] 262487 11.572% 84.002% ## ( 3, 4 ] 103393 4.558% 88.561% # ( 4, 6 ] 96746 4.265% 92.826% # ( 6, 10 ] 18742 0.826% 93.652% ( 10, 15 ] 4115 0.181% 93.833% ( 15, 22 ] 472 0.021% 93.854% ( 22, 34 ] 35 0.002% 93.856% ( 34, 51 ] 40 0.002% 93.858% ( 51, 76 ] 64 0.003% 93.860% ( 76, 110 ] 6701 0.295% 94.156% ( 110, 170 ] 73051 3.221% 97.376% # ( 170, 250 ] 42027 1.853% 99.229% ( 250, 380 ] 8422 0.371% 99.600% ( 380, 580 ] 5674 0.250% 99.851% ( 580, 870 ] 2293 0.101% 99.952% ( 870, 1300 ] 876 0.039% 99.990% ( 1300, 1900 ] 466 0.021% 100.011% ( 1900, 2900 ] 399 0.018% 100.028% ( 2900, 4400 ] 319 0.014% 100.042% ( 4400, 6600 ] 104 0.005% 100.047% ( 6600, 9900 ] 20 0.001% 100.048% ( 9900, 14000 ] 7 0.000% 100.048% ( 14000, 22000 ] 14 0.001% 100.049% ( 22000, 33000 ] 3 0.000% 100.049% ( 33000, 50000 ] 1 0.000% 100.049% ** Level 1 read latency histogram (micros): Count: 403646 Average: 11.1576 StdDev: 153.19 Min: 1 Median: 1.9831 Max: 25350 Percentiles: P50: 1.98 P75: 3.19 P99: 161.29 P99.9: 1626.26 P99.99: 4349.39 ------------------------------------------------------ [ 0, 1 ] 12420 3.077% 3.077% # ( 1, 2 ] 192655 47.729% 50.806% ########## ( 2, 3 ] 89367 22.140% 72.946% #### ( 3, 4 ] 42726 10.585% 83.531% ## ( 4, 6 ] 46827 11.601% 95.132% ## ( 6, 10 ] 9505 2.355% 97.486% ( 10, 15 ] 2540 0.629% 98.116% ( 15, 22 ] 613 0.152% 98.268% ( 22, 34 ] 76 0.019% 98.286% ( 34, 51 ] 13 0.003% 98.290% ( 51, 76 ] 24 0.006% 98.296% ( 76, 110 ] 326 0.081% 98.376% ( 110, 170 ] 2945 0.730% 99.106% ( 170, 250 ] 1583 0.392% 99.498% ( 250, 380 ] 480 0.119% 99.617% ( 380, 580 ] 418 0.104% 99.721% ( 580, 870 ] 347 0.086% 99.807% ( 870, 1300 ] 286 0.071% 99.877% ( 1300, 1900 ] 168 0.042% 99.919% ( 1900, 2900 ] 133 0.033% 99.952% ( 2900, 4400 ] 159 0.039% 99.991% ( 4400, 6600 ] 41 0.010% 100.001% ( 6600, 9900 ] 11 0.003% 100.004% ( 9900, 14000 ] 5 0.001% 100.005% ( 14000, 22000 ] 2 0.000% 100.006% ( 22000, 33000 ] 4 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 605288 Average: 17.0998 StdDev: 206.77 Min: 1 Median: 1.9356 Max: 15710 Percentiles: P50: 1.94 P75: 2.99 P99: 13.12 P99.9: 2316.99 P99.99: 2928.00 ------------------------------------------------------ [ 0, 1 ] 20327 3.358% 3.358% # ( 1, 2 ] 301761 49.854% 53.212% ########## ( 2, 3 ] 133586 22.070% 75.282% #### ( 3, 4 ] 59922 9.900% 85.182% ## ( 4, 6 ] 64810 10.707% 95.889% ## ( 6, 10 ] 15813 2.612% 98.502% # ( 10, 15 ] 4830 0.798% 99.300% ( 15, 22 ] 685 0.113% 99.413% ( 22, 34 ] 61 0.010% 99.423% ( 34, 51 ] 24 0.004% 99.427% ( 51, 76 ] 18 0.003% 99.430% ( 76, 110 ] 14 0.002% 99.432% ( 110, 170 ] 18 0.003% 99.435% ( 170, 250 ] 49 0.008% 99.443% ( 250, 380 ] 148 0.024% 99.468% ( 380, 580 ] 285 0.047% 99.515% ( 580, 870 ] 463 0.076% 99.591% ( 870, 1300 ] 677 0.112% 99.703% ( 1300, 1900 ] 811 0.134% 99.837% ( 1900, 2900 ] 913 0.151% 99.988% ( 2900, 4400 ] 668 0.110% 100.098% ( 4400, 6600 ] 207 0.034% 100.132% ( 6600, 9900 ] 54 0.009% 100.141% ( 9900, 14000 ] 4 0.001% 100.142% ( 14000, 22000 ] 1 0.000% 100.142% ** Level 3 read latency histogram (micros): Count: 1884030 Average: 14.4927 StdDev: 220.16 Min: 1 Median: 1.9470 Max: 44648 Percentiles: P50: 1.95 P75: 2.96 P99: 14.72 P99.9: 1357.72 P99.99: 2040.12 ------------------------------------------------------ [ 0, 1 ] 43586 2.313% 2.313% ( 1, 2 ] 948685 50.354% 52.667% ########## ( 2, 3 ] 436444 23.165% 75.833% ##### ( 3, 4 ] 181087 9.612% 85.445% ## ( 4, 6 ] 198579 10.540% 95.985% ## ( 6, 10 ] 45516 2.416% 98.401% ( 10, 15 ] 11959 0.635% 99.035% ( 15, 22 ] 1373 0.073% 99.108% ( 22, 34 ] 101 0.005% 99.114% ( 34, 51 ] 109 0.006% 99.119% ( 51, 76 ] 156 0.008% 99.128% ( 76, 110 ] 544 0.029% 99.157% ( 110, 170 ] 5156 0.274% 99.430% ( 170, 250 ] 2934 0.156% 99.586% ( 250, 380 ] 1050 0.056% 99.642% ( 380, 580 ] 1272 0.068% 99.709% ( 580, 870 ] 1625 0.086% 99.795% ( 870, 1300 ] 1815 0.096% 99.892% ( 1300, 1900 ] 1611 0.086% 99.977% ( 1900, 2900 ] 1710 0.091% 100.068% ( 2900, 4400 ] 1487 0.079% 100.147% ( 4400, 6600 ] 468 0.025% 100.172% ( 6600, 9900 ] 79 0.004% 100.176% ( 9900, 14000 ] 22 0.001% 100.177% ( 14000, 22000 ] 27 0.001% 100.179% ( 22000, 33000 ] 15 0.001% 100.179% ( 33000, 50000 ] 11 0.001% 100.180% ** Level 4 read latency histogram (micros): Count: 1184206 Average: 30.1180 StdDev: 250.82 Min: 1 Median: 1.9783 Max: 47421 Percentiles: P50: 1.98 P75: 3.29 P99: 498.63 P99.9: 2584.28 P99.99: 3531.34 ------------------------------------------------------ [ 0, 1 ] 29360 2.479% 2.479% ( 1, 2 ] 575235 48.576% 51.055% ########## ( 2, 3 ] 252006 21.281% 72.335% #### ( 3, 4 ] 107123 9.046% 81.381% ## ( 4, 6 ] 113107 9.551% 90.933% ## ( 6, 10 ] 26636 2.249% 93.182% ( 10, 15 ] 6687 0.565% 93.747% ( 15, 22 ] 666 0.056% 93.803% ( 22, 34 ] 66 0.006% 93.809% ( 34, 51 ] 78 0.007% 93.815% ( 51, 76 ] 90 0.008% 93.823% ( 76, 110 ] 3272 0.276% 94.099% ( 110, 170 ] 32262 2.724% 96.823% # ( 170, 250 ] 18432 1.556% 98.380% ( 250, 380 ] 4875 0.412% 98.792% ( 380, 580 ] 4164 0.352% 99.143% ( 580, 870 ] 3261 0.275% 99.419% ( 870, 1300 ] 2660 0.225% 99.643% ( 1300, 1900 ] 1937 0.164% 99.807% ( 1900, 2900 ] 1616 0.136% 99.943% ( 2900, 4400 ] 1320 0.111% 100.055% ( 4400, 6600 ] 440 0.037% 100.092% ( 6600, 9900 ] 70 0.006% 100.098% ( 9900, 14000 ] 13 0.001% 100.099% ( 14000, 22000 ] 25 0.002% 100.101% ( 22000, 33000 ] 11 0.001% 100.102% ( 33000, 50000 ] 3 0.000% 100.102% ** Level 5 read latency histogram (micros): Count: 359753 Average: 322.0102 StdDev: 698.64 Min: 79 Median: 167.0854 Max: 97852 Percentiles: P50: 167.09 P75: 238.02 P99: 3595.58 P99.9: 6525.16 P99.99: 20776.83 ------------------------------------------------------ ( 76, 110 ] 17286 4.805% 4.805% # ( 110, 170 ] 170892 47.503% 52.308% ########## ( 170, 250 ] 96016 26.689% 78.997% ##### ( 250, 380 ] 23945 6.656% 85.653% # ( 380, 580 ] 19563 5.438% 91.091% # ( 580, 870 ] 11687 3.249% 94.339% # ( 870, 1300 ] 7370 2.049% 96.388% ( 1300, 1900 ] 4367 1.214% 97.602% ( 1900, 2900 ] 3476 0.966% 98.568% ( 2900, 4400 ] 3350 0.931% 99.499% ( 4400, 6600 ] 1492 0.415% 99.914% ( 6600, 9900 ] 232 0.064% 99.979% ( 9900, 14000 ] 19 0.005% 99.984% ( 14000, 22000 ] 26 0.007% 99.991% ( 22000, 33000 ] 21 0.006% 99.997% ( 33000, 50000 ] 12 0.003% 100.000% ( 75000, 110000 ] 1 0.000% 100.001% ** DB Stats ** Uptime(secs): 43.8 total, 16.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 134.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.150 H:M:S, 48.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 60.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.476 H:M:S, 76.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 316.540 micros/op 12626 ops/sec 60.113 seconds 758996 operations; 12.2 MB/s (186999 of 186999 found) Microseconds per read: Count: 758996 Average: 316.5426 StdDev: 1044.18 Min: 2 Median: 207.9616 Max: 158788 Percentiles: P50: 207.96 P75: 262.58 P99: 2170.55 P99.9: 17750.72 P99.99: 35194.67 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 29 0.004% 0.005% ( 3, 4 ] 45 0.006% 0.011% ( 4, 6 ] 80 0.011% 0.021% ( 6, 10 ] 210 0.028% 0.049% ( 10, 15 ] 1732 0.228% 0.277% ( 15, 22 ] 2095 0.276% 0.553% ( 22, 34 ] 4457 0.587% 1.140% ( 34, 51 ] 1666 0.220% 1.360% ( 51, 76 ] 263 0.035% 1.394% ( 76, 110 ] 1822 0.240% 1.634% ( 110, 170 ] 204683 26.968% 28.602% ##### ( 170, 250 ] 342262 45.094% 73.696% ######### ( 250, 380 ] 102270 13.474% 87.170% ### ( 380, 580 ] 52979 6.980% 94.151% # ( 580, 870 ] 21068 2.776% 96.926% # ( 870, 1300 ] 10073 1.327% 98.253% ( 1300, 1900 ] 4790 0.631% 98.885% ( 1900, 2900 ] 3238 0.427% 99.311% ( 2900, 4400 ] 2737 0.361% 99.672% ( 4400, 6600 ] 974 0.128% 99.800% ( 6600, 9900 ] 192 0.025% 99.825% ( 9900, 14000 ] 220 0.029% 99.854% ( 14000, 22000 ] 738 0.097% 99.952% ( 22000, 33000 ] 284 0.037% 99.989% ( 33000, 50000 ] 55 0.007% 99.996% ( 50000, 75000 ] 18 0.002% 99.999% ( 75000, 110000 ] 7 0.001% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13643333 rocksdb.bloom.filter.full.positive COUNT : 892029 rocksdb.bloom.filter.full.true.positive COUNT : 758628 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 368 rocksdb.memtable.miss COUNT : 758628 rocksdb.l0.hit COUNT : 30351 rocksdb.l1.hit COUNT : 3928 rocksdb.l2andup.hit COUNT : 724349 rocksdb.compaction.key.drop.new COUNT : 233529 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6087078 rocksdb.number.keys.read COUNT : 758996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6281864496 rocksdb.bytes.read COUNT : 758996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1718 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36652038 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27322234463 rocksdb.compact.write.bytes COUNT : 27083837074 rocksdb.flush.write.bytes COUNT : 6275430701 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 21 rocksdb.number.superversion_acquires COUNT : 1221 rocksdb.number.superversion_releases COUNT : 1201 rocksdb.number.superversion_cleanups COUNT : 311 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 285 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6224818176 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2408448 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30501592818 rocksdb.non.last.level.read.count COUNT : 7227630 rocksdb.block.checksum.compute.count COUNT : 7520560 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 207.178242 P95 : 667.183991 P99 : 2169.848719 P100 : 158786.000000 COUNT : 758996 SUM : 239613510 rocksdb.db.write.micros P50 : 1.555933 P95 : 4.365110 P99 : 9.023985 P100 : 1055497.000000 COUNT : 6087078 SUM : 52105162 rocksdb.compaction.times.micros P50 : 1530555.555556 P95 : 3660000.000000 P99 : 5356000.000000 P100 : 6241224.000000 COUNT : 104 SUM : 179452915 rocksdb.compaction.times.cpu_micros P50 : 945000.000000 P95 : 1830000.000000 P99 : 4244000.000000 P100 : 5802231.000000 COUNT : 104 SUM : 109414871 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1033.400000 P95 : 21750.000000 P99 : 80250.000000 P100 : 83965.000000 COUNT : 85 SUM : 524865 rocksdb.compaction.outfile.sync.micros P50 : 12819.696970 P95 : 174000.000000 P99 : 463916.666667 P100 : 566305.000000 COUNT : 335 SUM : 14658234 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 430.000000 P95 : 4261.250000 P99 : 6069.555556 P100 : 6314.000000 COUNT : 217 SUM : 240100 rocksdb.table.open.io.micros P50 : 11342.447419 P95 : 21436.402570 P99 : 30565.652174 P100 : 141389.000000 COUNT : 1718 SUM : 18966095 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.965939 P95 : 9.958909 P99 : 205.856955 P100 : 44653.000000 COUNT : 6617315 SUM : 108404503 rocksdb.read.block.get.micros P50 : 158.414003 P95 : 533.039003 P99 : 2088.017287 P100 : 97939.000000 COUNT : 901515 SUM : 207188099 rocksdb.write.raw.block.micros P50 : 0.528284 P95 : 1.105093 P99 : 3.487474 P100 : 80300.000000 COUNT : 8079766 SUM : 27336071 rocksdb.numfiles.in.singlecompaction P50 : 2.897727 P95 : 4.783333 P99 : 9.340000 P100 : 13.000000 COUNT : 133 SUM : 455 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569855 P95 : 1189.048836 P99 : 2500.872131 P100 : 1055343.000000 COUNT : 184601 SUM : 36668624 rocksdb.sst.read.micros P50 : 1.947316 P95 : 184.929265 P99 : 520.607768 P100 : 97852.000000 COUNT : 7227646 SUM : 298369909 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 758996 SUM : 758996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6087078 SUM : 6281864496 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 229649.122807 P95 : 979000.000000 P99 : 1279697.000000 P100 : 1279697.000000 COUNT : 85 SUM : 28838993 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 350 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0