[2024-07-15 11:21:00.264455] Starting SPDK v24.09-pre git sha1 e7cce062d / DPDK 24.03.0 initialization... [2024-07-15 11:21:00.264754] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid29707 ] Set seed to 1721035260258047 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 11:21:00.378368] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 11:21:00.598653] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 11:21:00.598705] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 29707' to capture a snapshot of events at runtime. [2024-07-15 11:21:00.598715] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 11:21:00.598725] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 11:21:00.598733] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid29707 for offline analysis/debug. [2024-07-15 11:21:00.598819] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 11:21:06 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-11:21:09 ... thread 0: (1000000,1000000) ops and (339795.6,339795.6) ops/second in (2.942946,2.942946) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 503.14 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.5 2.51 2.26 12 0.209 0 0 0.0 0.0 L1 2/0 239.65 MB 24.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 263.0 262.0 0.96 0.93 1 0.956 255K 975 0.0 0.0 L2 1/0 50.45 MB 0.5 0.3 0.1 0.2 0.3 0.1 0.0 2.3 248.9 248.1 1.24 1.19 3 0.414 314K 969 0.0 0.0 L3 18/0 939.04 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 220.5 220.5 0.54 0.50 1 0.545 121K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 252/5 20.09 GB 0.0 0.7 0.5 0.2 1.5 1.4 0.2 1.8 129.6 296.7 5.26 4.88 17 0.309 691K 1944 0.0 0.0 Int 0/0 0.00 KB 0.0 0.7 0.5 0.2 1.5 1.4 0.1 1.8 129.6 296.7 5.26 4.88 17 0.309 691K 1944 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.7 0.5 0.2 0.7 0.5 0.0 0.0 248.2 247.5 2.74 2.62 5 0.549 691K 1944 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.5 2.51 2.26 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.9 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.52 GB write, 515.88 MB/s write, 0.66 GB read, 225.25 MB/s read, 5.3 seconds Interval compaction: 1.52 GB write, 529.52 MB/s write, 0.66 GB read, 231.21 MB/s read, 5.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 140603 Average: 1.9975 StdDev: 12.23 Min: 0 Median: 1.3534 Max: 3408 Percentiles: P50: 1.35 P75: 1.75 P99: 5.27 P99.9: 9.84 P99.99: 50.66 ------------------------------------------------------ [ 0, 1 ] 39331 27.973% 27.973% ###### ( 1, 2 ] 87644 62.334% 90.307% ############ ( 2, 3 ] 7817 5.560% 95.867% # ( 3, 4 ] 3273 2.328% 98.195% ( 4, 6 ] 1790 1.273% 99.468% ( 6, 10 ] 634 0.451% 99.919% ( 10, 15 ] 87 0.062% 99.981% ( 15, 22 ] 9 0.006% 99.987% ( 22, 34 ] 3 0.002% 99.989% ( 34, 51 ] 3 0.002% 99.991% ( 51, 76 ] 5 0.004% 99.995% ( 110, 170 ] 5 0.004% 99.999% ( 170, 250 ] 5 0.004% 100.002% ( 250, 380 ] 3 0.002% 100.004% ( 380, 580 ] 6 0.004% 100.009% ( 580, 870 ] 1 0.001% 100.009% ( 870, 1300 ] 2 0.001% 100.011% ( 1900, 2900 ] 1 0.001% 100.011% ( 2900, 4400 ] 1 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 11618 Average: 3.8505 StdDev: 44.46 Min: 1 Median: 1.3412 Max: 2859 Percentiles: P50: 1.34 P75: 1.77 P99: 9.90 P99.9: 405.47 P99.99: 2319.10 ------------------------------------------------------ [ 0, 1 ] 3489 30.031% 30.031% ###### ( 1, 2 ] 6800 58.530% 88.561% ############ ( 2, 3 ] 541 4.657% 93.217% # ( 3, 4 ] 338 2.909% 96.127% # ( 4, 6 ] 207 1.782% 97.908% ( 6, 10 ] 130 1.119% 99.027% ( 10, 15 ] 36 0.310% 99.337% ( 15, 22 ] 3 0.026% 99.363% ( 22, 34 ] 1 0.009% 99.372% ( 34, 51 ] 2 0.017% 99.389% ( 51, 76 ] 26 0.224% 99.613% ( 76, 110 ] 5 0.043% 99.656% ( 110, 170 ] 1 0.009% 99.664% ( 170, 250 ] 16 0.138% 99.802% ( 250, 380 ] 11 0.095% 99.897% ( 380, 580 ] 3 0.026% 99.923% ( 580, 870 ] 4 0.034% 99.957% ( 870, 1300 ] 2 0.017% 99.974% ( 1300, 1900 ] 1 0.009% 99.983% ( 1900, 2900 ] 2 0.017% 100.000% ** Level 2 read latency histogram (micros): Count: 65485 Average: 2.1831 StdDev: 6.88 Min: 1 Median: 1.4819 Max: 1107 Percentiles: P50: 1.48 P75: 1.87 P99: 5.88 P99.9: 11.68 P99.99: 17.40 ------------------------------------------------------ [ 0, 1 ] 12533 19.139% 19.139% #### ( 1, 2 ] 41934 64.036% 83.175% ############# ( 2, 3 ] 6413 9.793% 92.968% ## ( 3, 4 ] 2402 3.668% 96.636% # ( 4, 6 ] 1650 2.520% 99.156% # ( 6, 10 ] 460 0.702% 99.858% ( 10, 15 ] 82 0.125% 99.983% ( 15, 22 ] 13 0.020% 100.003% ( 22, 34 ] 1 0.002% 100.005% ( 76, 110 ] 1 0.002% 100.006% ( 110, 170 ] 3 0.005% 100.011% ( 250, 380 ] 3 0.005% 100.015% ( 580, 870 ] 1 0.002% 100.017% ( 870, 1300 ] 2 0.003% 100.020% ** Level 3 read latency histogram (micros): Count: 90 Average: 1363.8111 StdDev: 1841.80 Min: 0 Median: 250.0000 Max: 6848 Percentiles: P50: 250.00 P75: 2364.29 P99: 6848.00 P99.9: 6848.00 P99.99: 6848.00 ------------------------------------------------------ [ 0, 1 ] 19 21.111% 21.111% #### ( 1, 2 ] 6 6.667% 27.778% # ( 4, 6 ] 3 3.333% 31.111% # ( 6, 10 ] 4 4.444% 35.556% # ( 10, 15 ] 6 6.667% 42.222% # ( 51, 76 ] 1 1.111% 43.333% ( 76, 110 ] 1 1.111% 44.444% ( 110, 170 ] 1 1.111% 45.556% ( 170, 250 ] 4 4.444% 50.000% # ( 250, 380 ] 2 2.222% 52.222% ( 380, 580 ] 3 3.333% 55.556% # ( 580, 870 ] 4 4.444% 60.000% # ( 870, 1300 ] 2 2.222% 62.222% ( 1300, 1900 ] 5 5.556% 67.778% # ( 1900, 2900 ] 14 15.556% 83.333% ### ( 2900, 4400 ] 6 6.667% 90.000% # ( 4400, 6600 ] 8 8.889% 98.889% ## ( 6600, 9900 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 2808.5600 StdDev: 2049.60 Min: 113 Median: 2775.0000 Max: 7553 Percentiles: P50: 2775.00 P75: 3978.12 P99: 7553.00 P99.9: 7553.00 P99.99: 7553.00 ------------------------------------------------------ ( 110, 170 ] 1 4.000% 4.000% # ( 250, 380 ] 2 8.000% 12.000% ## ( 380, 580 ] 2 8.000% 20.000% ## ( 870, 1300 ] 2 8.000% 28.000% ## ( 1300, 1900 ] 2 8.000% 36.000% ## ( 1900, 2900 ] 4 16.000% 52.000% ### ( 2900, 4400 ] 8 32.000% 84.000% ###### ( 4400, 6600 ] 2 8.000% 92.000% ## ( 6600, 9900 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 325.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.384 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.384 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-11:21:12 ... thread 0: (1000000,2000000) ops and (353985.4,346745.4) ops/second in (2.824975,5.767921) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.41 GB 18.9 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.9 319.0 8.27 7.64 29 0.285 830K 4504 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 263.0 262.0 0.96 0.93 1 0.956 255K 975 0.0 0.0 L2 1/1 50.45 MB 0.0 0.3 0.1 0.2 0.3 0.1 0.3 2.3 248.9 248.1 1.24 1.19 3 0.414 314K 969 0.0 0.0 L3 19/10 1.15 GB 0.4 0.5 0.4 0.1 0.5 0.3 0.0 1.4 229.4 228.7 2.19 2.06 3 0.732 511K 1522 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 255/19 21.00 GB 0.0 1.8 0.7 1.1 3.6 2.5 0.4 2.0 148.7 292.1 12.66 11.82 36 0.352 1911K 7970 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.1 3.6 2.5 0.4 2.0 148.7 292.1 12.66 11.82 36 0.352 1911K 7970 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.1 1.8 0.7 0.0 0.0 250.7 249.6 7.51 7.24 10 0.751 1911K 7970 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.1 5.15 4.58 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.8 total, 5.8 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.61 GB write, 632.40 MB/s write, 1.84 GB read, 321.87 MB/s read, 12.7 seconds Interval compaction: 3.61 GB write, 640.93 MB/s write, 1.84 GB read, 326.21 MB/s read, 12.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 338817 Average: 2.3557 StdDev: 15.28 Min: 0 Median: 1.4981 Max: 3408 Percentiles: P50: 1.50 P75: 1.89 P99: 5.84 P99.9: 13.91 P99.99: 244.88 ------------------------------------------------------ [ 0, 1 ] 60841 17.957% 17.957% #### ( 1, 2 ] 217945 64.325% 82.282% ############# ( 2, 3 ] 37096 10.949% 93.231% ## ( 3, 4 ] 11680 3.447% 96.678% # ( 4, 6 ] 8574 2.531% 99.209% # ( 6, 10 ] 1992 0.588% 99.797% ( 10, 15 ] 449 0.133% 99.929% ( 15, 22 ] 42 0.012% 99.942% ( 22, 34 ] 10 0.003% 99.945% ( 34, 51 ] 6 0.002% 99.946% ( 51, 76 ] 6 0.002% 99.948% ( 76, 110 ] 31 0.009% 99.957% ( 110, 170 ] 70 0.021% 99.978% ( 170, 250 ] 45 0.013% 99.991% ( 250, 380 ] 22 0.006% 99.998% ( 380, 580 ] 25 0.007% 100.005% ( 580, 870 ] 12 0.004% 100.009% ( 870, 1300 ] 8 0.002% 100.011% ( 1300, 1900 ] 1 0.000% 100.011% ( 1900, 2900 ] 3 0.001% 100.012% ( 2900, 4400 ] 3 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 72470 Average: 2.7695 StdDev: 18.40 Min: 1 Median: 1.6532 Max: 2859 Percentiles: P50: 1.65 P75: 2.17 P99: 8.35 P99.9: 59.20 P99.99: 779.59 ------------------------------------------------------ [ 0, 1 ] 6138 8.470% 8.470% ## ( 1, 2 ] 46078 63.582% 72.052% ############# ( 2, 3 ] 12581 17.360% 89.412% ### ( 3, 4 ] 3433 4.737% 94.149% # ( 4, 6 ] 2991 4.127% 98.277% # ( 6, 10 ] 893 1.232% 99.509% ( 10, 15 ] 246 0.339% 99.848% ( 15, 22 ] 23 0.032% 99.880% ( 22, 34 ] 3 0.004% 99.884% ( 34, 51 ] 3 0.004% 99.888% ( 51, 76 ] 26 0.036% 99.924% ( 76, 110 ] 8 0.011% 99.935% ( 110, 170 ] 4 0.006% 99.941% ( 170, 250 ] 17 0.023% 99.964% ( 250, 380 ] 11 0.015% 99.979% ( 380, 580 ] 5 0.007% 99.986% ( 580, 870 ] 4 0.006% 99.992% ( 870, 1300 ] 3 0.004% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 68027 Average: 2.2306 StdDev: 7.85 Min: 1 Median: 1.4936 Max: 1107 Percentiles: P50: 1.49 P75: 1.89 P99: 5.89 P99.9: 12.00 P99.99: 20.49 ------------------------------------------------------ [ 0, 1 ] 12596 18.516% 18.516% #### ( 1, 2 ] 43394 63.789% 82.306% ############# ( 2, 3 ] 7157 10.521% 92.826% ## ( 3, 4 ] 2544 3.740% 96.566% # ( 4, 6 ] 1756 2.581% 99.147% # ( 6, 10 ] 478 0.703% 99.850% ( 10, 15 ] 85 0.125% 99.975% ( 15, 22 ] 13 0.019% 99.994% ( 22, 34 ] 1 0.001% 99.996% ( 76, 110 ] 1 0.001% 99.997% ( 110, 170 ] 3 0.004% 100.001% ( 170, 250 ] 3 0.004% 100.006% ( 250, 380 ] 4 0.006% 100.012% ( 380, 580 ] 1 0.001% 100.013% ( 580, 870 ] 2 0.003% 100.016% ( 870, 1300 ] 2 0.003% 100.019% ** Level 3 read latency histogram (micros): Count: 171042 Average: 3.8444 StdDev: 54.84 Min: 0 Median: 1.6744 Max: 6848 Percentiles: P50: 1.67 P75: 2.22 P99: 9.02 P99.9: 229.74 P99.99: 951.52 ------------------------------------------------------ [ 0, 1 ] 10858 6.348% 6.348% # ( 1, 2 ] 110716 64.730% 71.078% ############# ( 2, 3 ] 30465 17.811% 88.890% #### ( 3, 4 ] 8175 4.780% 93.669% # ( 4, 6 ] 6867 4.015% 97.684% # ( 6, 10 ] 2982 1.743% 99.428% ( 10, 15 ] 374 0.219% 99.646% ( 15, 22 ] 46 0.027% 99.673% ( 22, 34 ] 3 0.002% 99.675% ( 34, 51 ] 1 0.001% 99.676% ( 51, 76 ] 8 0.005% 99.680% ( 76, 110 ] 136 0.080% 99.760% ( 110, 170 ] 172 0.101% 99.860% ( 170, 250 ] 91 0.053% 99.913% ( 250, 380 ] 63 0.037% 99.950% ( 380, 580 ] 51 0.030% 99.980% ( 580, 870 ] 15 0.009% 99.989% ( 870, 1300 ] 10 0.006% 99.995% ( 1300, 1900 ] 6 0.004% 99.998% ( 1900, 2900 ] 15 0.009% 100.007% ( 2900, 4400 ] 6 0.004% 100.011% ( 4400, 6600 ] 8 0.005% 100.015% ( 6600, 9900 ] 1 0.001% 100.016% ** Level 4 read latency histogram (micros): Count: 25 Average: 2808.5600 StdDev: 2049.60 Min: 113 Median: 2775.0000 Max: 7553 Percentiles: P50: 2775.00 P75: 3978.12 P99: 7553.00 P99.9: 7553.00 P99.99: 7553.00 ------------------------------------------------------ ( 110, 170 ] 1 4.000% 4.000% # ( 250, 380 ] 2 8.000% 12.000% ## ( 380, 580 ] 2 8.000% 20.000% ## ( 870, 1300 ] 2 8.000% 28.000% ## ( 1300, 1900 ] 2 8.000% 36.000% ## ( 1900, 2900 ] 4 16.000% 52.000% ### ( 2900, 4400 ] 8 32.000% 84.000% ###### ( 4400, 6600 ] 2 8.000% 92.000% ## ( 6600, 9900 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 5.8 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 336.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.588 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.204 H:M:S, 7.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-11:21:15 ... thread 0: (1000000,3000000) ops and (329081.1,340650.3) ops/second in (3.038765,8.806686) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.33 GB 81.5 1.3 0.0 1.3 4.0 2.7 0.0 1.5 102.0 315.0 12.96 11.95 44 0.295 1341K 6910 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 263.0 262.0 0.96 0.93 1 0.956 255K 975 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.3 2.3 248.9 248.1 1.24 1.19 3 0.414 314K 969 0.0 0.0 L3 10/0 524.93 MB 0.5 1.3 0.4 0.9 1.3 0.4 0.0 3.3 228.4 225.6 6.01 5.59 4 1.502 1394K 17K 0.0 0.0 L4 118/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 211.7 211.7 0.81 0.72 1 0.812 174K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 262/12 21.90 GB 0.0 3.3 0.9 2.4 6.0 3.6 1.6 2.2 155.9 280.6 21.98 20.38 53 0.415 3480K 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 0.9 2.4 6.0 3.6 1.5 2.2 155.9 280.6 21.98 20.38 53 0.415 3480K 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 0.9 2.4 3.3 0.9 0.0 0.0 243.0 241.1 14.10 13.41 14 1.007 3480K 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 351.4 7.87 6.97 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 2.702, interval 2.702 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.02 GB write, 694.09 MB/s write, 3.35 GB read, 385.63 MB/s read, 22.0 seconds Interval compaction: 6.02 GB write, 700.23 MB/s write, 3.35 GB read, 389.03 MB/s read, 22.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 692984 Average: 2.5590 StdDev: 15.66 Min: 0 Median: 1.5718 Max: 3408 Percentiles: P50: 1.57 P75: 1.95 P99: 6.63 P99.9: 14.90 P99.99: 292.77 ------------------------------------------------------ [ 0, 1 ] 87204 12.584% 12.584% ### ( 1, 2 ] 453438 65.433% 78.017% ############# ( 2, 3 ] 97262 14.035% 92.052% ### ( 3, 4 ] 25892 3.736% 95.788% # ( 4, 6 ] 21290 3.072% 98.860% # ( 6, 10 ] 6125 0.884% 99.744% ( 10, 15 ] 1105 0.159% 99.904% ( 15, 22 ] 90 0.013% 99.917% ( 22, 34 ] 13 0.002% 99.918% ( 34, 51 ] 8 0.001% 99.920% ( 51, 76 ] 9 0.001% 99.921% ( 76, 110 ] 101 0.015% 99.935% ( 110, 170 ] 218 0.031% 99.967% ( 170, 250 ] 139 0.020% 99.987% ( 250, 380 ] 69 0.010% 99.997% ( 380, 580 ] 77 0.011% 100.008% ( 580, 870 ] 33 0.005% 100.013% ( 870, 1300 ] 17 0.002% 100.015% ( 1300, 1900 ] 10 0.001% 100.017% ( 1900, 2900 ] 6 0.001% 100.018% ( 2900, 4400 ] 4 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 72470 Average: 2.7695 StdDev: 18.40 Min: 1 Median: 1.6532 Max: 2859 Percentiles: P50: 1.65 P75: 2.17 P99: 8.35 P99.9: 59.20 P99.99: 779.59 ------------------------------------------------------ [ 0, 1 ] 6138 8.470% 8.470% ## ( 1, 2 ] 46078 63.582% 72.052% ############# ( 2, 3 ] 12581 17.360% 89.412% ### ( 3, 4 ] 3433 4.737% 94.149% # ( 4, 6 ] 2991 4.127% 98.277% # ( 6, 10 ] 893 1.232% 99.509% ( 10, 15 ] 246 0.339% 99.848% ( 15, 22 ] 23 0.032% 99.880% ( 22, 34 ] 3 0.004% 99.884% ( 34, 51 ] 3 0.004% 99.888% ( 51, 76 ] 26 0.036% 99.924% ( 76, 110 ] 8 0.011% 99.935% ( 110, 170 ] 4 0.006% 99.941% ( 170, 250 ] 17 0.023% 99.964% ( 250, 380 ] 11 0.015% 99.979% ( 380, 580 ] 5 0.007% 99.986% ( 580, 870 ] 4 0.006% 99.992% ( 870, 1300 ] 3 0.004% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 78297 Average: 2.4175 StdDev: 11.62 Min: 1 Median: 1.5204 Max: 1334 Percentiles: P50: 1.52 P75: 1.91 P99: 6.25 P99.9: 13.98 P99.99: 311.10 ------------------------------------------------------ [ 0, 1 ] 13093 16.722% 16.722% ### ( 1, 2 ] 50065 63.942% 80.665% ############# ( 2, 3 ] 9152 11.689% 92.353% ## ( 3, 4 ] 2992 3.821% 96.175% # ( 4, 6 ] 2170 2.771% 98.946% # ( 6, 10 ] 664 0.848% 99.794% ( 10, 15 ] 104 0.133% 99.927% ( 15, 22 ] 14 0.018% 99.945% ( 22, 34 ] 1 0.001% 99.946% ( 76, 110 ] 6 0.008% 99.954% ( 110, 170 ] 15 0.019% 99.973% ( 170, 250 ] 8 0.010% 99.983% ( 250, 380 ] 11 0.014% 99.997% ( 380, 580 ] 8 0.010% 100.008% ( 580, 870 ] 3 0.004% 100.011% ( 870, 1300 ] 3 0.004% 100.015% ( 1300, 1900 ] 1 0.001% 100.017% ** Level 3 read latency histogram (micros): Count: 288229 Average: 3.6981 StdDev: 45.17 Min: 0 Median: 1.6926 Max: 6848 Percentiles: P50: 1.69 P75: 2.28 P99: 9.13 P99.9: 245.17 P99.99: 1104.47 ------------------------------------------------------ [ 0, 1 ] 16106 5.588% 5.588% # ( 1, 2 ] 184833 64.127% 69.715% ############# ( 2, 3 ] 54996 19.081% 88.796% #### ( 3, 4 ] 13177 4.572% 93.367% # ( 4, 6 ] 12024 4.172% 97.539% # ( 6, 10 ] 5385 1.868% 99.407% ( 10, 15 ] 717 0.249% 99.656% ( 15, 22 ] 77 0.027% 99.683% ( 22, 34 ] 4 0.001% 99.684% ( 34, 51 ] 2 0.001% 99.685% ( 51, 76 ] 9 0.003% 99.688% ( 76, 110 ] 184 0.064% 99.752% ( 110, 170 ] 283 0.098% 99.850% ( 170, 250 ] 153 0.053% 99.903% ( 250, 380 ] 109 0.038% 99.941% ( 380, 580 ] 97 0.034% 99.975% ( 580, 870 ] 30 0.010% 99.985% ( 870, 1300 ] 26 0.009% 99.994% ( 1300, 1900 ] 11 0.004% 99.998% ( 1900, 2900 ] 18 0.006% 100.004% ( 2900, 4400 ] 6 0.002% 100.006% ( 4400, 6600 ] 8 0.003% 100.009% ( 6600, 9900 ] 1 0.000% 100.009% ** Level 4 read latency histogram (micros): Count: 55 Average: 1314.9818 StdDev: 1944.45 Min: 1 Median: 140.0000 Max: 7553 Percentiles: P50: 140.00 P75: 2462.50 P99: 7553.00 P99.9: 7553.00 P99.99: 7553.00 ------------------------------------------------------ [ 0, 1 ] 10 18.182% 18.182% #### ( 1, 2 ] 8 14.545% 32.727% ### ( 15, 22 ] 1 1.818% 34.545% ( 22, 34 ] 2 3.636% 38.182% # ( 76, 110 ] 6 10.909% 49.091% ## ( 110, 170 ] 1 1.818% 50.909% ( 250, 380 ] 3 5.455% 56.364% # ( 380, 580 ] 3 5.455% 61.818% # ( 580, 870 ] 1 1.818% 63.636% ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 2 3.636% 70.909% # ( 1900, 2900 ] 4 7.273% 78.182% # ( 2900, 4400 ] 8 14.545% 92.727% ### ( 4400, 6600 ] 2 3.636% 96.364% # ( 6600, 9900 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 1125.2000 StdDev: 1358.70 Min: 106 Median: 413.3333 Max: 6567 Percentiles: P50: 413.33 P75: 2011.11 P99: 5720.00 P99.9: 6512.00 P99.99: 6567.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 6 15.000% 22.500% ### ( 170, 250 ] 7 17.500% 40.000% #### ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 1 2.500% 65.000% # ( 1300, 1900 ] 3 7.500% 72.500% ## ( 1900, 2900 ] 9 22.500% 95.000% ##### ( 2900, 4400 ] 1 2.500% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 332.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.976 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.388 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-11:21:18 ... thread 0: (1000000,4000000) ops and (318652.9,334871.0) ops/second in (3.138211,11.944897) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.08 GB 6.3 2.1 0.0 2.1 5.8 3.7 0.0 1.6 113.5 313.1 18.85 17.46 61 0.309 2171K 11K 0.0 0.0 L1 10/10 1.19 GB 0.0 1.5 1.5 0.0 1.4 1.4 0.1 1.0 229.7 224.5 6.55 6.24 2 3.275 1528K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.3 2.3 248.9 248.1 1.24 1.19 3 0.414 314K 969 0.0 0.0 L3 10/0 524.93 MB 0.5 1.3 0.4 0.9 1.3 0.4 0.0 3.3 228.4 225.6 6.01 5.59 4 1.502 1394K 17K 0.0 0.0 L4 118/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 211.7 211.7 0.81 0.72 1 0.812 174K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 269/24 22.85 GB 0.0 5.4 2.2 3.2 9.0 5.8 1.6 2.4 164.3 275.2 33.46 31.19 71 0.471 5583K 63K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.2 3.2 9.0 5.8 1.5 2.4 164.3 275.2 33.46 31.19 71 0.471 5583K 63K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.2 3.2 5.3 2.1 0.0 0.0 241.9 239.1 22.73 21.69 18 1.263 5583K 63K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 351.5 10.74 9.50 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 3.685, interval 3.685 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.99 GB write, 765.75 MB/s write, 5.37 GB read, 457.21 MB/s read, 33.5 seconds Interval compaction: 8.99 GB write, 770.74 MB/s write, 5.37 GB read, 460.19 MB/s read, 33.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 13, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1005801 Average: 2.5580 StdDev: 16.48 Min: 0 Median: 1.5622 Max: 4388 Percentiles: P50: 1.56 P75: 1.94 P99: 6.58 P99.9: 18.22 P99.99: 241.73 ------------------------------------------------------ [ 0, 1 ] 128179 12.744% 12.744% ### ( 1, 2 ] 666503 66.266% 79.010% ############# ( 2, 3 ] 136059 13.527% 92.537% ### ( 3, 4 ] 34778 3.458% 95.995% # ( 4, 6 ] 28972 2.880% 98.876% # ( 6, 10 ] 8705 0.865% 99.741% ( 10, 15 ] 1544 0.154% 99.895% ( 15, 22 ] 120 0.012% 99.906% ( 22, 34 ] 13 0.001% 99.908% ( 34, 51 ] 9 0.001% 99.909% ( 51, 76 ] 13 0.001% 99.910% ( 76, 110 ] 206 0.020% 99.930% ( 110, 170 ] 421 0.042% 99.972% ( 170, 250 ] 199 0.020% 99.992% ( 250, 380 ] 103 0.010% 100.002% ( 380, 580 ] 108 0.011% 100.013% ( 580, 870 ] 50 0.005% 100.018% ( 870, 1300 ] 23 0.002% 100.020% ( 1300, 1900 ] 12 0.001% 100.021% ( 1900, 2900 ] 9 0.001% 100.022% ( 2900, 4400 ] 8 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 93123 Average: 3.0855 StdDev: 30.11 Min: 0 Median: 1.6042 Max: 3104 Percentiles: P50: 1.60 P75: 1.99 P99: 8.47 P99.9: 161.91 P99.99: 1622.52 ------------------------------------------------------ [ 0, 1 ] 10342 11.106% 11.106% ## ( 1, 2 ] 59943 64.370% 75.475% ############# ( 2, 3 ] 13834 14.856% 90.331% ### ( 3, 4 ] 3968 4.261% 94.592% # ( 4, 6 ] 3381 3.631% 98.223% # ( 6, 10 ] 1173 1.260% 99.482% ( 10, 15 ] 269 0.289% 99.771% ( 15, 22 ] 25 0.027% 99.798% ( 22, 34 ] 5 0.005% 99.803% ( 34, 51 ] 3 0.003% 99.807% ( 51, 76 ] 27 0.029% 99.836% ( 76, 110 ] 27 0.029% 99.865% ( 110, 170 ] 38 0.041% 99.906% ( 170, 250 ] 25 0.027% 99.932% ( 250, 380 ] 18 0.019% 99.952% ( 380, 580 ] 17 0.018% 99.970% ( 580, 870 ] 9 0.010% 99.980% ( 870, 1300 ] 7 0.008% 99.987% ( 1300, 1900 ] 5 0.005% 99.992% ( 1900, 2900 ] 5 0.005% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 78297 Average: 2.4175 StdDev: 11.62 Min: 1 Median: 1.5204 Max: 1334 Percentiles: P50: 1.52 P75: 1.91 P99: 6.25 P99.9: 13.98 P99.99: 311.10 ------------------------------------------------------ [ 0, 1 ] 13093 16.722% 16.722% ### ( 1, 2 ] 50065 63.942% 80.665% ############# ( 2, 3 ] 9152 11.689% 92.353% ## ( 3, 4 ] 2992 3.821% 96.175% # ( 4, 6 ] 2170 2.771% 98.946% # ( 6, 10 ] 664 0.848% 99.794% ( 10, 15 ] 104 0.133% 99.927% ( 15, 22 ] 14 0.018% 99.945% ( 22, 34 ] 1 0.001% 99.946% ( 76, 110 ] 6 0.008% 99.954% ( 110, 170 ] 15 0.019% 99.973% ( 170, 250 ] 8 0.010% 99.983% ( 250, 380 ] 11 0.014% 99.997% ( 380, 580 ] 8 0.010% 100.008% ( 580, 870 ] 3 0.004% 100.011% ( 870, 1300 ] 3 0.004% 100.015% ( 1300, 1900 ] 1 0.001% 100.017% ** Level 3 read latency histogram (micros): Count: 288229 Average: 3.6981 StdDev: 45.17 Min: 0 Median: 1.6926 Max: 6848 Percentiles: P50: 1.69 P75: 2.28 P99: 9.13 P99.9: 245.17 P99.99: 1104.47 ------------------------------------------------------ [ 0, 1 ] 16106 5.588% 5.588% # ( 1, 2 ] 184833 64.127% 69.715% ############# ( 2, 3 ] 54996 19.081% 88.796% #### ( 3, 4 ] 13177 4.572% 93.367% # ( 4, 6 ] 12024 4.172% 97.539% # ( 6, 10 ] 5385 1.868% 99.407% ( 10, 15 ] 717 0.249% 99.656% ( 15, 22 ] 77 0.027% 99.683% ( 22, 34 ] 4 0.001% 99.684% ( 34, 51 ] 2 0.001% 99.685% ( 51, 76 ] 9 0.003% 99.688% ( 76, 110 ] 184 0.064% 99.752% ( 110, 170 ] 283 0.098% 99.850% ( 170, 250 ] 153 0.053% 99.903% ( 250, 380 ] 109 0.038% 99.941% ( 380, 580 ] 97 0.034% 99.975% ( 580, 870 ] 30 0.010% 99.985% ( 870, 1300 ] 26 0.009% 99.994% ( 1300, 1900 ] 11 0.004% 99.998% ( 1900, 2900 ] 18 0.006% 100.004% ( 2900, 4400 ] 6 0.002% 100.006% ( 4400, 6600 ] 8 0.003% 100.009% ( 6600, 9900 ] 1 0.000% 100.009% ** Level 4 read latency histogram (micros): Count: 55 Average: 1314.9818 StdDev: 1944.45 Min: 1 Median: 140.0000 Max: 7553 Percentiles: P50: 140.00 P75: 2462.50 P99: 7553.00 P99.9: 7553.00 P99.99: 7553.00 ------------------------------------------------------ [ 0, 1 ] 10 18.182% 18.182% #### ( 1, 2 ] 8 14.545% 32.727% ### ( 15, 22 ] 1 1.818% 34.545% ( 22, 34 ] 2 3.636% 38.182% # ( 76, 110 ] 6 10.909% 49.091% ## ( 110, 170 ] 1 1.818% 50.909% ( 250, 380 ] 3 5.455% 56.364% # ( 380, 580 ] 3 5.455% 61.818% # ( 580, 870 ] 1 1.818% 63.636% ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 2 3.636% 70.909% # ( 1900, 2900 ] 4 7.273% 78.182% # ( 2900, 4400 ] 8 14.545% 92.727% ### ( 4400, 6600 ] 2 3.636% 96.364% # ( 6600, 9900 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 1125.2000 StdDev: 1358.70 Min: 106 Median: 413.3333 Max: 6567 Percentiles: P50: 413.33 P75: 2011.11 P99: 5720.00 P99.9: 6512.00 P99.99: 6567.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 6 15.000% 22.500% ### ( 170, 250 ] 7 17.500% 40.000% #### ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 1 2.500% 65.000% # ( 1300, 1900 ] 3 7.500% 72.500% ## ( 1900, 2900 ] 9 22.500% 95.000% ##### ( 2900, 4400 ] 1 2.500% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.521 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.545 H:M:S, 17.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-11:21:22 ... thread 0: (1000000,5000000) ops and (282405.6,322874.3) ops/second in (3.541006,15.485903) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.12 GB 112.6 3.2 0.0 3.2 7.9 4.7 0.0 1.7 125.2 310.0 26.12 24.33 80 0.326 3321K 17K 0.0 0.0 L1 10/10 1.19 GB 0.0 1.5 1.5 0.0 1.4 1.4 0.1 1.0 229.7 224.5 6.55 6.24 2 3.275 1528K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.3 2.3 248.9 248.1 1.24 1.19 3 0.414 314K 969 0.0 0.0 L3 10/0 524.93 MB 0.5 1.3 0.4 0.9 1.3 0.4 0.0 3.3 228.4 225.6 6.01 5.59 4 1.502 1394K 17K 0.0 0.0 L4 118/0 9.53 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.5 1.0 211.7 211.7 0.81 0.72 1 0.812 174K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 272/24 23.89 GB 0.0 6.5 2.2 4.3 11.1 6.8 1.6 2.4 162.8 279.9 40.73 38.07 90 0.453 6733K 69K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.2 4.3 11.1 6.8 1.5 2.4 162.8 279.9 40.73 38.07 90 0.453 6733K 69K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.2 4.3 6.4 2.1 0.0 0.0 246.1 243.5 26.94 25.84 22 1.225 6733K 69K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.2 13.79 12.23 68 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.5 interval Flush(GB): cumulative 4.729, interval 4.729 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.14 GB write, 732.57 MB/s write, 6.47 GB read, 425.93 MB/s read, 40.7 seconds Interval compaction: 11.14 GB write, 736.25 MB/s write, 6.47 GB read, 428.08 MB/s read, 40.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 16, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1398966 Average: 2.5552 StdDev: 15.96 Min: 0 Median: 1.5649 Max: 4388 Percentiles: P50: 1.56 P75: 1.94 P99: 6.28 P99.9: 20.47 P99.99: 239.60 ------------------------------------------------------ [ 0, 1 ] 170057 12.156% 12.156% ## ( 1, 2 ] 937217 66.994% 79.149% ############# ( 2, 3 ] 190818 13.640% 92.789% ### ( 3, 4 ] 47232 3.376% 96.166% # ( 4, 6 ] 38845 2.777% 98.942% # ( 6, 10 ] 11364 0.812% 99.755% ( 10, 15 ] 1917 0.137% 99.892% ( 15, 22 ] 151 0.011% 99.902% ( 22, 34 ] 17 0.001% 99.904% ( 34, 51 ] 11 0.001% 99.904% ( 51, 76 ] 15 0.001% 99.906% ( 76, 110 ] 333 0.024% 99.929% ( 110, 170 ] 610 0.044% 99.973% ( 170, 250 ] 276 0.020% 99.993% ( 250, 380 ] 144 0.010% 100.003% ( 380, 580 ] 149 0.011% 100.014% ( 580, 870 ] 76 0.005% 100.019% ( 870, 1300 ] 27 0.002% 100.021% ( 1300, 1900 ] 17 0.001% 100.022% ( 1900, 2900 ] 12 0.001% 100.023% ( 2900, 4400 ] 9 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 175176 Average: 2.9802 StdDev: 23.99 Min: 0 Median: 1.6036 Max: 3104 Percentiles: P50: 1.60 P75: 1.98 P99: 8.54 P99.9: 162.07 P99.99: 1022.49 ------------------------------------------------------ [ 0, 1 ] 17464 9.969% 9.969% ## ( 1, 2 ] 116183 66.324% 76.293% ############# ( 2, 3 ] 25907 14.789% 91.082% ### ( 3, 4 ] 6605 3.770% 94.853% # ( 4, 6 ] 5663 3.233% 98.085% # ( 6, 10 ] 2527 1.443% 99.528% ( 10, 15 ] 350 0.200% 99.728% ( 15, 22 ] 38 0.022% 99.749% ( 22, 34 ] 6 0.003% 99.753% ( 34, 51 ] 6 0.003% 99.756% ( 51, 76 ] 28 0.016% 99.772% ( 76, 110 ] 98 0.056% 99.828% ( 110, 170 ] 145 0.083% 99.911% ( 170, 250 ] 59 0.034% 99.945% ( 250, 380 ] 35 0.020% 99.965% ( 380, 580 ] 28 0.016% 99.981% ( 580, 870 ] 14 0.008% 99.989% ( 870, 1300 ] 7 0.004% 99.993% ( 1300, 1900 ] 5 0.003% 99.995% ( 1900, 2900 ] 6 0.003% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 78297 Average: 2.4175 StdDev: 11.62 Min: 1 Median: 1.5204 Max: 1334 Percentiles: P50: 1.52 P75: 1.91 P99: 6.25 P99.9: 13.98 P99.99: 311.10 ------------------------------------------------------ [ 0, 1 ] 13093 16.722% 16.722% ### ( 1, 2 ] 50065 63.942% 80.665% ############# ( 2, 3 ] 9152 11.689% 92.353% ## ( 3, 4 ] 2992 3.821% 96.175% # ( 4, 6 ] 2170 2.771% 98.946% # ( 6, 10 ] 664 0.848% 99.794% ( 10, 15 ] 104 0.133% 99.927% ( 15, 22 ] 14 0.018% 99.945% ( 22, 34 ] 1 0.001% 99.946% ( 76, 110 ] 6 0.008% 99.954% ( 110, 170 ] 15 0.019% 99.973% ( 170, 250 ] 8 0.010% 99.983% ( 250, 380 ] 11 0.014% 99.997% ( 380, 580 ] 8 0.010% 100.008% ( 580, 870 ] 3 0.004% 100.011% ( 870, 1300 ] 3 0.004% 100.015% ( 1300, 1900 ] 1 0.001% 100.017% ** Level 3 read latency histogram (micros): Count: 288229 Average: 3.6981 StdDev: 45.17 Min: 0 Median: 1.6926 Max: 6848 Percentiles: P50: 1.69 P75: 2.28 P99: 9.13 P99.9: 245.17 P99.99: 1104.47 ------------------------------------------------------ [ 0, 1 ] 16106 5.588% 5.588% # ( 1, 2 ] 184833 64.127% 69.715% ############# ( 2, 3 ] 54996 19.081% 88.796% #### ( 3, 4 ] 13177 4.572% 93.367% # ( 4, 6 ] 12024 4.172% 97.539% # ( 6, 10 ] 5385 1.868% 99.407% ( 10, 15 ] 717 0.249% 99.656% ( 15, 22 ] 77 0.027% 99.683% ( 22, 34 ] 4 0.001% 99.684% ( 34, 51 ] 2 0.001% 99.685% ( 51, 76 ] 9 0.003% 99.688% ( 76, 110 ] 184 0.064% 99.752% ( 110, 170 ] 283 0.098% 99.850% ( 170, 250 ] 153 0.053% 99.903% ( 250, 380 ] 109 0.038% 99.941% ( 380, 580 ] 97 0.034% 99.975% ( 580, 870 ] 30 0.010% 99.985% ( 870, 1300 ] 26 0.009% 99.994% ( 1300, 1900 ] 11 0.004% 99.998% ( 1900, 2900 ] 18 0.006% 100.004% ( 2900, 4400 ] 6 0.002% 100.006% ( 4400, 6600 ] 8 0.003% 100.009% ( 6600, 9900 ] 1 0.000% 100.009% ** Level 4 read latency histogram (micros): Count: 55 Average: 1314.9818 StdDev: 1944.45 Min: 1 Median: 140.0000 Max: 7553 Percentiles: P50: 140.00 P75: 2462.50 P99: 7553.00 P99.9: 7553.00 P99.99: 7553.00 ------------------------------------------------------ [ 0, 1 ] 10 18.182% 18.182% #### ( 1, 2 ] 8 14.545% 32.727% ### ( 15, 22 ] 1 1.818% 34.545% ( 22, 34 ] 2 3.636% 38.182% # ( 76, 110 ] 6 10.909% 49.091% ## ( 110, 170 ] 1 1.818% 50.909% ( 250, 380 ] 3 5.455% 56.364% # ( 380, 580 ] 3 5.455% 61.818% # ( 580, 870 ] 1 1.818% 63.636% ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 2 3.636% 70.909% # ( 1900, 2900 ] 4 7.273% 78.182% # ( 2900, 4400 ] 8 14.545% 92.727% ### ( 4400, 6600 ] 2 3.636% 96.364% # ( 6600, 9900 ] 2 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 1125.2000 StdDev: 1358.70 Min: 106 Median: 413.3333 Max: 6567 Percentiles: P50: 413.33 P75: 2011.11 P99: 5720.00 P99.9: 6512.00 P99.99: 6567.00 ------------------------------------------------------ ( 76, 110 ] 3 7.500% 7.500% ## ( 110, 170 ] 6 15.000% 22.500% ### ( 170, 250 ] 7 17.500% 40.000% #### ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 6 15.000% 62.500% ### ( 580, 870 ] 1 2.500% 65.000% # ( 1300, 1900 ] 3 7.500% 72.500% ## ( 1900, 2900 ] 9 22.500% 95.000% ##### ( 2900, 4400 ] 1 2.500% 97.500% # ( 4400, 6600 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 316.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.377 H:M:S, 15.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.855 H:M:S, 24.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.513 micros/op 284641 ops/sec 20.131 seconds 5729999 operations; 275.8 MB/s Microseconds per write: Count: 5729999 Average: 3.5132 StdDev: 247.09 Min: 1 Median: 1.7225 Max: 207241 Percentiles: P50: 1.72 P75: 2.65 P99: 7.31 P99.9: 96.58 P99.99: 1279.18 ------------------------------------------------------ [ 0, 1 ] 771953 13.472% 13.472% ### ( 1, 2 ] 2897063 50.560% 64.032% ########## ( 2, 3 ] 973190 16.984% 81.016% ### ( 3, 4 ] 763818 13.330% 94.346% ### ( 4, 6 ] 251670 4.392% 98.738% # ( 6, 10 ] 45805 0.799% 99.538% ( 10, 15 ] 13406 0.234% 99.771% ( 15, 22 ] 3903 0.068% 99.840% ( 22, 34 ] 734 0.013% 99.852% ( 34, 51 ] 75 0.001% 99.854% ( 51, 76 ] 17 0.000% 99.854% ( 76, 110 ] 4354 0.076% 99.930% ( 110, 170 ] 1294 0.023% 99.953% ( 170, 250 ] 124 0.002% 99.955% ( 250, 380 ] 43 0.001% 99.955% ( 380, 580 ] 7 0.000% 99.956% ( 580, 870 ] 5 0.000% 99.956% ( 870, 1300 ] 2065 0.036% 99.992% ( 1900, 2900 ] 459 0.008% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 8 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 203743 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5729999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5913358968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 168 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4973492 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10193259291 rocksdb.compact.write.bytes COUNT : 9993187288 rocksdb.flush.write.bytes COUNT : 5869462961 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 17 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 77 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5831738368 rocksdb.memtable.garbage.bytes.at.flush COUNT : 11076608 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10242238329 rocksdb.non.last.level.read.count COUNT : 2473007 rocksdb.block.checksum.compute.count COUNT : 2472688 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.361541 P95 : 3.745110 P99 : 5.879509 P100 : 207237.000000 COUNT : 5729999 SUM : 17508369 rocksdb.compaction.times.micros P50 : 976875.000000 P95 : 3950000.000000 P99 : 5594726.000000 P100 : 5594726.000000 COUNT : 25 SUM : 29735289 rocksdb.compaction.times.cpu_micros P50 : 976875.000000 P95 : 3950000.000000 P99 : 5305820.000000 P100 : 5305820.000000 COUNT : 25 SUM : 28559520 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 665.294118 P95 : 1300.000000 P99 : 1456.000000 P100 : 1456.000000 COUNT : 80 SUM : 60819 rocksdb.compaction.outfile.sync.micros P50 : 816.413043 P95 : 1505.000000 P99 : 1600.000000 P100 : 1600.000000 COUNT : 79 SUM : 67499 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 89.940000 P95 : 233.500000 P99 : 374.366667 P100 : 412.000000 COUNT : 113 SUM : 12078 rocksdb.table.open.io.micros P50 : 1717.391304 P95 : 15280.000000 P99 : 17340.000000 P100 : 17340.000000 COUNT : 168 SUM : 502044 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.608872 P95 : 6.352299 P99 : 9.814038 P100 : 9528.000000 COUNT : 2472223 SUM : 11640430 rocksdb.read.block.get.micros P50 : 546.666667 P95 : 4196.428571 P99 : 7128.000000 P100 : 7713.000000 COUNT : 336 SUM : 386199 rocksdb.write.raw.block.micros P50 : 0.510402 P95 : 0.969764 P99 : 2.672236 P100 : 4424.000000 COUNT : 3842986 SUM : 7056232 rocksdb.numfiles.in.singlecompaction P50 : 3.352941 P95 : 11.500000 P99 : 19.620000 P100 : 20.000000 COUNT : 34 SUM : 146 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559950 P95 : 1148.552542 P99 : 2405.751634 P100 : 207040.000000 COUNT : 23986 SUM : 4976185 rocksdb.sst.read.micros P50 : 1.571696 P95 : 3.749756 P99 : 7.403238 P100 : 7553.000000 COUNT : 2473099 SUM : 6882106 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5729999 SUM : 5913358968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 207894.736842 P95 : 328000.000000 P99 : 369458.000000 P100 : 369458.000000 COUNT : 80 SUM : 16030286 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 110 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0