[2024-11-20 17:05:42.702100] Starting SPDK v25.01-pre git sha1 5200caf0b / DPDK 24.03.0 initialization... [2024-11-20 17:05:42.702237] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932221 ] Set seed to 1732118742699168 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 17:05:42.845711] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 17:05:42.940375] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 17:05:42.940416] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2932221' to capture a snapshot of events at runtime. [2024-11-20 17:05:42.940429] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 17:05:42.940440] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 17:05:42.940451] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2932221 for offline analysis/debug. [2024-11-20 17:05:42.941712] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 17:05:45 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/11/20-17:05:48 ... thread 0: (1000000,1000000) ops and (365574.0,365574.0) ops/second in (2.735424,2.735424) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 503.29 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 380.3 2.15 1.99 13 0.165 0 0 0.0 0.0 L1 3/3 188.10 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 347.7 346.5 0.54 0.53 1 0.543 191K 628 0.0 0.0 L2 2/1 160.33 MB 0.4 0.3 0.1 0.1 0.3 0.1 0.0 2.1 335.0 334.5 0.77 0.75 2 0.386 262K 402 0.0 0.0 L3 10/0 818.90 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 124/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 120/0 8.67 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 267/11 20.03 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.1 1.5 129.1 364.8 3.46 3.27 16 0.217 454K 1030 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.1 1.5 129.1 364.8 3.46 3.27 16 0.217 454K 1030 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 340.3 339.5 1.31 1.28 3 0.438 454K 1030 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 380.3 2.15 1.99 13 0.165 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.8 total, 2.7 interval Flush(GB): cumulative 0.799, interval 0.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 445.96 MB/s write, 0.44 GB read, 157.78 MB/s read, 3.5 seconds Interval compaction: 1.23 GB write, 461.46 MB/s write, 0.44 GB read, 163.26 MB/s read, 3.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 129142 Average: 1.5241 StdDev: 4.29 Min: 0 Median: 0.8410 Max: 441 Percentiles: P50: 0.84 P75: 1.43 P99: 3.41 P99.9: 7.25 P99.99: 197.81 ------------------------------------------------------ [ 0, 1 ] 76775 59.450% 59.450% ############ ( 1, 2 ] 47213 36.559% 96.009% ####### ( 2, 3 ] 3450 2.671% 98.681% # ( 3, 4 ] 1011 0.783% 99.463% ( 4, 6 ] 524 0.406% 99.869% ( 6, 10 ] 137 0.106% 99.975% ( 10, 15 ] 8 0.006% 99.981% ( 15, 22 ] 3 0.002% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 1 0.001% 99.985% ( 110, 170 ] 7 0.005% 99.991% ( 170, 250 ] 6 0.005% 99.995% ( 250, 380 ] 2 0.002% 99.997% ( 380, 580 ] 11 0.009% 100.005% ** Level 1 read latency histogram (micros): Count: 36253 Average: 1.5082 StdDev: 3.64 Min: 0 Median: 0.8617 Max: 483 Percentiles: P50: 0.86 P75: 1.44 P99: 3.09 P99.9: 5.52 P99.99: 132.48 ------------------------------------------------------ [ 0, 1 ] 21036 58.026% 58.026% ############ ( 1, 2 ] 13884 38.298% 96.323% ######## ( 2, 3 ] 948 2.615% 98.938% # ( 3, 4 ] 273 0.753% 99.691% ( 4, 6 ] 102 0.281% 99.972% ( 6, 10 ] 6 0.017% 99.989% ( 34, 51 ] 1 0.003% 99.992% ( 51, 76 ] 1 0.003% 99.994% ( 110, 170 ] 1 0.003% 99.997% ( 250, 380 ] 2 0.006% 100.003% ( 380, 580 ] 1 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 45626 Average: 1.8618 StdDev: 19.66 Min: 0 Median: 0.8374 Max: 3420 Percentiles: P50: 0.84 P75: 1.43 P99: 3.99 P99.9: 123.66 P99.99: 367.81 ------------------------------------------------------ [ 0, 1 ] 27243 59.709% 59.709% ############ ( 1, 2 ] 16162 35.423% 95.132% ####### ( 2, 3 ] 1299 2.847% 97.979% # ( 3, 4 ] 472 1.034% 99.014% ( 4, 6 ] 297 0.651% 99.665% ( 6, 10 ] 72 0.158% 99.822% ( 10, 15 ] 4 0.009% 99.831% ( 15, 22 ] 1 0.002% 99.833% ( 76, 110 ] 25 0.055% 99.888% ( 110, 170 ] 28 0.061% 99.950% ( 170, 250 ] 14 0.031% 99.980% ( 250, 380 ] 6 0.013% 99.993% ( 380, 580 ] 1 0.002% 99.996% ( 870, 1300 ] 1 0.002% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 2900, 4400 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 50 Average: 1707.3800 StdDev: 1346.33 Min: 148 Median: 1182.7273 Max: 5019 Percentiles: P50: 1182.73 P75: 2962.50 P99: 5019.00 P99.9: 5019.00 P99.99: 5019.00 ------------------------------------------------------ ( 110, 170 ] 3 6.000% 6.000% # ( 170, 250 ] 2 4.000% 10.000% # ( 250, 380 ] 8 16.000% 26.000% ### ( 380, 580 ] 2 4.000% 30.000% # ( 580, 870 ] 2 4.000% 34.000% # ( 870, 1300 ] 11 22.000% 56.000% #### ( 1300, 1900 ] 2 4.000% 60.000% # ( 1900, 2900 ] 7 14.000% 74.000% ### ( 2900, 4400 ] 12 24.000% 98.000% ##### ( 4400, 6600 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1695.5200 StdDev: 1353.49 Min: 103 Median: 1400.0000 Max: 4732 Percentiles: P50: 1400.00 P75: 2650.00 P99: 4732.00 P99.9: 4732.00 P99.99: 4732.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 1 4.000% 8.000% # ( 250, 380 ] 5 20.000% 28.000% #### ( 380, 580 ] 1 4.000% 32.000% # ( 580, 870 ] 1 4.000% 36.000% # ( 870, 1300 ] 3 12.000% 48.000% ## ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 5 20.000% 80.000% #### ( 2900, 4400 ] 3 12.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 2.8 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 347.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.005 H:M:S, 0.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 359.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.005 H:M:S, 0.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-17:05:51 ... thread 0: (1000000,2000000) ops and (332887.7,348466.1) ops/second in (3.004016,5.739440) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.29 GB 56.4 0.7 0.0 0.7 2.5 1.8 0.0 1.4 109.3 372.8 6.91 6.49 31 0.223 766K 3665 0.0 0.0 L1 4/4 374.32 MB 0.0 0.6 0.4 0.2 0.5 0.4 0.1 1.5 330.4 328.6 1.71 1.66 2 0.856 574K 3108 0.0 0.0 L2 1/0 40.17 MB 0.4 0.3 0.1 0.1 0.3 0.1 0.0 2.1 335.0 334.5 0.77 0.75 2 0.386 262K 402 0.0 0.0 L3 18/0 939.07 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 308.8 308.8 0.39 0.37 1 0.389 122K 0 0.0 0.0 L4 124/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 120/0 8.67 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 278/12 21.00 GB 0.0 1.7 0.6 1.1 3.4 2.4 0.1 1.9 173.7 359.5 9.78 9.27 36 0.272 1725K 7175 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.1 3.4 2.4 0.1 1.9 173.7 359.5 9.78 9.27 36 0.272 1725K 7175 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.1 1.7 0.6 0.0 0.0 331.3 329.9 5.13 5.00 8 0.641 1725K 7175 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 392.1 4.65 4.27 28 0.166 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.8 total, 5.7 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.43 GB write, 602.25 MB/s write, 1.66 GB read, 291.04 MB/s read, 9.8 seconds Interval compaction: 3.43 GB write, 612.23 MB/s write, 1.66 GB read, 295.86 MB/s read, 9.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 459907 Average: 1.7238 StdDev: 6.53 Min: 0 Median: 1.0566 Max: 2040 Percentiles: P50: 1.06 P75: 1.61 P99: 3.92 P99.9: 8.29 P99.99: 14.17 ------------------------------------------------------ [ 0, 1 ] 218121 47.427% 47.427% ######### ( 1, 2 ] 208986 45.441% 92.868% ######### ( 2, 3 ] 21220 4.614% 97.482% # ( 3, 4 ] 7621 1.657% 99.139% ( 4, 6 ] 3033 0.659% 99.799% ( 6, 10 ] 816 0.177% 99.976% ( 10, 15 ] 78 0.017% 99.993% ( 15, 22 ] 14 0.003% 99.996% ( 22, 34 ] 1 0.000% 99.996% ( 34, 51 ] 4 0.001% 99.997% ( 51, 76 ] 2 0.000% 99.998% ( 76, 110 ] 3 0.001% 99.998% ( 110, 170 ] 48 0.010% 100.009% ( 170, 250 ] 41 0.009% 100.018% ( 250, 380 ] 19 0.004% 100.022% ( 380, 580 ] 25 0.005% 100.027% ( 580, 870 ] 2 0.000% 100.028% ( 1300, 1900 ] 2 0.000% 100.028% ( 1900, 2900 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 135801 Average: 1.6494 StdDev: 5.82 Min: 0 Median: 0.9273 Max: 655 Percentiles: P50: 0.93 P75: 1.52 P99: 3.51 P99.9: 5.91 P99.99: 309.61 ------------------------------------------------------ [ 0, 1 ] 73225 53.921% 53.921% ########### ( 1, 2 ] 55574 40.923% 94.844% ######## ( 2, 3 ] 4868 3.585% 98.429% # ( 3, 4 ] 1514 1.115% 99.543% ( 4, 6 ] 506 0.373% 99.916% ( 6, 10 ] 41 0.030% 99.946% ( 10, 15 ] 1 0.001% 99.947% ( 34, 51 ] 1 0.001% 99.948% ( 51, 76 ] 1 0.001% 99.948% ( 76, 110 ] 1 0.001% 99.949% ( 110, 170 ] 30 0.022% 99.971% ( 170, 250 ] 19 0.014% 99.985% ( 250, 380 ] 14 0.010% 99.996% ( 380, 580 ] 4 0.003% 99.999% ( 580, 870 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 64210 Average: 1.8213 StdDev: 16.58 Min: 0 Median: 0.9058 Max: 3420 Percentiles: P50: 0.91 P75: 1.52 P99: 4.04 P99.9: 93.39 P99.99: 327.54 ------------------------------------------------------ [ 0, 1 ] 35443 55.199% 55.199% ########### ( 1, 2 ] 24539 38.217% 93.415% ######## ( 2, 3 ] 2609 4.063% 97.479% # ( 3, 4 ] 967 1.506% 98.985% ( 4, 6 ] 468 0.729% 99.713% ( 6, 10 ] 102 0.159% 99.872% ( 10, 15 ] 4 0.006% 99.879% ( 15, 22 ] 1 0.002% 99.880% ( 76, 110 ] 25 0.039% 99.919% ( 110, 170 ] 28 0.044% 99.963% ( 170, 250 ] 14 0.022% 99.984% ( 250, 380 ] 6 0.009% 99.994% ( 380, 580 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 957.3778 StdDev: 1308.49 Min: 0 Median: 266.2500 Max: 5019 Percentiles: P50: 266.25 P75: 1280.45 P99: 4620.00 P99.9: 5019.00 P99.99: 5019.00 ------------------------------------------------------ [ 0, 1 ] 20 22.222% 22.222% #### ( 1, 2 ] 5 5.556% 27.778% # ( 4, 6 ] 5 5.556% 33.333% # ( 6, 10 ] 6 6.667% 40.000% # ( 10, 15 ] 1 1.111% 41.111% ( 110, 170 ] 5 5.556% 46.667% # ( 170, 250 ] 2 2.222% 48.889% ( 250, 380 ] 8 8.889% 57.778% ## ( 380, 580 ] 3 3.333% 61.111% # ( 580, 870 ] 2 2.222% 63.333% ( 870, 1300 ] 11 12.222% 75.556% ## ( 1300, 1900 ] 2 2.222% 77.778% ( 1900, 2900 ] 7 7.778% 85.556% ## ( 2900, 4400 ] 12 13.333% 98.889% ### ( 4400, 6600 ] 1 1.111% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1695.5200 StdDev: 1353.49 Min: 103 Median: 1400.0000 Max: 4732 Percentiles: P50: 1400.00 P75: 2650.00 P99: 4732.00 P99.9: 4732.00 P99.99: 4732.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 1 4.000% 8.000% # ( 250, 380 ] 5 20.000% 28.000% #### ( 380, 580 ] 1 4.000% 32.000% # ( 580, 870 ] 1 4.000% 36.000% # ( 870, 1300 ] 3 12.000% 48.000% ## ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 5 20.000% 80.000% #### ( 2900, 4400 ] 3 12.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 5.8 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 337.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.123 H:M:S, 2.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.118 H:M:S, 3.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-17:05:53 ... thread 0: (1000000,3000000) ops and (369794.4,355296.8) ops/second in (2.704205,8.443645) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.78 GB 31.3 1.5 0.0 1.5 4.2 2.8 0.0 1.5 127.7 366.5 11.82 11.08 48 0.246 1533K 7364 0.0 0.0 L1 4/4 347.46 MB 0.0 1.4 0.9 0.5 1.4 0.8 0.1 1.6 329.4 325.6 4.38 4.25 3 1.459 1464K 16K 0.0 0.0 L2 1/1 40.17 MB 0.0 0.3 0.1 0.1 0.3 0.1 0.5 2.1 335.0 334.5 0.77 0.75 2 0.386 262K 402 0.0 0.0 L3 25/10 1.42 GB 0.6 0.7 0.6 0.1 0.7 0.6 0.0 1.2 292.4 291.1 2.51 2.35 3 0.837 745K 3291 0.0 0.0 L4 124/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 120/0 8.67 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 286/25 21.96 GB 0.0 3.9 1.6 2.3 6.6 4.3 0.6 2.4 202.5 346.3 19.48 18.44 56 0.348 4005K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.6 2.3 6.6 4.3 0.6 2.4 202.5 346.3 19.48 18.44 56 0.348 4005K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.6 2.3 3.8 1.6 0.0 0.0 321.9 319.6 12.25 11.86 14 0.875 4005K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 391.7 7.23 6.57 42 0.172 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.5 total, 8.4 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.59 GB write, 789.80 MB/s write, 3.85 GB read, 461.73 MB/s read, 19.5 seconds Interval compaction: 6.59 GB write, 798.71 MB/s write, 3.85 GB read, 466.94 MB/s read, 19.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 749598 Average: 1.9837 StdDev: 8.79 Min: 0 Median: 1.2053 Max: 2040 Percentiles: P50: 1.21 P75: 1.72 P99: 5.00 P99.9: 9.53 P99.99: 175.44 ------------------------------------------------------ [ 0, 1 ] 299599 39.968% 39.968% ######## ( 1, 2 ] 366246 48.859% 88.827% ########## ( 2, 3 ] 49542 6.609% 95.436% # ( 3, 4 ] 21824 2.911% 98.348% # ( 4, 6 ] 9756 1.301% 99.649% ( 6, 10 ] 2130 0.284% 99.933% ( 10, 15 ] 202 0.027% 99.960% ( 15, 22 ] 25 0.003% 99.963% ( 22, 34 ] 6 0.001% 99.964% ( 34, 51 ] 4 0.001% 99.965% ( 51, 76 ] 5 0.001% 99.965% ( 76, 110 ] 9 0.001% 99.967% ( 110, 170 ] 163 0.022% 99.988% ( 170, 250 ] 177 0.024% 100.012% ( 250, 380 ] 119 0.016% 100.028% ( 380, 580 ] 71 0.009% 100.037% ( 580, 870 ] 12 0.002% 100.039% ( 870, 1300 ] 4 0.001% 100.039% ( 1300, 1900 ] 3 0.000% 100.040% ( 1900, 2900 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 273700 Average: 1.9966 StdDev: 9.55 Min: 0 Median: 1.0226 Max: 877 Percentiles: P50: 1.02 P75: 1.63 P99: 5.01 P99.9: 155.32 P99.99: 402.87 ------------------------------------------------------ [ 0, 1 ] 134317 49.075% 49.075% ########## ( 1, 2 ] 111853 40.867% 89.942% ######## ( 2, 3 ] 16124 5.891% 95.833% # ( 3, 4 ] 6896 2.520% 98.352% # ( 4, 6 ] 3509 1.282% 99.634% ( 6, 10 ] 522 0.191% 99.825% ( 10, 15 ] 62 0.023% 99.848% ( 15, 22 ] 11 0.004% 99.852% ( 22, 34 ] 1 0.000% 99.852% ( 34, 51 ] 2 0.001% 99.853% ( 51, 76 ] 2 0.001% 99.853% ( 76, 110 ] 14 0.005% 99.859% ( 110, 170 ] 150 0.055% 99.913% ( 170, 250 ] 109 0.040% 99.953% ( 250, 380 ] 98 0.036% 99.989% ( 380, 580 ] 23 0.008% 99.997% ( 580, 870 ] 6 0.002% 100.000% ( 870, 1300 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 65259 Average: 2.2253 StdDev: 19.69 Min: 0 Median: 0.9199 Max: 3420 Percentiles: P50: 0.92 P75: 1.54 P99: 4.65 P99.9: 219.32 P99.99: 568.31 ------------------------------------------------------ [ 0, 1 ] 35471 54.354% 54.354% ########### ( 1, 2 ] 25141 38.525% 92.879% ######## ( 2, 3 ] 2796 4.284% 97.164% # ( 3, 4 ] 1033 1.583% 98.747% ( 4, 6 ] 509 0.780% 99.527% ( 6, 10 ] 116 0.178% 99.704% ( 10, 15 ] 6 0.009% 99.713% ( 15, 22 ] 1 0.002% 99.715% ( 76, 110 ] 26 0.040% 99.755% ( 110, 170 ] 67 0.103% 99.857% ( 170, 250 ] 45 0.069% 99.926% ( 250, 380 ] 33 0.051% 99.977% ( 380, 580 ] 9 0.014% 99.991% ( 580, 870 ] 3 0.005% 99.995% ( 870, 1300 ] 1 0.002% 99.997% ( 1300, 1900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 188830 Average: 3.4976 StdDev: 38.46 Min: 0 Median: 1.5164 Max: 5019 Percentiles: P50: 1.52 P75: 1.93 P99: 7.96 P99.9: 291.27 P99.99: 1523.40 ------------------------------------------------------ [ 0, 1 ] 35128 18.603% 18.603% #### ( 1, 2 ] 114798 60.794% 79.397% ############ ( 2, 3 ] 19743 10.455% 89.853% ## ( 3, 4 ] 10401 5.508% 95.361% # ( 4, 6 ] 6073 3.216% 98.577% # ( 6, 10 ] 1632 0.864% 99.441% ( 10, 15 ] 182 0.096% 99.538% ( 15, 22 ] 22 0.012% 99.549% ( 22, 34 ] 7 0.004% 99.553% ( 34, 51 ] 58 0.031% 99.584% ( 51, 76 ] 30 0.016% 99.600% ( 76, 110 ] 28 0.015% 99.614% ( 110, 170 ] 256 0.136% 99.750% ( 170, 250 ] 240 0.127% 99.877% ( 250, 380 ] 136 0.072% 99.949% ( 380, 580 ] 54 0.029% 99.978% ( 580, 870 ] 11 0.006% 99.984% ( 870, 1300 ] 11 0.006% 99.989% ( 1300, 1900 ] 3 0.002% 99.991% ( 1900, 2900 ] 7 0.004% 99.995% ( 2900, 4400 ] 12 0.006% 100.001% ( 4400, 6600 ] 1 0.001% 100.002% ** Level 4 read latency histogram (micros): Count: 25 Average: 1695.5200 StdDev: 1353.49 Min: 103 Median: 1400.0000 Max: 4732 Percentiles: P50: 1400.00 P75: 2650.00 P99: 4732.00 P99.9: 4732.00 P99.99: 4732.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 1 4.000% 8.000% # ( 250, 380 ] 5 20.000% 28.000% #### ( 380, 580 ] 1 4.000% 32.000% # ( 580, 870 ] 1 4.000% 36.000% # ( 870, 1300 ] 3 12.000% 48.000% ## ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 5 20.000% 80.000% #### ( 2900, 4400 ] 3 12.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 8.5 total, 2.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 345.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.545 H:M:S, 6.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 363.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.422 H:M:S, 15.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-17:05:56 ... thread 0: (1000000,4000000) ops and (453268.1,375592.3) ops/second in (2.206200,10.649845) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.69 GB 106.4 2.3 0.0 2.3 5.9 3.7 0.0 1.6 143.3 375.0 16.24 15.15 66 0.246 2363K 11K 0.0 0.0 L1 4/4 347.46 MB 0.0 1.4 0.9 0.5 1.4 0.8 0.1 1.6 329.4 325.6 4.38 4.25 3 1.459 1464K 16K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.5 2.1 335.0 334.5 0.77 0.75 2 0.386 262K 402 0.0 0.0 L3 18/0 810.17 MB 0.8 1.6 0.7 0.9 1.5 0.7 0.0 2.3 275.0 273.6 5.79 5.42 4 1.448 1618K 8634 0.0 0.0 L4 127/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 128/0 9.29 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 295/18 22.88 GB 0.0 5.5 1.6 3.8 9.1 5.3 1.9 2.5 206.8 344.3 27.18 25.57 75 0.362 5708K 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.6 3.8 9.1 5.3 1.9 2.5 206.8 344.3 27.18 25.57 75 0.362 5708K 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.6 3.8 5.5 1.6 0.0 0.0 313.1 311.1 17.95 17.22 18 0.997 5708K 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 408.8 9.23 8.34 57 0.162 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.7 total, 10.7 interval Flush(GB): cumulative 3.686, interval 3.686 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.14 GB write, 870.59 MB/s write, 5.49 GB read, 522.96 MB/s read, 27.2 seconds Interval compaction: 9.14 GB write, 878.37 MB/s write, 5.49 GB read, 527.63 MB/s read, 27.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1122076 Average: 2.0841 StdDev: 10.03 Min: 0 Median: 1.2340 Max: 2040 Percentiles: P50: 1.23 P75: 1.74 P99: 5.16 P99.9: 9.58 P99.99: 146.51 ------------------------------------------------------ [ 0, 1 ] 431031 38.414% 38.414% ######## ( 1, 2 ] 555515 49.508% 87.921% ########## ( 2, 3 ] 79425 7.078% 95.000% # ( 3, 4 ] 35370 3.152% 98.152% # ( 4, 6 ] 16450 1.466% 99.618% ( 6, 10 ] 3538 0.315% 99.933% ( 10, 15 ] 367 0.033% 99.966% ( 15, 22 ] 53 0.005% 99.971% ( 22, 34 ] 24 0.002% 99.973% ( 34, 51 ] 12 0.001% 99.974% ( 51, 76 ] 6 0.001% 99.975% ( 76, 110 ] 19 0.002% 99.976% ( 110, 170 ] 256 0.023% 99.999% ( 170, 250 ] 324 0.029% 100.028% ( 250, 380 ] 275 0.025% 100.052% ( 380, 580 ] 154 0.014% 100.066% ( 580, 870 ] 33 0.003% 100.069% ( 870, 1300 ] 8 0.001% 100.070% ( 1300, 1900 ] 3 0.000% 100.070% ( 1900, 2900 ] 1 0.000% 100.070% ** Level 1 read latency histogram (micros): Count: 295764 Average: 2.0191 StdDev: 9.47 Min: 0 Median: 1.0514 Max: 877 Percentiles: P50: 1.05 P75: 1.65 P99: 5.09 P99.9: 154.50 P99.99: 391.86 ------------------------------------------------------ [ 0, 1 ] 141509 47.845% 47.845% ########## ( 1, 2 ] 123898 41.891% 89.736% ######## ( 2, 3 ] 17711 5.988% 95.724% # ( 3, 4 ] 7548 2.552% 98.276% # ( 4, 6 ] 3945 1.334% 99.610% ( 6, 10 ] 605 0.205% 99.815% ( 10, 15 ] 67 0.023% 99.837% ( 15, 22 ] 12 0.004% 99.841% ( 22, 34 ] 1 0.000% 99.842% ( 34, 51 ] 2 0.001% 99.842% ( 51, 76 ] 2 0.001% 99.843% ( 76, 110 ] 34 0.011% 99.855% ( 110, 170 ] 181 0.061% 99.916% ( 170, 250 ] 117 0.040% 99.955% ( 250, 380 ] 101 0.034% 99.990% ( 380, 580 ] 24 0.008% 99.998% ( 580, 870 ] 6 0.002% 100.000% ( 870, 1300 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 74411 Average: 2.4956 StdDev: 21.18 Min: 0 Median: 1.0069 Max: 3420 Percentiles: P50: 1.01 P75: 1.61 P99: 5.31 P99.9: 275.44 P99.99: 686.01 ------------------------------------------------------ [ 0, 1 ] 36993 49.714% 49.714% ########## ( 1, 2 ] 30994 41.652% 91.367% ######## ( 2, 3 ] 3656 4.913% 96.280% # ( 3, 4 ] 1472 1.978% 98.258% ( 4, 6 ] 842 1.132% 99.390% ( 6, 10 ] 196 0.263% 99.653% ( 10, 15 ] 7 0.009% 99.663% ( 15, 22 ] 1 0.001% 99.664% ( 22, 34 ] 1 0.001% 99.665% ( 76, 110 ] 26 0.035% 99.700% ( 110, 170 ] 75 0.101% 99.801% ( 170, 250 ] 64 0.086% 99.887% ( 250, 380 ] 49 0.066% 99.953% ( 380, 580 ] 25 0.034% 99.987% ( 580, 870 ] 7 0.009% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233336 Average: 3.3488 StdDev: 35.24 Min: 0 Median: 1.5225 Max: 5019 Percentiles: P50: 1.52 P75: 1.93 P99: 7.81 P99.9: 268.39 P99.99: 1210.41 ------------------------------------------------------ [ 0, 1 ] 42095 18.041% 18.041% #### ( 1, 2 ] 142735 61.171% 79.212% ############ ( 2, 3 ] 24516 10.507% 89.719% ## ( 3, 4 ] 13033 5.586% 95.304% # ( 4, 6 ] 7698 3.299% 98.603% # ( 6, 10 ] 2051 0.879% 99.482% ( 10, 15 ] 229 0.098% 99.580% ( 15, 22 ] 25 0.011% 99.591% ( 22, 34 ] 7 0.003% 99.594% ( 34, 51 ] 92 0.039% 99.634% ( 51, 76 ] 45 0.019% 99.653% ( 76, 110 ] 38 0.016% 99.669% ( 110, 170 ] 260 0.111% 99.781% ( 170, 250 ] 259 0.111% 99.892% ( 250, 380 ] 139 0.060% 99.951% ( 380, 580 ] 64 0.027% 99.979% ( 580, 870 ] 14 0.006% 99.985% ( 870, 1300 ] 16 0.007% 99.991% ( 1300, 1900 ] 3 0.001% 99.993% ( 1900, 2900 ] 7 0.003% 99.996% ( 2900, 4400 ] 12 0.005% 100.001% ( 4400, 6600 ] 1 0.000% 100.001% ** Level 4 read latency histogram (micros): Count: 25 Average: 1695.5200 StdDev: 1353.49 Min: 103 Median: 1400.0000 Max: 4732 Percentiles: P50: 1400.00 P75: 2650.00 P99: 4732.00 P99.9: 4732.00 P99.99: 4732.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 1 4.000% 8.000% # ( 250, 380 ] 5 20.000% 28.000% #### ( 380, 580 ] 1 4.000% 32.000% # ( 580, 870 ] 1 4.000% 36.000% # ( 870, 1300 ] 3 12.000% 48.000% ## ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 5 20.000% 80.000% #### ( 2900, 4400 ] 3 12.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 487.7500 StdDev: 370.09 Min: 113 Median: 365.5556 Max: 1519 Percentiles: P50: 365.56 P75: 662.86 P99: 1519.00 P99.9: 1519.00 P99.99: 1519.00 ------------------------------------------------------ ( 110, 170 ] 7 17.500% 17.500% #### ( 170, 250 ] 5 12.500% 30.000% ### ( 250, 380 ] 9 22.500% 52.500% ##### ( 380, 580 ] 7 17.500% 70.000% #### ( 580, 870 ] 7 17.500% 87.500% #### ( 870, 1300 ] 2 5.000% 92.500% # ( 1300, 1900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 10.7 total, 2.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 366.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.545 H:M:S, 5.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 446.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-17:05:58 ... thread 0: (1000000,5000000) ops and (353932.8,371050.9) ops/second in (2.825395,13.475240) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.51 GB 6.3 3.3 0.0 3.3 7.9 4.7 0.0 1.7 156.1 379.2 21.35 20.00 85 0.251 3385K 16K 0.0 0.0 L1 15/15 1.45 GB 0.0 2.9 2.0 0.9 2.8 2.0 0.1 1.4 292.4 285.9 10.19 9.74 4 2.547 3025K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.5 2.1 335.0 334.5 0.77 0.75 2 0.386 262K 402 0.0 0.0 L3 18/0 810.17 MB 0.8 1.6 0.7 0.9 1.5 0.7 0.0 2.3 275.0 273.6 5.79 5.42 4 1.448 1618K 8634 0.0 0.0 L4 127/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 128/0 9.29 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 303/29 23.81 GB 0.0 8.0 2.8 5.2 12.6 7.4 1.9 2.7 214.3 337.3 38.11 35.90 95 0.401 8292K 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 2.8 5.2 12.6 7.4 1.9 2.7 214.3 337.3 38.11 35.90 95 0.401 8292K 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 2.8 5.2 7.9 2.7 0.0 0.0 305.2 301.8 26.75 25.65 23 1.163 8292K 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 420.9 11.36 10.26 72 0.158 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.6 total, 13.5 interval Flush(GB): cumulative 4.668, interval 4.668 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.55 GB write, 946.94 MB/s write, 7.97 GB read, 601.54 MB/s read, 38.1 seconds Interval compaction: 12.55 GB write, 953.63 MB/s write, 7.97 GB read, 605.79 MB/s read, 38.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 7, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1450743 Average: 2.1111 StdDev: 10.31 Min: 0 Median: 1.2239 Max: 2040 Percentiles: P50: 1.22 P75: 1.73 P99: 5.06 P99.9: 9.89 P99.99: 172.81 ------------------------------------------------------ [ 0, 1 ] 564298 38.897% 38.897% ######## ( 1, 2 ] 719474 49.593% 88.491% ########## ( 2, 3 ] 98563 6.794% 95.285% # ( 3, 4 ] 43510 2.999% 98.284% # ( 4, 6 ] 19592 1.350% 99.634% ( 6, 10 ] 3968 0.274% 99.908% ( 10, 15 ] 440 0.030% 99.938% ( 15, 22 ] 67 0.005% 99.943% ( 22, 34 ] 28 0.002% 99.945% ( 34, 51 ] 17 0.001% 99.946% ( 51, 76 ] 6 0.000% 99.946% ( 76, 110 ] 38 0.003% 99.949% ( 110, 170 ] 580 0.040% 99.989% ( 170, 250 ] 511 0.035% 100.024% ( 250, 380 ] 422 0.029% 100.053% ( 380, 580 ] 188 0.013% 100.066% ( 580, 870 ] 42 0.003% 100.069% ( 870, 1300 ] 8 0.001% 100.070% ( 1300, 1900 ] 4 0.000% 100.070% ( 1900, 2900 ] 1 0.000% 100.070% ** Level 1 read latency histogram (micros): Count: 379026 Average: 2.1151 StdDev: 11.96 Min: 0 Median: 1.0353 Max: 2050 Percentiles: P50: 1.04 P75: 1.64 P99: 5.17 P99.9: 175.79 P99.99: 492.08 ------------------------------------------------------ [ 0, 1 ] 183960 48.535% 48.535% ########## ( 1, 2 ] 157491 41.552% 90.086% ######## ( 2, 3 ] 21410 5.649% 95.735% # ( 3, 4 ] 9328 2.461% 98.196% ( 4, 6 ] 5187 1.369% 99.565% ( 6, 10 ] 707 0.187% 99.751% ( 10, 15 ] 137 0.036% 99.787% ( 15, 22 ] 21 0.006% 99.793% ( 22, 34 ] 6 0.002% 99.794% ( 34, 51 ] 6 0.002% 99.796% ( 51, 76 ] 2 0.001% 99.797% ( 76, 110 ] 74 0.020% 99.816% ( 110, 170 ] 304 0.080% 99.896% ( 170, 250 ] 193 0.051% 99.947% ( 250, 380 ] 138 0.036% 99.984% ( 380, 580 ] 43 0.011% 99.995% ( 580, 870 ] 14 0.004% 99.999% ( 870, 1300 ] 1 0.000% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 74411 Average: 2.4956 StdDev: 21.18 Min: 0 Median: 1.0069 Max: 3420 Percentiles: P50: 1.01 P75: 1.61 P99: 5.31 P99.9: 275.44 P99.99: 686.01 ------------------------------------------------------ [ 0, 1 ] 36993 49.714% 49.714% ########## ( 1, 2 ] 30994 41.652% 91.367% ######## ( 2, 3 ] 3656 4.913% 96.280% # ( 3, 4 ] 1472 1.978% 98.258% ( 4, 6 ] 842 1.132% 99.390% ( 6, 10 ] 196 0.263% 99.653% ( 10, 15 ] 7 0.009% 99.663% ( 15, 22 ] 1 0.001% 99.664% ( 22, 34 ] 1 0.001% 99.665% ( 76, 110 ] 26 0.035% 99.700% ( 110, 170 ] 75 0.101% 99.801% ( 170, 250 ] 64 0.086% 99.887% ( 250, 380 ] 49 0.066% 99.953% ( 380, 580 ] 25 0.034% 99.987% ( 580, 870 ] 7 0.009% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233336 Average: 3.3488 StdDev: 35.24 Min: 0 Median: 1.5225 Max: 5019 Percentiles: P50: 1.52 P75: 1.93 P99: 7.81 P99.9: 268.39 P99.99: 1210.41 ------------------------------------------------------ [ 0, 1 ] 42095 18.041% 18.041% #### ( 1, 2 ] 142735 61.171% 79.212% ############ ( 2, 3 ] 24516 10.507% 89.719% ## ( 3, 4 ] 13033 5.586% 95.304% # ( 4, 6 ] 7698 3.299% 98.603% # ( 6, 10 ] 2051 0.879% 99.482% ( 10, 15 ] 229 0.098% 99.580% ( 15, 22 ] 25 0.011% 99.591% ( 22, 34 ] 7 0.003% 99.594% ( 34, 51 ] 92 0.039% 99.634% ( 51, 76 ] 45 0.019% 99.653% ( 76, 110 ] 38 0.016% 99.669% ( 110, 170 ] 260 0.111% 99.781% ( 170, 250 ] 259 0.111% 99.892% ( 250, 380 ] 139 0.060% 99.951% ( 380, 580 ] 64 0.027% 99.979% ( 580, 870 ] 14 0.006% 99.985% ( 870, 1300 ] 16 0.007% 99.991% ( 1300, 1900 ] 3 0.001% 99.993% ( 1900, 2900 ] 7 0.003% 99.996% ( 2900, 4400 ] 12 0.005% 100.001% ( 4400, 6600 ] 1 0.000% 100.001% ** Level 4 read latency histogram (micros): Count: 25 Average: 1695.5200 StdDev: 1353.49 Min: 103 Median: 1400.0000 Max: 4732 Percentiles: P50: 1400.00 P75: 2650.00 P99: 4732.00 P99.9: 4732.00 P99.99: 4732.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 1 4.000% 8.000% # ( 250, 380 ] 5 20.000% 28.000% #### ( 380, 580 ] 1 4.000% 32.000% # ( 580, 870 ] 1 4.000% 36.000% # ( 870, 1300 ] 3 12.000% 48.000% ## ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 5 20.000% 80.000% #### ( 2900, 4400 ] 3 12.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 487.7500 StdDev: 370.09 Min: 113 Median: 365.5556 Max: 1519 Percentiles: P50: 365.56 P75: 662.86 P99: 1519.00 P99.9: 1519.00 P99.99: 1519.00 ------------------------------------------------------ ( 110, 170 ] 7 17.500% 17.500% #### ( 170, 250 ] 5 12.500% 30.000% ### ( 250, 380 ] 9 22.500% 52.500% ##### ( 380, 580 ] 7 17.500% 70.000% #### ( 580, 870 ] 7 17.500% 87.500% #### ( 870, 1300 ] 2 5.000% 92.500% # ( 1300, 1900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 13.6 total, 2.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 362.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.108 H:M:S, 8.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.562 H:M:S, 19.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-17:06:01 ... thread 0: (1000000,6000000) ops and (359591.2,369090.5) ops/second in (2.780936,16.256176) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.49 GB 106.5 4.2 0.0 4.2 9.9 5.6 0.0 1.7 162.3 377.9 26.74 25.10 105 0.255 4407K 21K 0.0 0.0 L1 15/15 1.45 GB 0.0 2.9 2.0 0.9 2.8 2.0 0.1 1.4 292.4 285.9 10.19 9.74 4 2.547 3025K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.1 0.3 0.1 0.5 2.1 335.0 334.5 0.77 0.75 2 0.386 262K 402 0.0 0.0 L3 18/0 810.17 MB 0.8 1.6 0.7 0.9 1.5 0.7 0.0 2.3 275.0 273.6 5.79 5.42 4 1.448 1618K 8634 0.0 0.0 L4 127/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 128/0 9.29 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 307/29 24.78 GB 0.0 9.0 2.8 6.2 14.5 8.4 1.9 2.6 210.9 341.7 43.50 41.00 115 0.378 9314K 97K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.0 2.8 6.2 14.5 8.4 1.9 2.6 210.9 341.7 43.50 41.00 115 0.378 9314K 97K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.0 2.8 6.2 8.9 2.7 0.0 0.0 305.9 302.6 29.98 28.82 27 1.111 9314K 97K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 428.3 13.51 12.18 88 0.154 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.3 interval Flush(GB): cumulative 5.651, interval 5.651 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.51 GB write, 908.71 MB/s write, 8.96 GB read, 560.80 MB/s read, 43.5 seconds Interval compaction: 14.51 GB write, 914.04 MB/s write, 8.96 GB read, 564.09 MB/s read, 43.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 7, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1886021 Average: 2.0894 StdDev: 9.90 Min: 0 Median: 1.2280 Max: 2040 Percentiles: P50: 1.23 P75: 1.73 P99: 4.96 P99.9: 9.65 P99.99: 159.85 ------------------------------------------------------ [ 0, 1 ] 727413 38.569% 38.569% ######## ( 1, 2 ] 945622 50.138% 88.707% ########## ( 2, 3 ] 126815 6.724% 95.431% # ( 3, 4 ] 55624 2.949% 98.380% # ( 4, 6 ] 24445 1.296% 99.676% ( 6, 10 ] 4616 0.245% 99.921% ( 10, 15 ] 515 0.027% 99.949% ( 15, 22 ] 77 0.004% 99.953% ( 22, 34 ] 31 0.002% 99.954% ( 34, 51 ] 23 0.001% 99.955% ( 51, 76 ] 7 0.000% 99.956% ( 76, 110 ] 58 0.003% 99.959% ( 110, 170 ] 707 0.037% 99.996% ( 170, 250 ] 658 0.035% 100.031% ( 250, 380 ] 507 0.027% 100.058% ( 380, 580 ] 220 0.012% 100.070% ( 580, 870 ] 50 0.003% 100.072% ( 870, 1300 ] 11 0.001% 100.073% ( 1300, 1900 ] 4 0.000% 100.073% ( 1900, 2900 ] 1 0.000% 100.073% ** Level 1 read latency histogram (micros): Count: 451498 Average: 2.1924 StdDev: 12.47 Min: 0 Median: 1.0475 Max: 2050 Percentiles: P50: 1.05 P75: 1.64 P99: 5.25 P99.9: 200.07 P99.99: 508.55 ------------------------------------------------------ [ 0, 1 ] 216740 48.005% 48.005% ########## ( 1, 2 ] 189598 41.993% 89.998% ######## ( 2, 3 ] 25403 5.626% 95.624% # ( 3, 4 ] 11206 2.482% 98.106% ( 4, 6 ] 6442 1.427% 99.533% ( 6, 10 ] 833 0.184% 99.717% ( 10, 15 ] 150 0.033% 99.751% ( 15, 22 ] 25 0.006% 99.756% ( 22, 34 ] 6 0.001% 99.757% ( 34, 51 ] 6 0.001% 99.759% ( 51, 76 ] 2 0.000% 99.759% ( 76, 110 ] 108 0.024% 99.783% ( 110, 170 ] 420 0.093% 99.876% ( 170, 250 ] 286 0.063% 99.940% ( 250, 380 ] 188 0.042% 99.981% ( 380, 580 ] 62 0.014% 99.995% ( 580, 870 ] 18 0.004% 99.999% ( 870, 1300 ] 1 0.000% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 74411 Average: 2.4956 StdDev: 21.18 Min: 0 Median: 1.0069 Max: 3420 Percentiles: P50: 1.01 P75: 1.61 P99: 5.31 P99.9: 275.44 P99.99: 686.01 ------------------------------------------------------ [ 0, 1 ] 36993 49.714% 49.714% ########## ( 1, 2 ] 30994 41.652% 91.367% ######## ( 2, 3 ] 3656 4.913% 96.280% # ( 3, 4 ] 1472 1.978% 98.258% ( 4, 6 ] 842 1.132% 99.390% ( 6, 10 ] 196 0.263% 99.653% ( 10, 15 ] 7 0.009% 99.663% ( 15, 22 ] 1 0.001% 99.664% ( 22, 34 ] 1 0.001% 99.665% ( 76, 110 ] 26 0.035% 99.700% ( 110, 170 ] 75 0.101% 99.801% ( 170, 250 ] 64 0.086% 99.887% ( 250, 380 ] 49 0.066% 99.953% ( 380, 580 ] 25 0.034% 99.987% ( 580, 870 ] 7 0.009% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 233336 Average: 3.3488 StdDev: 35.24 Min: 0 Median: 1.5225 Max: 5019 Percentiles: P50: 1.52 P75: 1.93 P99: 7.81 P99.9: 268.39 P99.99: 1210.41 ------------------------------------------------------ [ 0, 1 ] 42095 18.041% 18.041% #### ( 1, 2 ] 142735 61.171% 79.212% ############ ( 2, 3 ] 24516 10.507% 89.719% ## ( 3, 4 ] 13033 5.586% 95.304% # ( 4, 6 ] 7698 3.299% 98.603% # ( 6, 10 ] 2051 0.879% 99.482% ( 10, 15 ] 229 0.098% 99.580% ( 15, 22 ] 25 0.011% 99.591% ( 22, 34 ] 7 0.003% 99.594% ( 34, 51 ] 92 0.039% 99.634% ( 51, 76 ] 45 0.019% 99.653% ( 76, 110 ] 38 0.016% 99.669% ( 110, 170 ] 260 0.111% 99.781% ( 170, 250 ] 259 0.111% 99.892% ( 250, 380 ] 139 0.060% 99.951% ( 380, 580 ] 64 0.027% 99.979% ( 580, 870 ] 14 0.006% 99.985% ( 870, 1300 ] 16 0.007% 99.991% ( 1300, 1900 ] 3 0.001% 99.993% ( 1900, 2900 ] 7 0.003% 99.996% ( 2900, 4400 ] 12 0.005% 100.001% ( 4400, 6600 ] 1 0.000% 100.001% ** Level 4 read latency histogram (micros): Count: 25 Average: 1695.5200 StdDev: 1353.49 Min: 103 Median: 1400.0000 Max: 4732 Percentiles: P50: 1400.00 P75: 2650.00 P99: 4732.00 P99.9: 4732.00 P99.99: 4732.00 ------------------------------------------------------ ( 76, 110 ] 1 4.000% 4.000% # ( 110, 170 ] 1 4.000% 8.000% # ( 250, 380 ] 5 20.000% 28.000% #### ( 380, 580 ] 1 4.000% 32.000% # ( 580, 870 ] 1 4.000% 36.000% # ( 870, 1300 ] 3 12.000% 48.000% ## ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 5 20.000% 80.000% #### ( 2900, 4400 ] 3 12.000% 92.000% ## ( 4400, 6600 ] 2 8.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 487.7500 StdDev: 370.09 Min: 113 Median: 365.5556 Max: 1519 Percentiles: P50: 365.56 P75: 662.86 P99: 1519.00 P99.9: 1519.00 P99.99: 1519.00 ------------------------------------------------------ ( 110, 170 ] 7 17.500% 17.500% #### ( 170, 250 ] 5 12.500% 30.000% ### ( 250, 380 ] 9 22.500% 52.500% ##### ( 380, 580 ] 7 17.500% 70.000% #### ( 580, 870 ] 7 17.500% 87.500% #### ( 870, 1300 ] 2 5.000% 92.500% # ( 1300, 1900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 16.4 total, 2.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 361.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.581 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.474 H:M:S, 17.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.033 micros/op 329720 ops/sec 20.026 seconds 6602999 operations; 319.5 MB/s Microseconds per write: Count: 6602999 Average: 3.0329 StdDev: 131.64 Min: 0 Median: 1.6228 Max: 199084 Percentiles: P50: 1.62 P75: 2.40 P99: 6.89 P99.9: 89.43 P99.99: 1208.24 ------------------------------------------------------ [ 0, 1 ] 1455475 22.043% 22.043% #### ( 1, 2 ] 2964116 44.890% 66.933% ######### ( 2, 3 ] 1321368 20.012% 86.945% #### ( 3, 4 ] 572214 8.666% 95.611% ## ( 4, 6 ] 213647 3.236% 98.846% # ( 6, 10 ] 45559 0.690% 99.536% ( 10, 15 ] 11618 0.176% 99.712% ( 15, 22 ] 6030 0.091% 99.804% ( 22, 34 ] 2922 0.044% 99.848% ( 34, 51 ] 423 0.006% 99.854% ( 51, 76 ] 1165 0.018% 99.872% ( 76, 110 ] 4705 0.071% 99.943% ( 110, 170 ] 713 0.011% 99.954% ( 170, 250 ] 164 0.002% 99.956% ( 250, 380 ] 48 0.001% 99.957% ( 380, 580 ] 10 0.000% 99.957% ( 580, 870 ] 8 0.000% 99.957% ( 870, 1300 ] 2738 0.041% 99.999% ( 1300, 1900 ] 5 0.000% 99.999% ( 1900, 2900 ] 63 0.001% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 260060 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6602999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6814294968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 210 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3784678 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 12920218106 rocksdb.compact.write.bytes COUNT : 12662082757 rocksdb.flush.write.bytes COUNT : 6793850863 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 17 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 105 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6748984320 rocksdb.memtable.garbage.bytes.at.flush COUNT : 11704320 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 12974072070 rocksdb.non.last.level.read.count COUNT : 3133688 rocksdb.block.checksum.compute.count COUNT : 3133285 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.243824 P95 : 3.553122 P99 : 5.807150 P100 : 199075.000000 COUNT : 6602999 SUM : 17425411 rocksdb.compaction.times.micros P50 : 797857.142857 P95 : 3600000.000000 P99 : 5812932.000000 P100 : 5812932.000000 COUNT : 30 SUM : 32264354 rocksdb.compaction.times.cpu_micros P50 : 782666.666667 P95 : 3600000.000000 P99 : 5490541.000000 P100 : 5490541.000000 COUNT : 30 SUM : 31061652 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 570.909091 P95 : 1260.071429 P99 : 1482.000000 P100 : 1482.000000 COUNT : 99 SUM : 65455 rocksdb.compaction.outfile.sync.micros P50 : 575.555556 P95 : 1194.153846 P99 : 1588.000000 P100 : 1658.000000 COUNT : 104 SUM : 66703 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.766667 P95 : 295.500000 P99 : 374.655556 P100 : 625.000000 COUNT : 137 SUM : 17873 rocksdb.table.open.io.micros P50 : 825.384615 P95 : 8525.000000 P99 : 13355.714286 P100 : 14063.000000 COUNT : 210 SUM : 362812 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.516388 P95 : 5.027643 P99 : 8.447090 P100 : 1311.000000 COUNT : 3133797 SUM : 11500178 rocksdb.read.block.get.micros P50 : 408.318584 P95 : 2025.000000 P99 : 4370.000000 P100 : 5197.000000 COUNT : 420 SUM : 250837 rocksdb.write.raw.block.micros P50 : 0.509385 P95 : 0.967832 P99 : 2.016505 P100 : 3068.000000 COUNT : 4714620 SUM : 6611252 rocksdb.numfiles.in.singlecompaction P50 : 3.481481 P95 : 10.000000 P99 : 25.000000 P100 : 25.000000 COUNT : 40 SUM : 189 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.598880 P95 : 1123.339051 P99 : 1273.707226 P100 : 198806.000000 COUNT : 23954 SUM : 3790312 rocksdb.sst.read.micros P50 : 1.222484 P95 : 3.012984 P99 : 5.437060 P100 : 5019.000000 COUNT : 3135594 SUM : 7467939 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6602999 SUM : 6814294968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 141935.483871 P95 : 251300.000000 P99 : 331903.000000 P100 : 331903.000000 COUNT : 99 SUM : 14979420 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 140 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0