[2024-11-18 10:51:52.604057] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-18 10:51:52.604270] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1443923 ] Set seed to 1731923512598845 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 10:51:52.712827] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 10:51:52.754334] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 10:51:52.754392] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1443923' to capture a snapshot of events at runtime. [2024-11-18 10:51:52.754403] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-18 10:51:52.754413] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-18 10:51:52.754421] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1443923 for offline analysis/debug. [2024-11-18 10:51:52.754513] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 10:51:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-10:51:59 ... thread 0: (1000000,1000000) ops and (337219.2,337219.2) ops/second in (2.965430,2.965430) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.98 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.3 2.51 2.27 12 0.209 0 0 0.0 0.0 L1 3/3 251.74 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 255.5 255.2 0.99 0.96 1 0.986 255K 196 0.0 0.0 L2 1/0 48.81 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 16/0 692.52 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.0 1.0 204.4 204.5 0.31 0.25 1 0.306 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.7 306.1 4.27 3.92 15 0.285 432K 223 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.7 306.1 4.27 3.92 15 0.285 432K 223 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 241.9 241.7 1.76 1.65 3 0.587 432K 223 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.3 2.51 2.27 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 416.29 MB/s write, 0.42 GB read, 135.60 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 440.80 MB/s write, 0.42 GB read, 143.59 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 106032 Average: 1.7886 StdDev: 20.07 Min: 0 Median: 1.0900 Max: 3648 Percentiles: P50: 1.09 P75: 1.58 P99: 3.47 P99.9: 9.85 P99.99: 338.32 ------------------------------------------------------ [ 0, 1 ] 48163 45.423% 45.423% ######### ( 1, 2 ] 53950 50.881% 96.304% ########## ( 2, 3 ] 2446 2.307% 98.611% ( 3, 4 ] 876 0.826% 99.437% ( 4, 6 ] 314 0.296% 99.733% ( 6, 10 ] 185 0.174% 99.908% ( 10, 15 ] 61 0.058% 99.965% ( 15, 22 ] 12 0.011% 99.976% ( 22, 34 ] 1 0.001% 99.977% ( 34, 51 ] 1 0.001% 99.978% ( 110, 170 ] 9 0.008% 99.987% ( 170, 250 ] 1 0.001% 99.988% ( 250, 380 ] 5 0.005% 99.992% ( 380, 580 ] 3 0.003% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 3 0.003% 100.001% ** Level 1 read latency histogram (micros): Count: 33110 Average: 2.1657 StdDev: 18.32 Min: 1 Median: 1.1423 Max: 1989 Percentiles: P50: 1.14 P75: 1.62 P99: 5.59 P99.9: 69.92 P99.99: 1051.57 ------------------------------------------------------ [ 0, 1 ] 14087 42.546% 42.546% ######### ( 1, 2 ] 17348 52.395% 94.941% ########## ( 2, 3 ] 926 2.797% 97.738% # ( 3, 4 ] 276 0.834% 98.571% ( 4, 6 ] 178 0.538% 99.109% ( 6, 10 ] 157 0.474% 99.583% ( 10, 15 ] 32 0.097% 99.680% ( 15, 22 ] 11 0.033% 99.713% ( 22, 34 ] 3 0.009% 99.722% ( 34, 51 ] 43 0.130% 99.852% ( 51, 76 ] 21 0.063% 99.915% ( 76, 110 ] 2 0.006% 99.921% ( 110, 170 ] 4 0.012% 99.934% ( 170, 250 ] 6 0.018% 99.952% ( 250, 380 ] 4 0.012% 99.964% ( 380, 580 ] 5 0.015% 99.979% ( 580, 870 ] 2 0.006% 99.985% ( 870, 1300 ] 4 0.012% 99.997% ( 1900, 2900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15898 Average: 1.7436 StdDev: 4.64 Min: 1 Median: 1.1337 Max: 485 Percentiles: P50: 1.13 P75: 1.63 P99: 3.92 P99.9: 10.96 P99.99: 226.41 ------------------------------------------------------ [ 0, 1 ] 6886 43.314% 43.314% ######### ( 1, 2 ] 7953 50.025% 93.339% ########## ( 2, 3 ] 730 4.592% 97.931% # ( 3, 4 ] 184 1.157% 99.088% ( 4, 6 ] 77 0.484% 99.572% ( 6, 10 ] 50 0.315% 99.887% ( 10, 15 ] 11 0.069% 99.956% ( 15, 22 ] 2 0.013% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 701.8250 StdDev: 1059.10 Min: 1 Median: 210.0000 Max: 4299 Percentiles: P50: 210.00 P75: 956.00 P99: 4160.00 P99.9: 4299.00 P99.99: 4299.00 ------------------------------------------------------ [ 0, 1 ] 10 12.500% 12.500% ### ( 1, 2 ] 21 26.250% 38.750% ##### ( 2, 3 ] 7 8.750% 47.500% ## ( 170, 250 ] 4 5.000% 52.500% # ( 250, 380 ] 6 7.500% 60.000% ## ( 380, 580 ] 6 7.500% 67.500% ## ( 580, 870 ] 5 6.250% 73.750% # ( 870, 1300 ] 5 6.250% 80.000% # ( 1300, 1900 ] 4 5.000% 85.000% # ( 1900, 2900 ] 7 8.750% 93.750% ## ( 2900, 4400 ] 5 6.250% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1591.9429 StdDev: 1041.78 Min: 256 Median: 1333.3333 Max: 4094 Percentiles: P50: 1333.33 P75: 1962.50 P99: 4094.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 4 11.429% 25.714% ## ( 870, 1300 ] 8 22.857% 48.571% ##### ( 1300, 1900 ] 9 25.714% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 313.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.406 H:M:S, 12.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.406 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-10:52:03 ... thread 0: (1000000,2000000) ops and (325508.9,331260.6) ops/second in (3.072113,6.037543) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.23 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.8 328.4 7.48 6.86 28 0.267 575K 607 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 247.7 247.2 3.31 3.23 2 1.653 831K 1434 0.0 0.0 L2 5/4 563.88 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 16/9 692.52 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 204.4 204.5 0.31 0.25 1 0.306 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1194/24 97.98 GB 0.0 1.5 0.6 0.9 3.4 2.5 0.7 1.8 134.9 298.2 11.56 10.78 32 0.361 1583K 2068 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.4 2.5 0.7 1.8 134.9 298.2 11.56 10.78 32 0.361 1583K 2068 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 252.7 252.4 6.17 5.97 6 1.029 1583K 2068 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.7 5.39 4.81 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.37 GB write, 554.84 MB/s write, 1.52 GB read, 251.03 MB/s read, 11.6 seconds Interval compaction: 3.37 GB write, 570.89 MB/s write, 1.52 GB read, 258.29 MB/s read, 11.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 414067 Average: 2.1655 StdDev: 13.39 Min: 0 Median: 1.4554 Max: 3648 Percentiles: P50: 1.46 P75: 1.86 P99: 5.65 P99.9: 10.27 P99.99: 14.90 ------------------------------------------------------ [ 0, 1 ] 91160 22.016% 22.016% #### ( 1, 2 ] 254421 61.444% 83.460% ############ ( 2, 3 ] 39994 9.659% 93.119% ## ( 3, 4 ] 15960 3.854% 96.973% # ( 4, 6 ] 10153 2.452% 99.425% ( 6, 10 ] 1945 0.470% 99.895% ( 10, 15 ] 403 0.097% 99.993% ( 15, 22 ] 44 0.011% 100.003% ( 22, 34 ] 9 0.002% 100.005% ( 34, 51 ] 5 0.001% 100.007% ( 51, 76 ] 1 0.000% 100.007% ( 110, 170 ] 12 0.003% 100.010% ( 170, 250 ] 10 0.002% 100.012% ( 250, 380 ] 11 0.003% 100.015% ( 380, 580 ] 7 0.002% 100.016% ( 580, 870 ] 5 0.001% 100.018% ( 870, 1300 ] 3 0.001% 100.018% ( 1300, 1900 ] 2 0.000% 100.019% ( 1900, 2900 ] 2 0.000% 100.019% ( 2900, 4400 ] 4 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 137078 Average: 2.3343 StdDev: 11.45 Min: 0 Median: 1.5176 Max: 1989 Percentiles: P50: 1.52 P75: 1.92 P99: 5.82 P99.9: 14.57 P99.99: 471.68 ------------------------------------------------------ [ 0, 1 ] 24586 17.936% 17.936% #### ( 1, 2 ] 84918 61.949% 79.884% ############ ( 2, 3 ] 16535 12.062% 91.947% ## ( 3, 4 ] 5919 4.318% 96.265% # ( 4, 6 ] 4127 3.011% 99.276% # ( 6, 10 ] 750 0.547% 99.823% ( 10, 15 ] 117 0.085% 99.908% ( 15, 22 ] 18 0.013% 99.921% ( 22, 34 ] 4 0.003% 99.924% ( 34, 51 ] 44 0.032% 99.956% ( 51, 76 ] 23 0.017% 99.973% ( 76, 110 ] 2 0.001% 99.974% ( 110, 170 ] 5 0.004% 99.978% ( 170, 250 ] 7 0.005% 99.983% ( 250, 380 ] 8 0.006% 99.989% ( 380, 580 ] 5 0.004% 99.993% ( 580, 870 ] 2 0.001% 99.994% ( 870, 1300 ] 6 0.004% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 15954 Average: 1.7475 StdDev: 4.63 Min: 1 Median: 1.1368 Max: 485 Percentiles: P50: 1.14 P75: 1.64 P99: 3.93 P99.9: 11.27 P99.99: 226.18 ------------------------------------------------------ [ 0, 1 ] 6886 43.162% 43.162% ######### ( 1, 2 ] 7974 49.981% 93.143% ########## ( 2, 3 ] 760 4.764% 97.906% # ( 3, 4 ] 188 1.178% 99.085% ( 4, 6 ] 77 0.483% 99.568% ( 6, 10 ] 50 0.313% 99.881% ( 10, 15 ] 12 0.075% 99.956% ( 15, 22 ] 2 0.013% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 91921 Average: 3.9326 StdDev: 40.93 Min: 1 Median: 1.6904 Max: 4299 Percentiles: P50: 1.69 P75: 2.37 P99: 9.53 P99.9: 272.58 P99.99: 1235.92 ------------------------------------------------------ [ 0, 1 ] 7962 8.662% 8.662% ## ( 1, 2 ] 55039 59.876% 68.538% ############ ( 2, 3 ] 15876 17.271% 85.810% ### ( 3, 4 ] 5636 6.131% 91.941% # ( 4, 6 ] 4906 5.337% 97.278% # ( 6, 10 ] 1795 1.953% 99.231% ( 10, 15 ] 237 0.258% 99.489% ( 15, 22 ] 52 0.057% 99.545% ( 22, 34 ] 28 0.030% 99.576% ( 34, 51 ] 4 0.004% 99.580% ( 76, 110 ] 69 0.075% 99.655% ( 110, 170 ] 167 0.182% 99.837% ( 170, 250 ] 52 0.057% 99.893% ( 250, 380 ] 35 0.038% 99.931% ( 380, 580 ] 30 0.033% 99.964% ( 580, 870 ] 17 0.018% 99.983% ( 870, 1300 ] 8 0.009% 99.991% ( 1300, 1900 ] 5 0.005% 99.997% ( 1900, 2900 ] 7 0.008% 100.004% ( 2900, 4400 ] 5 0.005% 100.010% ** Level 4 read latency histogram (micros): Count: 35 Average: 1591.9429 StdDev: 1041.78 Min: 256 Median: 1333.3333 Max: 4094 Percentiles: P50: 1333.33 P75: 1962.50 P99: 4094.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 4 11.429% 25.714% ## ( 870, 1300 ] 8 22.857% 48.571% ##### ( 1300, 1900 ] 9 25.714% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.795 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.390 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/18-10:52:06 ... thread 0: (1000000,3000000) ops and (325941.2,329468.3) ops/second in (3.068038,9.105581) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 1.4 0.0 1.4 4.1 2.8 0.0 1.5 103.5 314.9 13.40 12.38 44 0.304 1407K 1456 0.0 0.0 L1 10/0 865.63 MB 86.6 1.6 1.3 0.4 1.6 1.3 0.1 1.3 232.7 232.1 7.25 7.01 3 2.417 1713K 4356 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 34/0 982.89 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 211.4 211.3 6.32 5.59 4 1.579 1335K 617 0.0 0.0 L4 140/0 9.56 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/4 98.90 GB 0.0 4.4 2.0 2.4 7.2 4.7 1.2 2.6 164.8 267.8 27.43 25.42 52 0.528 4569K 6456 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 2.0 2.4 7.2 4.7 1.2 2.6 164.8 267.8 27.43 25.42 52 0.528 4569K 6456 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 2.0 2.4 4.4 2.0 0.0 0.0 233.8 233.4 19.34 18.21 13 1.487 4569K 6456 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.1 8.10 7.21 39 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.18 GB write, 791.73 MB/s write, 4.41 GB read, 487.04 MB/s read, 27.4 seconds Interval compaction: 7.18 GB write, 806.92 MB/s write, 4.41 GB read, 496.38 MB/s read, 27.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 769542 Average: 2.3013 StdDev: 11.70 Min: 0 Median: 1.5225 Max: 3648 Percentiles: P50: 1.52 P75: 1.93 P99: 5.82 P99.9: 11.94 P99.99: 16.32 ------------------------------------------------------ [ 0, 1 ] 135757 17.641% 17.641% #### ( 1, 2 ] 476596 61.932% 79.574% ############ ( 2, 3 ] 88336 11.479% 91.053% ## ( 3, 4 ] 37665 4.894% 95.947% # ( 4, 6 ] 25791 3.351% 99.299% # ( 6, 10 ] 4203 0.546% 99.845% ( 10, 15 ] 1096 0.142% 99.987% ( 15, 22 ] 112 0.015% 100.002% ( 22, 34 ] 14 0.002% 100.004% ( 34, 51 ] 6 0.001% 100.004% ( 51, 76 ] 5 0.001% 100.005% ( 76, 110 ] 24 0.003% 100.008% ( 110, 170 ] 90 0.012% 100.020% ( 170, 250 ] 30 0.004% 100.024% ( 250, 380 ] 25 0.003% 100.027% ( 380, 580 ] 14 0.002% 100.029% ( 580, 870 ] 13 0.002% 100.031% ( 870, 1300 ] 11 0.001% 100.032% ( 1300, 1900 ] 3 0.000% 100.032% ( 1900, 2900 ] 4 0.001% 100.033% ( 2900, 4400 ] 4 0.001% 100.033% ** Level 1 read latency histogram (micros): Count: 219870 Average: 2.5192 StdDev: 11.76 Min: 0 Median: 1.5868 Max: 1989 Percentiles: P50: 1.59 P75: 1.99 P99: 5.93 P99.9: 39.59 P99.99: 551.61 ------------------------------------------------------ [ 0, 1 ] 30224 13.746% 13.746% ### ( 1, 2 ] 135829 61.777% 75.523% ############ ( 2, 3 ] 31137 14.162% 89.685% ### ( 3, 4 ] 11829 5.380% 95.065% # ( 4, 6 ] 8977 4.083% 99.148% # ( 6, 10 ] 1389 0.632% 99.779% ( 10, 15 ] 215 0.098% 99.877% ( 15, 22 ] 28 0.013% 99.890% ( 22, 34 ] 7 0.003% 99.893% ( 34, 51 ] 46 0.021% 99.914% ( 51, 76 ] 24 0.011% 99.925% ( 76, 110 ] 54 0.025% 99.950% ( 110, 170 ] 36 0.016% 99.966% ( 170, 250 ] 25 0.011% 99.977% ( 250, 380 ] 16 0.007% 99.985% ( 380, 580 ] 14 0.006% 99.991% ( 580, 870 ] 10 0.005% 99.995% ( 870, 1300 ] 6 0.003% 99.998% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28295 Average: 2.1597 StdDev: 3.61 Min: 1 Median: 1.4441 Max: 485 Percentiles: P50: 1.44 P75: 1.91 P99: 5.85 P99.9: 11.06 P99.99: 176.82 ------------------------------------------------------ [ 0, 1 ] 7466 26.386% 26.386% ##### ( 1, 2 ] 15044 53.168% 79.555% ########### ( 2, 3 ] 2931 10.359% 89.913% ## ( 3, 4 ] 1444 5.103% 95.017% # ( 4, 6 ] 1220 4.312% 99.329% # ( 6, 10 ] 156 0.551% 99.880% ( 10, 15 ] 27 0.095% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180466 Average: 3.6528 StdDev: 32.02 Min: 1 Median: 1.7012 Max: 4299 Percentiles: P50: 1.70 P75: 2.41 P99: 9.27 P99.9: 236.56 P99.99: 693.83 ------------------------------------------------------ [ 0, 1 ] 13925 7.716% 7.716% ## ( 1, 2 ] 108820 60.299% 68.016% ############ ( 2, 3 ] 30748 17.038% 85.054% ### ( 3, 4 ] 12020 6.661% 91.714% # ( 4, 6 ] 10213 5.659% 97.373% # ( 6, 10 ] 3590 1.989% 99.363% ( 10, 15 ] 405 0.224% 99.587% ( 15, 22 ] 69 0.038% 99.625% ( 22, 34 ] 40 0.022% 99.648% ( 34, 51 ] 22 0.012% 99.660% ( 51, 76 ] 1 0.001% 99.660% ( 76, 110 ] 81 0.045% 99.705% ( 110, 170 ] 265 0.147% 99.852% ( 170, 250 ] 104 0.058% 99.910% ( 250, 380 ] 73 0.040% 99.950% ( 380, 580 ] 59 0.033% 99.983% ( 580, 870 ] 33 0.018% 100.001% ( 870, 1300 ] 12 0.007% 100.008% ( 1300, 1900 ] 7 0.004% 100.012% ( 1900, 2900 ] 7 0.004% 100.016% ( 2900, 4400 ] 5 0.003% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1591.9429 StdDev: 1041.78 Min: 256 Median: 1333.3333 Max: 4094 Percentiles: P50: 1333.33 P75: 1962.50 P99: 4094.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 4 11.429% 25.714% ## ( 870, 1300 ] 8 22.857% 48.571% ##### ( 1300, 1900 ] 9 25.714% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 608.8500 StdDev: 656.22 Min: 82 Median: 302.0000 Max: 2399 Percentiles: P50: 302.00 P75: 870.00 P99: 2399.00 P99.9: 2399.00 P99.99: 2399.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 5 25.000% 65.000% ##### ( 580, 870 ] 2 10.000% 75.000% ## ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 318.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.182 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/18-10:52:09 ... thread 0: (1000000,4000000) ops and (336390.8,331172.0) ops/second in (2.972733,12.078314) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.34 GB 62.9 2.2 0.0 2.2 5.9 3.8 0.0 1.6 114.7 314.5 19.22 17.85 61 0.315 2238K 2342 0.0 0.0 L1 10/10 865.63 MB 0.0 1.6 1.3 0.4 1.6 1.3 0.1 1.3 232.7 232.1 7.25 7.01 3 2.417 1713K 4356 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 34/0 982.89 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 211.4 211.3 6.32 5.59 4 1.579 1335K 617 0.0 0.0 L4 140/0 9.56 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/22 99.88 GB 0.0 5.2 2.0 3.2 9.0 5.7 1.2 2.4 160.5 275.9 33.26 30.88 69 0.482 5400K 7342 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 2.0 3.2 9.0 5.7 1.2 2.4 160.5 275.9 33.26 30.88 69 0.482 5400K 7342 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 2.0 3.2 5.2 2.0 0.0 0.0 238.7 238.3 22.37 21.17 16 1.398 5400K 7342 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 353.0 10.89 9.71 53 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.96 GB write, 748.67 MB/s write, 5.21 GB read, 435.72 MB/s read, 33.3 seconds Interval compaction: 8.96 GB write, 759.50 MB/s write, 5.21 GB read, 442.02 MB/s read, 33.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1047750 Average: 2.2583 StdDev: 12.18 Min: 0 Median: 1.5024 Max: 3756 Percentiles: P50: 1.50 P75: 1.90 P99: 5.73 P99.9: 11.11 P99.99: 16.62 ------------------------------------------------------ [ 0, 1 ] 192189 18.343% 18.343% #### ( 1, 2 ] 660146 63.006% 81.349% ############# ( 2, 3 ] 113001 10.785% 92.134% ## ( 3, 4 ] 45964 4.387% 96.521% # ( 4, 6 ] 29951 2.859% 99.380% # ( 6, 10 ] 5191 0.495% 99.875% ( 10, 15 ] 1175 0.112% 99.987% ( 15, 22 ] 122 0.012% 99.999% ( 22, 34 ] 16 0.002% 100.000% ( 34, 51 ] 7 0.001% 100.001% ( 51, 76 ] 7 0.001% 100.002% ( 76, 110 ] 34 0.003% 100.005% ( 110, 170 ] 112 0.011% 100.016% ( 170, 250 ] 39 0.004% 100.019% ( 250, 380 ] 30 0.003% 100.022% ( 380, 580 ] 19 0.002% 100.024% ( 580, 870 ] 20 0.002% 100.026% ( 870, 1300 ] 19 0.002% 100.028% ( 1300, 1900 ] 4 0.000% 100.028% ( 1900, 2900 ] 5 0.000% 100.029% ( 2900, 4400 ] 6 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 278548 Average: 2.5564 StdDev: 13.37 Min: 0 Median: 1.5614 Max: 3038 Percentiles: P50: 1.56 P75: 1.96 P99: 6.25 P99.9: 93.98 P99.99: 574.10 ------------------------------------------------------ [ 0, 1 ] 41438 14.876% 14.876% ### ( 1, 2 ] 174271 62.564% 77.441% ############# ( 2, 3 ] 36431 13.079% 90.519% ### ( 3, 4 ] 13508 4.849% 95.369% # ( 4, 6 ] 9976 3.581% 98.950% # ( 6, 10 ] 2218 0.796% 99.747% ( 10, 15 ] 241 0.087% 99.833% ( 15, 22 ] 31 0.011% 99.844% ( 22, 34 ] 7 0.003% 99.847% ( 34, 51 ] 46 0.017% 99.863% ( 51, 76 ] 30 0.011% 99.874% ( 76, 110 ] 137 0.049% 99.923% ( 110, 170 ] 99 0.036% 99.959% ( 170, 250 ] 37 0.013% 99.972% ( 250, 380 ] 22 0.008% 99.980% ( 380, 580 ] 29 0.010% 99.990% ( 580, 870 ] 14 0.005% 99.995% ( 870, 1300 ] 8 0.003% 99.998% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28295 Average: 2.1597 StdDev: 3.61 Min: 1 Median: 1.4441 Max: 485 Percentiles: P50: 1.44 P75: 1.91 P99: 5.85 P99.9: 11.06 P99.99: 176.82 ------------------------------------------------------ [ 0, 1 ] 7466 26.386% 26.386% ##### ( 1, 2 ] 15044 53.168% 79.555% ########### ( 2, 3 ] 2931 10.359% 89.913% ## ( 3, 4 ] 1444 5.103% 95.017% # ( 4, 6 ] 1220 4.312% 99.329% # ( 6, 10 ] 156 0.551% 99.880% ( 10, 15 ] 27 0.095% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180466 Average: 3.6528 StdDev: 32.02 Min: 1 Median: 1.7012 Max: 4299 Percentiles: P50: 1.70 P75: 2.41 P99: 9.27 P99.9: 236.56 P99.99: 693.83 ------------------------------------------------------ [ 0, 1 ] 13925 7.716% 7.716% ## ( 1, 2 ] 108820 60.299% 68.016% ############ ( 2, 3 ] 30748 17.038% 85.054% ### ( 3, 4 ] 12020 6.661% 91.714% # ( 4, 6 ] 10213 5.659% 97.373% # ( 6, 10 ] 3590 1.989% 99.363% ( 10, 15 ] 405 0.224% 99.587% ( 15, 22 ] 69 0.038% 99.625% ( 22, 34 ] 40 0.022% 99.648% ( 34, 51 ] 22 0.012% 99.660% ( 51, 76 ] 1 0.001% 99.660% ( 76, 110 ] 81 0.045% 99.705% ( 110, 170 ] 265 0.147% 99.852% ( 170, 250 ] 104 0.058% 99.910% ( 250, 380 ] 73 0.040% 99.950% ( 380, 580 ] 59 0.033% 99.983% ( 580, 870 ] 33 0.018% 100.001% ( 870, 1300 ] 12 0.007% 100.008% ( 1300, 1900 ] 7 0.004% 100.012% ( 1900, 2900 ] 7 0.004% 100.016% ( 2900, 4400 ] 5 0.003% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1591.9429 StdDev: 1041.78 Min: 256 Median: 1333.3333 Max: 4094 Percentiles: P50: 1333.33 P75: 1962.50 P99: 4094.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 4 11.429% 25.714% ## ( 870, 1300 ] 8 22.857% 48.571% ##### ( 1300, 1900 ] 9 25.714% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 608.8500 StdDev: 656.22 Min: 82 Median: 302.0000 Max: 2399 Percentiles: P50: 302.00 P75: 870.00 P99: 2399.00 P99.9: 2399.00 P99.99: 2399.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 5 25.000% 65.000% ##### ( 580, 870 ] 2 10.000% 75.000% ## ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.3 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.558 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.375 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-10:52:12 ... thread 0: (1000000,5000000) ops and (293392.1,322857.2) ops/second in (3.408408,15.486722) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.32 GB 169.9 3.3 0.0 3.3 8.0 4.7 0.0 1.7 126.7 310.7 26.35 24.60 80 0.329 3390K 3582 0.0 0.0 L1 10/10 865.63 MB 0.0 1.6 1.3 0.4 1.6 1.3 0.1 1.3 232.7 232.1 7.25 7.01 3 2.417 1713K 4356 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 34/0 982.89 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 211.4 211.3 6.32 5.59 4 1.579 1335K 617 0.0 0.0 L4 140/0 9.56 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/22 100.86 GB 0.0 6.3 2.0 4.4 11.0 6.7 1.2 2.3 160.3 280.2 40.38 37.63 88 0.459 6551K 8582 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 2.0 4.4 11.0 6.7 1.2 2.3 160.3 280.2 40.38 37.63 88 0.459 6551K 8582 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 2.0 4.4 6.3 2.0 0.0 0.0 243.1 242.7 26.63 25.36 20 1.332 6551K 8582 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.7 13.75 12.28 68 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.05 GB write, 722.42 MB/s write, 6.32 GB read, 413.30 MB/s read, 40.4 seconds Interval compaction: 11.05 GB write, 730.57 MB/s write, 6.32 GB read, 417.96 MB/s read, 40.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 20, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1449164 Average: 2.2800 StdDev: 12.16 Min: 0 Median: 1.5042 Max: 3756 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 11.42 P99.99: 67.81 ------------------------------------------------------ [ 0, 1 ] 256055 17.669% 17.669% #### ( 1, 2 ] 929290 64.126% 81.795% ############# ( 2, 3 ] 155728 10.746% 92.541% ## ( 3, 4 ] 60588 4.181% 96.722% # ( 4, 6 ] 38181 2.635% 99.357% # ( 6, 10 ] 7432 0.513% 99.870% ( 10, 15 ] 1550 0.107% 99.977% ( 15, 22 ] 152 0.010% 99.987% ( 22, 34 ] 24 0.002% 99.989% ( 34, 51 ] 9 0.001% 99.989% ( 51, 76 ] 15 0.001% 99.990% ( 76, 110 ] 130 0.009% 99.999% ( 110, 170 ] 192 0.013% 100.013% ( 170, 250 ] 94 0.006% 100.019% ( 250, 380 ] 68 0.005% 100.024% ( 380, 580 ] 45 0.003% 100.027% ( 580, 870 ] 34 0.002% 100.029% ( 870, 1300 ] 24 0.002% 100.031% ( 1300, 1900 ] 7 0.000% 100.031% ( 1900, 2900 ] 7 0.000% 100.032% ( 2900, 4400 ] 7 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 347503 Average: 2.5922 StdDev: 13.15 Min: 0 Median: 1.5603 Max: 3038 Percentiles: P50: 1.56 P75: 1.95 P99: 6.96 P99.9: 107.76 P99.99: 566.90 ------------------------------------------------------ [ 0, 1 ] 49678 14.296% 14.296% ### ( 1, 2 ] 221457 63.728% 78.024% ############# ( 2, 3 ] 44472 12.798% 90.821% ### ( 3, 4 ] 16018 4.609% 95.431% # ( 4, 6 ] 11604 3.339% 98.770% # ( 6, 10 ] 3324 0.957% 99.727% ( 10, 15 ] 282 0.081% 99.808% ( 15, 22 ] 38 0.011% 99.819% ( 22, 34 ] 9 0.003% 99.821% ( 34, 51 ] 47 0.014% 99.835% ( 51, 76 ] 35 0.010% 99.845% ( 76, 110 ] 205 0.059% 99.904% ( 110, 170 ] 169 0.049% 99.953% ( 170, 250 ] 54 0.016% 99.968% ( 250, 380 ] 37 0.011% 99.979% ( 380, 580 ] 42 0.012% 99.991% ( 580, 870 ] 18 0.005% 99.996% ( 870, 1300 ] 9 0.003% 99.999% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28295 Average: 2.1597 StdDev: 3.61 Min: 1 Median: 1.4441 Max: 485 Percentiles: P50: 1.44 P75: 1.91 P99: 5.85 P99.9: 11.06 P99.99: 176.82 ------------------------------------------------------ [ 0, 1 ] 7466 26.386% 26.386% ##### ( 1, 2 ] 15044 53.168% 79.555% ########### ( 2, 3 ] 2931 10.359% 89.913% ## ( 3, 4 ] 1444 5.103% 95.017% # ( 4, 6 ] 1220 4.312% 99.329% # ( 6, 10 ] 156 0.551% 99.880% ( 10, 15 ] 27 0.095% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180466 Average: 3.6528 StdDev: 32.02 Min: 1 Median: 1.7012 Max: 4299 Percentiles: P50: 1.70 P75: 2.41 P99: 9.27 P99.9: 236.56 P99.99: 693.83 ------------------------------------------------------ [ 0, 1 ] 13925 7.716% 7.716% ## ( 1, 2 ] 108820 60.299% 68.016% ############ ( 2, 3 ] 30748 17.038% 85.054% ### ( 3, 4 ] 12020 6.661% 91.714% # ( 4, 6 ] 10213 5.659% 97.373% # ( 6, 10 ] 3590 1.989% 99.363% ( 10, 15 ] 405 0.224% 99.587% ( 15, 22 ] 69 0.038% 99.625% ( 22, 34 ] 40 0.022% 99.648% ( 34, 51 ] 22 0.012% 99.660% ( 51, 76 ] 1 0.001% 99.660% ( 76, 110 ] 81 0.045% 99.705% ( 110, 170 ] 265 0.147% 99.852% ( 170, 250 ] 104 0.058% 99.910% ( 250, 380 ] 73 0.040% 99.950% ( 380, 580 ] 59 0.033% 99.983% ( 580, 870 ] 33 0.018% 100.001% ( 870, 1300 ] 12 0.007% 100.008% ( 1300, 1900 ] 7 0.004% 100.012% ( 1900, 2900 ] 7 0.004% 100.016% ( 2900, 4400 ] 5 0.003% 100.018% ** Level 4 read latency histogram (micros): Count: 35 Average: 1591.9429 StdDev: 1041.78 Min: 256 Median: 1333.3333 Max: 4094 Percentiles: P50: 1333.33 P75: 1962.50 P99: 4094.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 4 11.429% 25.714% ## ( 870, 1300 ] 8 22.857% 48.571% ##### ( 1300, 1900 ] 9 25.714% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 608.8500 StdDev: 656.22 Min: 82 Median: 302.0000 Max: 2399 Percentiles: P50: 302.00 P75: 870.00 P99: 2399.00 P99.9: 2399.00 P99.99: 2399.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 2 10.000% 40.000% ## ( 250, 380 ] 5 25.000% 65.000% ##### ( 580, 870 ] 2 10.000% 75.000% ## ( 870, 1300 ] 2 10.000% 85.000% ## ( 1300, 1900 ] 2 10.000% 95.000% ## ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.7 total, 3.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.279 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.721 H:M:S, 21.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-10:52:17 ... thread 0: (1000000,6000000) ops and (208083.8,295676.1) ops/second in (4.805755,20.292477) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 2.83 GB 157.3 4.0 0.0 4.0 9.7 5.7 0.0 1.7 128.6 310.5 31.84 29.72 98 0.325 4157K 4343 0.0 0.0 L1 19/0 1.29 GB 131.8 3.9 2.7 1.2 3.9 2.7 0.1 1.4 229.6 228.1 17.42 16.73 4 4.356 4062K 26K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.5 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 19/5 1.13 GB 0.9 1.3 0.6 0.7 1.3 0.6 1.0 2.1 211.4 211.3 6.32 5.59 4 1.579 1335K 617 0.0 0.0 L4 155/4 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/18 101.77 GB 0.0 9.3 3.4 5.9 14.9 9.0 4.6 2.6 170.3 273.1 56.05 52.48 107 0.524 9668K 31K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.3 3.4 5.9 14.9 9.0 4.6 2.6 170.3 273.1 56.05 52.48 107 0.524 9668K 31K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.3 3.4 5.9 9.3 3.3 0.0 0.0 241.0 240.2 39.59 37.82 24 1.650 9668K 31K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.2 16.46 14.66 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.5 total, 20.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.95 GB write, 747.81 MB/s write, 9.32 GB read, 466.22 MB/s read, 56.1 seconds Interval compaction: 14.95 GB write, 754.25 MB/s write, 9.32 GB read, 470.23 MB/s read, 56.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 20, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1893096 Average: 2.2575 StdDev: 12.12 Min: 0 Median: 1.4979 Max: 3769 Percentiles: P50: 1.50 P75: 1.89 P99: 5.73 P99.9: 11.30 P99.99: 64.36 ------------------------------------------------------ [ 0, 1 ] 338983 17.906% 17.906% #### ( 1, 2 ] 1220320 64.462% 82.368% ############# ( 2, 3 ] 198610 10.491% 92.859% ## ( 3, 4 ] 75477 3.987% 96.846% # ( 4, 6 ] 47272 2.497% 99.343% ( 6, 10 ] 10026 0.530% 99.873% ( 10, 15 ] 1984 0.105% 99.978% ( 15, 22 ] 184 0.010% 99.987% ( 22, 34 ] 30 0.002% 99.989% ( 34, 51 ] 10 0.001% 99.989% ( 51, 76 ] 20 0.001% 99.990% ( 76, 110 ] 168 0.009% 99.999% ( 110, 170 ] 233 0.012% 100.012% ( 170, 250 ] 110 0.006% 100.017% ( 250, 380 ] 76 0.004% 100.021% ( 380, 580 ] 53 0.003% 100.024% ( 580, 870 ] 40 0.002% 100.026% ( 870, 1300 ] 27 0.001% 100.028% ( 1300, 1900 ] 7 0.000% 100.028% ( 1900, 2900 ] 11 0.001% 100.029% ( 2900, 4400 ] 9 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 466549 Average: 2.6814 StdDev: 14.84 Min: 0 Median: 1.5530 Max: 3038 Percentiles: P50: 1.55 P75: 1.94 P99: 7.48 P99.9: 134.83 P99.99: 684.23 ------------------------------------------------------ [ 0, 1 ] 68636 14.711% 14.711% ### ( 1, 2 ] 297713 63.812% 78.523% ############# ( 2, 3 ] 57687 12.365% 90.888% ## ( 3, 4 ] 20908 4.481% 95.369% # ( 4, 6 ] 15056 3.227% 98.596% # ( 6, 10 ] 5102 1.094% 99.690% ( 10, 15 ] 386 0.083% 99.773% ( 15, 22 ] 50 0.011% 99.783% ( 22, 34 ] 12 0.003% 99.786% ( 34, 51 ] 47 0.010% 99.796% ( 51, 76 ] 48 0.010% 99.806% ( 76, 110 ] 323 0.069% 99.875% ( 110, 170 ] 279 0.060% 99.935% ( 170, 250 ] 106 0.023% 99.958% ( 250, 380 ] 70 0.015% 99.973% ( 380, 580 ] 71 0.015% 99.988% ( 580, 870 ] 26 0.006% 99.994% ( 870, 1300 ] 20 0.004% 99.998% ( 1300, 1900 ] 7 0.002% 100.000% ( 1900, 2900 ] 2 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28295 Average: 2.1597 StdDev: 3.61 Min: 1 Median: 1.4441 Max: 485 Percentiles: P50: 1.44 P75: 1.91 P99: 5.85 P99.9: 11.06 P99.99: 176.82 ------------------------------------------------------ [ 0, 1 ] 7466 26.386% 26.386% ##### ( 1, 2 ] 15044 53.168% 79.555% ########### ( 2, 3 ] 2931 10.359% 89.913% ## ( 3, 4 ] 1444 5.103% 95.017% # ( 4, 6 ] 1220 4.312% 99.329% # ( 6, 10 ] 156 0.551% 99.880% ( 10, 15 ] 27 0.095% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 220573 Average: 4.0188 StdDev: 32.59 Min: 1 Median: 1.7074 Max: 4299 Percentiles: P50: 1.71 P75: 2.42 P99: 9.62 P99.9: 338.18 P99.99: 776.67 ------------------------------------------------------ [ 0, 1 ] 15859 7.190% 7.190% # ( 1, 2 ] 133488 60.519% 67.709% ############ ( 2, 3 ] 38100 17.273% 84.982% ### ( 3, 4 ] 14707 6.668% 91.649% # ( 4, 6 ] 12211 5.536% 97.186% # ( 6, 10 ] 4423 2.005% 99.191% ( 10, 15 ] 515 0.233% 99.424% ( 15, 22 ] 76 0.034% 99.459% ( 22, 34 ] 41 0.019% 99.477% ( 34, 51 ] 22 0.010% 99.487% ( 51, 76 ] 7 0.003% 99.490% ( 76, 110 ] 186 0.084% 99.575% ( 110, 170 ] 415 0.188% 99.763% ( 170, 250 ] 201 0.091% 99.854% ( 250, 380 ] 151 0.068% 99.922% ( 380, 580 ] 114 0.052% 99.974% ( 580, 870 ] 53 0.024% 99.998% ( 870, 1300 ] 19 0.009% 100.007% ( 1300, 1900 ] 8 0.004% 100.010% ( 1900, 2900 ] 8 0.004% 100.014% ( 2900, 4400 ] 5 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 1591.9429 StdDev: 1041.78 Min: 256 Median: 1333.3333 Max: 4094 Percentiles: P50: 1333.33 P75: 1962.50 P99: 4094.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ ( 250, 380 ] 3 8.571% 8.571% ## ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 4 11.429% 25.714% ## ( 870, 1300 ] 8 22.857% 48.571% ##### ( 1300, 1900 ] 9 25.714% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 60 Average: 723.3000 StdDev: 858.49 Min: 82 Median: 293.3333 Max: 2970 Percentiles: P50: 293.33 P75: 870.00 P99: 2970.00 P99.9: 2970.00 P99.99: 2970.00 ------------------------------------------------------ ( 76, 110 ] 11 18.333% 18.333% #### ( 110, 170 ] 7 11.667% 30.000% ## ( 170, 250 ] 9 15.000% 45.000% ### ( 250, 380 ] 9 15.000% 60.000% ### ( 380, 580 ] 4 6.667% 66.667% # ( 580, 870 ] 5 8.333% 75.000% ## ( 870, 1300 ] 2 3.333% 78.333% # ( 1300, 1900 ] 6 10.000% 88.333% ## ( 1900, 2900 ] 4 6.667% 95.000% # ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 20.5 total, 4.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 288.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.349 H:M:S, 21.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 204.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.070 H:M:S, 43.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/18-10:52:20 ... thread 0: (1000000,7000000) ops and (313893.1,298148.0) ops/second in (3.185798,23.478275) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 3.74 GB 358.2 6.1 0.0 6.1 12.7 6.6 0.0 1.9 146.2 304.1 42.64 40.05 117 0.364 6331K 10K 0.0 0.0 L1 19/0 1.29 GB 131.8 3.9 2.7 1.2 3.9 2.7 0.1 1.4 229.6 228.1 17.42 16.73 4 4.356 4062K 26K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.5 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 14/0 871.56 MB 0.9 1.3 0.6 0.7 1.3 0.6 1.0 2.1 211.4 211.3 6.32 5.59 4 1.579 1335K 617 0.0 0.0 L4 168/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 1.0 1.1 184.1 183.7 1.77 1.48 2 0.886 300K 828 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/4 102.68 GB 0.0 11.7 3.7 8.1 18.3 10.2 4.9 2.8 175.0 272.7 68.62 64.29 128 0.536 12M 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.7 3.7 8.1 18.3 10.2 4.9 2.8 175.0 272.7 68.62 64.29 128 0.536 12M 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.7 3.7 8.1 11.7 3.6 0.0 0.0 242.5 241.7 49.52 47.31 31 1.597 12M 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.9 19.10 16.98 97 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.7 total, 23.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.27 GB write, 791.07 MB/s write, 11.73 GB read, 507.73 MB/s read, 68.6 seconds Interval compaction: 18.27 GB write, 796.96 MB/s write, 11.73 GB read, 511.51 MB/s read, 68.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 22, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2326401 Average: 2.2440 StdDev: 11.85 Min: 0 Median: 1.4982 Max: 4112 Percentiles: P50: 1.50 P75: 1.88 P99: 5.69 P99.9: 10.64 P99.99: 18.83 ------------------------------------------------------ [ 0, 1 ] 411604 17.693% 17.693% #### ( 1, 2 ] 1508563 64.845% 82.538% ############# ( 2, 3 ] 243433 10.464% 93.002% ## ( 3, 4 ] 91563 3.936% 96.938% # ( 4, 6 ] 56748 2.439% 99.377% ( 6, 10 ] 11875 0.510% 99.888% ( 10, 15 ] 2262 0.097% 99.985% ( 15, 22 ] 220 0.009% 99.994% ( 22, 34 ] 37 0.002% 99.996% ( 34, 51 ] 13 0.001% 99.996% ( 51, 76 ] 22 0.001% 99.997% ( 76, 110 ] 175 0.008% 100.005% ( 110, 170 ] 239 0.010% 100.015% ( 170, 250 ] 122 0.005% 100.020% ( 250, 380 ] 82 0.004% 100.024% ( 380, 580 ] 62 0.003% 100.027% ( 580, 870 ] 49 0.002% 100.029% ( 870, 1300 ] 30 0.001% 100.030% ( 1300, 1900 ] 9 0.000% 100.030% ( 1900, 2900 ] 12 0.001% 100.031% ( 2900, 4400 ] 11 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 472497 Average: 2.6818 StdDev: 14.74 Min: 0 Median: 1.5558 Max: 3038 Percentiles: P50: 1.56 P75: 1.95 P99: 7.51 P99.9: 133.55 P99.99: 677.60 ------------------------------------------------------ [ 0, 1 ] 68792 14.559% 14.559% ### ( 1, 2 ] 301295 63.767% 78.326% ############# ( 2, 3 ] 58906 12.467% 90.793% ## ( 3, 4 ] 21370 4.523% 95.316% # ( 4, 6 ] 15429 3.265% 98.581% # ( 6, 10 ] 5235 1.108% 99.689% ( 10, 15 ] 403 0.085% 99.774% ( 15, 22 ] 55 0.012% 99.786% ( 22, 34 ] 12 0.003% 99.788% ( 34, 51 ] 47 0.010% 99.798% ( 51, 76 ] 48 0.010% 99.808% ( 76, 110 ] 323 0.068% 99.877% ( 110, 170 ] 279 0.059% 99.936% ( 170, 250 ] 106 0.022% 99.958% ( 250, 380 ] 70 0.015% 99.973% ( 380, 580 ] 71 0.015% 99.988% ( 580, 870 ] 26 0.006% 99.994% ( 870, 1300 ] 20 0.004% 99.998% ( 1300, 1900 ] 7 0.001% 99.999% ( 1900, 2900 ] 2 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28295 Average: 2.1597 StdDev: 3.61 Min: 1 Median: 1.4441 Max: 485 Percentiles: P50: 1.44 P75: 1.91 P99: 5.85 P99.9: 11.06 P99.99: 176.82 ------------------------------------------------------ [ 0, 1 ] 7466 26.386% 26.386% ##### ( 1, 2 ] 15044 53.168% 79.555% ########### ( 2, 3 ] 2931 10.359% 89.913% ## ( 3, 4 ] 1444 5.103% 95.017% # ( 4, 6 ] 1220 4.312% 99.329% # ( 6, 10 ] 156 0.551% 99.880% ( 10, 15 ] 27 0.095% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 230595 Average: 3.9616 StdDev: 31.88 Min: 1 Median: 1.7108 Max: 4299 Percentiles: P50: 1.71 P75: 2.43 P99: 9.58 P99.9: 326.97 P99.99: 754.77 ------------------------------------------------------ [ 0, 1 ] 16123 6.992% 6.992% # ( 1, 2 ] 139519 60.504% 67.496% ############ ( 2, 3 ] 40159 17.415% 84.911% ### ( 3, 4 ] 15501 6.722% 91.633% # ( 4, 6 ] 12838 5.567% 97.201% # ( 6, 10 ] 4636 2.010% 99.211% ( 10, 15 ] 548 0.238% 99.449% ( 15, 22 ] 79 0.034% 99.483% ( 22, 34 ] 41 0.018% 99.501% ( 34, 51 ] 22 0.010% 99.510% ( 51, 76 ] 7 0.003% 99.513% ( 76, 110 ] 186 0.081% 99.594% ( 110, 170 ] 415 0.180% 99.774% ( 170, 250 ] 201 0.087% 99.861% ( 250, 380 ] 151 0.065% 99.927% ( 380, 580 ] 114 0.049% 99.976% ( 580, 870 ] 53 0.023% 99.999% ( 870, 1300 ] 19 0.008% 100.007% ( 1300, 1900 ] 8 0.003% 100.011% ( 1900, 2900 ] 8 0.003% 100.014% ( 2900, 4400 ] 5 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 140 Average: 425.8286 StdDev: 855.72 Min: 0 Median: 5.5000 Max: 4094 Percentiles: P50: 5.50 P75: 380.00 P99: 3980.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ [ 0, 1 ] 31 22.143% 22.143% #### ( 1, 2 ] 27 19.286% 41.429% #### ( 2, 3 ] 6 4.286% 45.714% # ( 4, 6 ] 8 5.714% 51.429% # ( 6, 10 ] 4 2.857% 54.286% # ( 22, 34 ] 16 11.429% 65.714% ## ( 34, 51 ] 1 0.714% 66.429% ( 110, 170 ] 5 3.571% 70.000% # ( 170, 250 ] 3 2.143% 72.143% ( 250, 380 ] 4 2.857% 75.000% # ( 380, 580 ] 4 2.857% 77.857% # ( 580, 870 ] 5 3.571% 81.429% # ( 870, 1300 ] 8 5.714% 87.143% # ( 1300, 1900 ] 9 6.429% 93.571% # ( 1900, 2900 ] 4 2.857% 96.429% # ( 2900, 4400 ] 5 3.571% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 720.0375 StdDev: 868.42 Min: 82 Median: 276.0000 Max: 2970 Percentiles: P50: 276.00 P75: 870.00 P99: 2970.00 P99.9: 2970.00 P99.99: 2970.00 ------------------------------------------------------ ( 76, 110 ] 11 13.750% 13.750% ### ( 110, 170 ] 13 16.250% 30.000% ### ( 170, 250 ] 14 17.500% 47.500% #### ( 250, 380 ] 10 12.500% 60.000% ### ( 380, 580 ] 7 8.750% 68.750% ## ( 580, 870 ] 5 6.250% 75.000% # ( 870, 1300 ] 3 3.750% 78.750% # ( 1300, 1900 ] 7 8.750% 87.500% ## ( 1900, 2900 ] 6 7.500% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 23.7 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 291.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.859 H:M:S, 20.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 308.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.510 H:M:S, 16.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-10:52:32 ... thread 0: (1000000,8000000) ops and (81360.4,223655.7) ops/second in (12.290987,35.769262) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 21/20 4.85 GB 31.5 6.9 0.0 6.9 14.6 7.7 0.0 1.9 144.5 305.5 48.84 45.87 136 0.359 7163K 10K 0.0 0.0 L1 19/19 1.29 GB 0.0 3.9 2.7 1.2 3.9 2.7 0.1 1.4 229.6 228.1 17.42 16.73 4 4.356 4062K 26K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.5 1.8 237.7 237.6 0.47 0.44 1 0.469 113K 27 0.0 0.0 L3 14/0 871.56 MB 0.9 1.3 0.6 0.7 1.3 0.6 1.0 2.1 211.4 211.3 6.32 5.59 4 1.579 1335K 617 0.0 0.0 L4 168/0 9.63 GB 1.0 0.3 0.3 0.0 0.3 0.3 1.0 1.1 184.1 183.7 1.77 1.48 2 0.886 300K 828 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/39 103.79 GB 0.0 12.5 3.7 8.9 20.2 11.3 4.9 2.6 171.5 276.2 74.82 70.11 147 0.509 12M 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.5 3.7 8.9 20.2 11.3 4.9 2.6 171.5 276.2 74.82 70.11 147 0.509 12M 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.5 3.7 8.9 12.5 3.6 0.0 0.0 244.1 243.4 52.55 50.29 34 1.546 12M 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.7 7.7 0.0 0.0 0.0 353.7 22.26 19.81 113 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.9 total, 35.8 interval Flush(GB): cumulative 7.690, interval 7.690 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.18 GB write, 574.87 MB/s write, 12.53 GB read, 356.90 MB/s read, 74.8 seconds Interval compaction: 20.18 GB write, 577.68 MB/s write, 12.53 GB read, 358.64 MB/s read, 74.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 26, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3124504 Average: 2.1671 StdDev: 11.84 Min: 0 Median: 1.4423 Max: 4112 Percentiles: P50: 1.44 P75: 1.84 P99: 5.60 P99.9: 11.41 P99.99: 103.13 ------------------------------------------------------ [ 0, 1 ] 683024 21.860% 21.860% #### ( 1, 2 ] 1988021 63.627% 85.487% ############# ( 2, 3 ] 267897 8.574% 94.061% ## ( 3, 4 ] 102972 3.296% 97.357% # ( 4, 6 ] 64332 2.059% 99.416% ( 6, 10 ] 14325 0.458% 99.874% ( 10, 15 ] 2879 0.092% 99.966% ( 15, 22 ] 323 0.010% 99.977% ( 22, 34 ] 39 0.001% 99.978% ( 34, 51 ] 17 0.001% 99.978% ( 51, 76 ] 22 0.001% 99.979% ( 76, 110 ] 433 0.014% 99.993% ( 110, 170 ] 460 0.015% 100.008% ( 170, 250 ] 176 0.006% 100.013% ( 250, 380 ] 112 0.004% 100.017% ( 380, 580 ] 87 0.003% 100.020% ( 580, 870 ] 66 0.002% 100.022% ( 870, 1300 ] 35 0.001% 100.023% ( 1300, 1900 ] 10 0.000% 100.023% ( 1900, 2900 ] 17 0.001% 100.024% ( 2900, 4400 ] 15 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 528515 Average: 2.6358 StdDev: 14.27 Min: 0 Median: 1.5192 Max: 3038 Percentiles: P50: 1.52 P75: 1.92 P99: 7.41 P99.9: 139.64 P99.99: 624.56 ------------------------------------------------------ [ 0, 1 ] 92276 17.459% 17.459% ### ( 1, 2 ] 331252 62.676% 80.135% ############# ( 2, 3 ] 59663 11.289% 91.424% ## ( 3, 4 ] 21883 4.140% 95.565% # ( 4, 6 ] 16243 3.073% 98.638% # ( 6, 10 ] 5418 1.025% 99.663% ( 10, 15 ] 450 0.085% 99.748% ( 15, 22 ] 63 0.012% 99.760% ( 22, 34 ] 12 0.002% 99.763% ( 34, 51 ] 47 0.009% 99.771% ( 51, 76 ] 59 0.011% 99.783% ( 76, 110 ] 415 0.079% 99.861% ( 110, 170 ] 418 0.079% 99.940% ( 170, 250 ] 113 0.021% 99.962% ( 250, 380 ] 72 0.014% 99.975% ( 380, 580 ] 75 0.014% 99.989% ( 580, 870 ] 27 0.005% 99.995% ( 870, 1300 ] 20 0.004% 99.998% ( 1300, 1900 ] 7 0.001% 100.000% ( 1900, 2900 ] 2 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28295 Average: 2.1597 StdDev: 3.61 Min: 1 Median: 1.4441 Max: 485 Percentiles: P50: 1.44 P75: 1.91 P99: 5.85 P99.9: 11.06 P99.99: 176.82 ------------------------------------------------------ [ 0, 1 ] 7466 26.386% 26.386% ##### ( 1, 2 ] 15044 53.168% 79.555% ########### ( 2, 3 ] 2931 10.359% 89.913% ## ( 3, 4 ] 1444 5.103% 95.017% # ( 4, 6 ] 1220 4.312% 99.329% # ( 6, 10 ] 156 0.551% 99.880% ( 10, 15 ] 27 0.095% 99.975% ( 15, 22 ] 2 0.007% 99.982% ( 22, 34 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 230595 Average: 3.9616 StdDev: 31.88 Min: 1 Median: 1.7108 Max: 4299 Percentiles: P50: 1.71 P75: 2.43 P99: 9.58 P99.9: 326.97 P99.99: 754.77 ------------------------------------------------------ [ 0, 1 ] 16123 6.992% 6.992% # ( 1, 2 ] 139519 60.504% 67.496% ############ ( 2, 3 ] 40159 17.415% 84.911% ### ( 3, 4 ] 15501 6.722% 91.633% # ( 4, 6 ] 12838 5.567% 97.201% # ( 6, 10 ] 4636 2.010% 99.211% ( 10, 15 ] 548 0.238% 99.449% ( 15, 22 ] 79 0.034% 99.483% ( 22, 34 ] 41 0.018% 99.501% ( 34, 51 ] 22 0.010% 99.510% ( 51, 76 ] 7 0.003% 99.513% ( 76, 110 ] 186 0.081% 99.594% ( 110, 170 ] 415 0.180% 99.774% ( 170, 250 ] 201 0.087% 99.861% ( 250, 380 ] 151 0.065% 99.927% ( 380, 580 ] 114 0.049% 99.976% ( 580, 870 ] 53 0.023% 99.999% ( 870, 1300 ] 19 0.008% 100.007% ( 1300, 1900 ] 8 0.003% 100.011% ( 1900, 2900 ] 8 0.003% 100.014% ( 2900, 4400 ] 5 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 140 Average: 425.8286 StdDev: 855.72 Min: 0 Median: 5.5000 Max: 4094 Percentiles: P50: 5.50 P75: 380.00 P99: 3980.00 P99.9: 4094.00 P99.99: 4094.00 ------------------------------------------------------ [ 0, 1 ] 31 22.143% 22.143% #### ( 1, 2 ] 27 19.286% 41.429% #### ( 2, 3 ] 6 4.286% 45.714% # ( 4, 6 ] 8 5.714% 51.429% # ( 6, 10 ] 4 2.857% 54.286% # ( 22, 34 ] 16 11.429% 65.714% ## ( 34, 51 ] 1 0.714% 66.429% ( 110, 170 ] 5 3.571% 70.000% # ( 170, 250 ] 3 2.143% 72.143% ( 250, 380 ] 4 2.857% 75.000% # ( 380, 580 ] 4 2.857% 77.857% # ( 580, 870 ] 5 3.571% 81.429% # ( 870, 1300 ] 8 5.714% 87.143% # ( 1300, 1900 ] 9 6.429% 93.571% # ( 1900, 2900 ] 4 2.857% 96.429% # ( 2900, 4400 ] 5 3.571% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 720.0375 StdDev: 868.42 Min: 82 Median: 276.0000 Max: 2970 Percentiles: P50: 276.00 P75: 870.00 P99: 2970.00 P99.9: 2970.00 P99.99: 2970.00 ------------------------------------------------------ ( 76, 110 ] 11 13.750% 13.750% ### ( 110, 170 ] 13 16.250% 30.000% ### ( 170, 250 ] 14 17.500% 47.500% #### ( 250, 380 ] 10 12.500% 60.000% ### ( 380, 580 ] 7 8.750% 68.750% ## ( 580, 870 ] 5 6.250% 75.000% # ( 870, 1300 ] 3 3.750% 78.750% # ( 1300, 1900 ] 7 8.750% 87.500% ## ( 1900, 2900 ] 6 7.500% 95.000% ## ( 2900, 4400 ] 4 5.000% 100.000% # ** DB Stats ** Uptime(secs): 35.9 total, 12.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 219.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.153 H:M:S, 39.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 80.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.294 H:M:S, 75.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.789 micros/op 147296 ops/sec 60.823 seconds 8958999 operations; 142.7 MB/s Microseconds per write: Count: 8958999 Average: 6.7890 StdDev: 609.74 Min: 0 Median: 1.7407 Max: 918433 Percentiles: P50: 1.74 P75: 2.78 P99: 9.87 P99.9: 1227.98 P99.99: 2779.28 ------------------------------------------------------ [ 0, 1 ] 1216335 13.577% 13.577% ### ( 1, 2 ] 4405489 49.174% 62.751% ########## ( 2, 3 ] 1412755 15.769% 78.520% ### ( 3, 4 ] 1222304 13.643% 92.163% ### ( 4, 6 ] 496036 5.537% 97.700% # ( 6, 10 ] 120266 1.342% 99.042% ( 10, 15 ] 43387 0.484% 99.526% ( 15, 22 ] 9819 0.110% 99.636% ( 22, 34 ] 1865 0.021% 99.657% ( 34, 51 ] 227 0.003% 99.659% ( 51, 76 ] 36 0.000% 99.660% ( 76, 110 ] 5935 0.066% 99.726% ( 110, 170 ] 2669 0.030% 99.756% ( 170, 250 ] 277 0.003% 99.759% ( 250, 380 ] 196 0.002% 99.761% ( 380, 580 ] 26 0.000% 99.761% ( 580, 870 ] 17 0.000% 99.762% ( 870, 1300 ] 14896 0.166% 99.928% ( 1300, 1900 ] 48 0.001% 99.928% ( 1900, 2900 ] 6278 0.070% 99.998% ( 2900, 4400 ] 96 0.001% 100.000% ( 4400, 6600 ] 14 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 250522 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8958999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9245686968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 477 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35558672 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29016368633 rocksdb.compact.write.bytes COUNT : 28757591979 rocksdb.flush.write.bytes COUNT : 9181894925 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 212 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9107941376 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3616768 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29091335697 rocksdb.non.last.level.read.count COUNT : 7032513 rocksdb.block.checksum.compute.count COUNT : 7031586 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.394864 P95 : 3.962771 P99 : 8.635355 P100 : 918431.000000 COUNT : 8958999 SUM : 56588480 rocksdb.compaction.times.micros P50 : 1068387.096774 P95 : 3940000.000000 P99 : 24640000.000000 P100 : 28211513.000000 COUNT : 76 SUM : 136811785 rocksdb.compaction.times.cpu_micros P50 : 874166.666667 P95 : 3040000.000000 P99 : 24526867.000000 P100 : 24526867.000000 COUNT : 76 SUM : 106173734 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 671.901408 P95 : 8002.500000 P99 : 231600.000000 P100 : 392151.000000 COUNT : 123 SUM : 774751 rocksdb.compaction.outfile.sync.micros P50 : 1085.000000 P95 : 221111.111111 P99 : 438900.000000 P100 : 552981.000000 COUNT : 345 SUM : 11598004 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 101.803571 P95 : 2695.000000 P99 : 4031.666667 P100 : 4400.000000 COUNT : 221 SUM : 99529 rocksdb.table.open.io.micros P50 : 1521.739130 P95 : 5766.538462 P99 : 9138.250000 P100 : 13013.000000 COUNT : 477 SUM : 926102 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.628197 P95 : 8.056105 P99 : 12.898286 P100 : 15403.000000 COUNT : 7030465 SUM : 50680883 rocksdb.read.block.get.micros P50 : 427.916667 P95 : 3132.978723 P99 : 4350.851064 P100 : 6652.000000 COUNT : 954 SUM : 791512 rocksdb.write.raw.block.micros P50 : 0.515678 P95 : 0.979788 P99 : 2.902537 P100 : 17875.000000 COUNT : 9192564 SUM : 20469660 rocksdb.numfiles.in.singlecompaction P50 : 3.153846 P95 : 6.600000 P99 : 21.020000 P100 : 35.000000 COUNT : 128 SUM : 502 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.571603 P95 : 1236.932276 P99 : 2637.135767 P100 : 918237.000000 COUNT : 170285 SUM : 35578532 rocksdb.sst.read.micros P50 : 1.594176 P95 : 4.852706 P99 : 9.338920 P100 : 15397.000000 COUNT : 7033072 SUM : 36038390 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8958999 SUM : 9245686968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213678.160920 P95 : 526300.000000 P99 : 1050085.000000 P100 : 1050085.000000 COUNT : 123 SUM : 29025175 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 324 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0