[2024-08-12 23:42:49.482291] Starting SPDK v24.09-pre git sha1 7c739692e / DPDK 22.11.4 initialization... [2024-08-12 23:42:49.482554] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1922411 ] Set seed to 1723498969475688 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-08-12 23:42:49.581743] app.c: 910:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-08-12 23:42:49.621398] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-08-12 23:42:49.621444] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1922411' to capture a snapshot of events at runtime. [2024-08-12 23:42:49.621454] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-08-12 23:42:49.621465] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-08-12 23:42:49.621473] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1922411 for offline analysis/debug. [2024-08-12 23:42:49.621556] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Aug 12 23:42:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/08/12-23:42:56 ... thread 0: (1000000,1000000) ops and (331302.3,331302.3) ops/second in (3.018391,3.018391) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.95 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 345.4 2.55 2.30 12 0.213 0 0 0.0 0.0 L1 3/0 249.81 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 247.1 246.8 1.02 0.98 1 1.020 255K 253 0.0 0.0 L2 3/2 190.77 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 9/0 741.20 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.5 1.5 102.3 305.2 4.34 4.01 15 0.290 451K 340 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 102.3 305.2 4.34 4.01 15 0.290 451K 340 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 248.1 247.9 1.79 1.72 3 0.597 451K 340 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 345.4 2.55 2.30 12 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 408.30 MB/s write, 0.43 GB read, 136.83 MB/s read, 4.3 seconds Interval compaction: 1.29 GB write, 438.98 MB/s write, 0.43 GB read, 147.11 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 157383 Average: 1.9732 StdDev: 14.90 Min: 0 Median: 1.3256 Max: 4074 Percentiles: P50: 1.33 P75: 1.74 P99: 5.04 P99.9: 9.68 P99.99: 14.87 ------------------------------------------------------ [ 0, 1 ] 48015 30.508% 30.508% ###### ( 1, 2 ] 94203 59.856% 90.364% ############ ( 2, 3 ] 9031 5.738% 96.103% # ( 3, 4 ] 3523 2.238% 98.341% ( 4, 6 ] 1993 1.266% 99.607% ( 6, 10 ] 501 0.318% 99.926% ( 10, 15 ] 104 0.066% 99.992% ( 15, 22 ] 5 0.003% 99.995% ( 22, 34 ] 2 0.001% 99.996% ( 51, 76 ] 2 0.001% 99.997% ( 110, 170 ] 7 0.004% 100.002% ( 170, 250 ] 3 0.002% 100.004% ( 250, 380 ] 5 0.003% 100.007% ( 380, 580 ] 1 0.001% 100.008% ( 580, 870 ] 3 0.002% 100.010% ( 870, 1300 ] 2 0.001% 100.011% ( 1900, 2900 ] 2 0.001% 100.012% ( 2900, 4400 ] 1 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 509 Average: 17.7014 StdDev: 128.83 Min: 1 Median: 2.7698 Max: 1984 Percentiles: P50: 2.77 P75: 3.75 P99: 368.30 P99.9: 1984.00 P99.99: 1984.00 ------------------------------------------------------ [ 0, 1 ] 7 1.375% 1.375% ( 1, 2 ] 92 18.075% 19.450% #### ( 2, 3 ] 202 39.686% 59.136% ######## ( 3, 4 ] 108 21.218% 80.354% #### ( 4, 6 ] 59 11.591% 91.945% ## ( 6, 10 ] 25 4.912% 96.857% # ( 10, 15 ] 3 0.589% 97.446% ( 15, 22 ] 2 0.393% 97.839% ( 22, 34 ] 1 0.196% 98.035% ( 110, 170 ] 1 0.196% 98.232% ( 170, 250 ] 3 0.589% 98.821% ( 250, 380 ] 1 0.196% 99.018% ( 580, 870 ] 1 0.196% 99.214% ( 870, 1300 ] 2 0.393% 99.607% ( 1300, 1900 ] 1 0.196% 99.804% ( 1900, 2900 ] 1 0.196% 100.000% ** Level 2 read latency histogram (micros): Count: 41744 Average: 2.2618 StdDev: 5.45 Min: 1 Median: 1.5394 Max: 881 Percentiles: P50: 1.54 P75: 1.91 P99: 5.98 P99.9: 10.35 P99.99: 48.04 ------------------------------------------------------ [ 0, 1 ] 5659 13.556% 13.556% ### ( 1, 2 ] 28206 67.569% 81.125% ############## ( 2, 3 ] 4375 10.481% 91.606% ## ( 3, 4 ] 1924 4.609% 96.215% # ( 4, 6 ] 1176 2.817% 99.032% # ( 6, 10 ] 361 0.865% 99.897% ( 10, 15 ] 32 0.077% 99.974% ( 15, 22 ] 6 0.014% 99.988% ( 22, 34 ] 1 0.002% 99.990% ( 34, 51 ] 1 0.002% 99.993% ( 51, 76 ] 2 0.005% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 380, 580 ] 1 0.002% 100.005% ( 870, 1300 ] 1 0.002% 100.007% ** Level 3 read latency histogram (micros): Count: 40 Average: 1763.7750 StdDev: 1400.39 Min: 151 Median: 1085.0000 Max: 5319 Percentiles: P50: 1085.00 P75: 2733.33 P99: 5319.00 P99.9: 5319.00 P99.99: 5319.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 170, 250 ] 1 2.500% 5.000% # ( 250, 380 ] 1 2.500% 7.500% # ( 580, 870 ] 13 32.500% 40.000% ####### ( 870, 1300 ] 8 20.000% 60.000% #### ( 1300, 1900 ] 1 2.500% 62.500% # ( 1900, 2900 ] 6 15.000% 77.500% ### ( 2900, 4400 ] 5 12.500% 90.000% ### ( 4400, 6600 ] 4 10.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 1938.5714 StdDev: 1699.88 Min: 235 Median: 1132.7778 Max: 6294 Percentiles: P50: 1132.78 P75: 3212.50 P99: 6294.00 P99.9: 6294.00 P99.99: 6294.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 2 5.714% 8.571% # ( 580, 870 ] 9 25.714% 34.286% ##### ( 870, 1300 ] 9 25.714% 60.000% ##### ( 1300, 1900 ] 3 8.571% 68.571% ## ( 1900, 2900 ] 1 2.857% 71.429% # ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 303.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.438 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.438 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/12-23:42:59 ... thread 0: (1000000,2000000) ops and (357598.7,343948.6) ops/second in (2.796431,5.814822) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 1.35 GB 25.2 0.5 0.0 0.5 2.3 1.8 0.0 1.3 71.8 331.8 7.02 6.45 28 0.251 511K 471 0.0 0.0 L1 3/3 249.81 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 247.1 246.8 1.02 0.98 1 1.020 255K 253 0.0 0.0 L2 1/0 3.35 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 18/0 928.62 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.5 226.5 0.83 0.76 1 0.827 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/16 97.92 GB 0.0 1.1 0.6 0.6 2.9 2.3 0.5 1.6 117.8 307.2 9.64 8.92 32 0.301 1153K 811 0.0 0.0 Int 0/0 0.00 KB 0.0 1.1 0.6 0.6 2.9 2.3 0.4 1.6 117.8 307.2 9.64 8.92 32 0.301 1153K 811 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.1 0.6 0.6 1.1 0.6 0.0 0.0 254.8 254.6 4.46 4.28 6 0.743 1153K 811 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.4 5.18 4.64 26 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.89 GB write, 490.06 MB/s write, 1.11 GB read, 187.92 MB/s read, 9.6 seconds Interval compaction: 2.89 GB write, 509.18 MB/s write, 1.11 GB read, 195.25 MB/s read, 9.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 399475 Average: 2.0593 StdDev: 15.10 Min: 0 Median: 1.3981 Max: 4209 Percentiles: P50: 1.40 P75: 1.79 P99: 5.11 P99.9: 9.98 P99.99: 14.73 ------------------------------------------------------ [ 0, 1 ] 97955 24.521% 24.521% ##### ( 1, 2 ] 255679 64.004% 88.525% ############# ( 2, 3 ] 29181 7.305% 95.830% # ( 3, 4 ] 9989 2.501% 98.330% # ( 4, 6 ] 4826 1.208% 99.538% ( 6, 10 ] 1451 0.363% 99.901% ( 10, 15 ] 374 0.094% 99.995% ( 15, 22 ] 19 0.005% 100.000% ( 22, 34 ] 5 0.001% 100.001% ( 34, 51 ] 3 0.001% 100.002% ( 51, 76 ] 4 0.001% 100.003% ( 110, 170 ] 17 0.004% 100.007% ( 170, 250 ] 7 0.002% 100.009% ( 250, 380 ] 9 0.002% 100.011% ( 380, 580 ] 2 0.001% 100.012% ( 580, 870 ] 8 0.002% 100.014% ( 870, 1300 ] 2 0.001% 100.014% ( 1300, 1900 ] 3 0.001% 100.015% ( 1900, 2900 ] 5 0.001% 100.016% ( 2900, 4400 ] 3 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 46322 Average: 2.1463 StdDev: 13.63 Min: 1 Median: 1.4338 Max: 1984 Percentiles: P50: 1.43 P75: 1.81 P99: 5.14 P99.9: 11.30 P99.99: 686.66 ------------------------------------------------------ [ 0, 1 ] 9973 21.530% 21.530% #### ( 1, 2 ] 30399 65.625% 87.155% ############# ( 2, 3 ] 3975 8.581% 95.736% ## ( 3, 4 ] 1199 2.588% 98.325% # ( 4, 6 ] 551 1.189% 99.514% ( 6, 10 ] 168 0.363% 99.877% ( 10, 15 ] 41 0.089% 99.965% ( 15, 22 ] 5 0.011% 99.976% ( 22, 34 ] 1 0.002% 99.978% ( 110, 170 ] 1 0.002% 99.981% ( 170, 250 ] 3 0.006% 99.987% ( 250, 380 ] 1 0.002% 99.989% ( 580, 870 ] 1 0.002% 99.991% ( 870, 1300 ] 2 0.004% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47963 Average: 2.2511 StdDev: 5.09 Min: 1 Median: 1.5425 Max: 881 Percentiles: P50: 1.54 P75: 1.91 P99: 5.92 P99.9: 9.98 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 6335 13.208% 13.208% ### ( 1, 2 ] 32527 67.817% 81.025% ############## ( 2, 3 ] 5267 10.981% 92.006% ## ( 3, 4 ] 2107 4.393% 96.399% # ( 4, 6 ] 1301 2.713% 99.112% # ( 6, 10 ] 380 0.792% 99.904% ( 10, 15 ] 33 0.069% 99.973% ( 15, 22 ] 6 0.013% 99.985% ( 22, 34 ] 2 0.004% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 2 0.004% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 85 Average: 865.3882 StdDev: 1291.14 Min: 1 Median: 190.0000 Max: 5319 Percentiles: P50: 190.00 P75: 1071.56 P99: 5319.00 P99.9: 5319.00 P99.99: 5319.00 ------------------------------------------------------ [ 0, 1 ] 10 11.765% 11.765% ## ( 1, 2 ] 21 24.706% 36.471% ##### ( 2, 3 ] 1 1.176% 37.647% ( 3, 4 ] 1 1.176% 38.824% ( 4, 6 ] 2 2.353% 41.176% ( 6, 10 ] 2 2.353% 43.529% ( 10, 15 ] 1 1.176% 44.706% ( 51, 76 ] 1 1.176% 45.882% ( 110, 170 ] 3 3.529% 49.412% # ( 170, 250 ] 2 2.353% 51.765% ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 2 2.353% 55.294% ( 580, 870 ] 13 15.294% 70.588% ### ( 870, 1300 ] 8 9.412% 80.000% ## ( 1300, 1900 ] 2 2.353% 82.353% ( 1900, 2900 ] 6 7.059% 89.412% # ( 2900, 4400 ] 5 5.882% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1938.5714 StdDev: 1699.88 Min: 235 Median: 1132.7778 Max: 6294 Percentiles: P50: 1132.78 P75: 3212.50 P99: 6294.00 P99.9: 6294.00 P99.99: 6294.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 2 5.714% 8.571% # ( 580, 870 ] 9 25.714% 34.286% ##### ( 870, 1300 ] 9 25.714% 60.000% ##### ( 1300, 1900 ] 3 8.571% 68.571% ## ( 1900, 2900 ] 1 2.857% 71.429% # ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 6.0 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.646 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.208 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/08/12-23:43:02 ... thread 0: (1000000,3000000) ops and (333034.2,340231.8) ops/second in (3.002695,8.817517) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.78 GB 151.0 1.6 0.0 1.6 4.4 2.8 0.0 1.6 116.3 317.6 14.08 13.14 46 0.306 1663K 1748 0.0 0.0 L1 8/0 813.80 MB 81.4 1.0 0.8 0.2 1.0 0.8 0.2 1.3 236.8 236.1 4.51 4.38 2 2.256 1084K 2855 0.0 0.0 L2 1/0 3.35 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 18/0 928.62 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.5 226.5 0.83 0.76 1 0.827 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1198/4 98.90 GB 0.0 3.0 1.1 1.9 5.8 3.9 0.5 2.1 152.9 293.0 20.19 19.01 51 0.396 3133K 4690 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.1 1.9 5.8 3.9 0.4 2.1 152.9 293.0 20.19 19.01 51 0.396 3133K 4690 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.1 1.9 3.0 1.1 0.0 0.0 252.5 252.1 12.22 11.86 11 1.111 3133K 4690 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.8 7.97 7.15 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.78 GB write, 653.97 MB/s write, 3.01 GB read, 341.15 MB/s read, 20.2 seconds Interval compaction: 5.78 GB write, 670.80 MB/s write, 3.01 GB read, 349.93 MB/s read, 20.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 701588 Average: 2.0544 StdDev: 12.80 Min: 0 Median: 1.4035 Max: 4209 Percentiles: P50: 1.40 P75: 1.79 P99: 5.24 P99.9: 10.49 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 169786 24.200% 24.200% ##### ( 1, 2 ] 448612 63.942% 88.143% ############# ( 2, 3 ] 52271 7.450% 95.593% # ( 3, 4 ] 18063 2.575% 98.168% # ( 4, 6 ] 9390 1.338% 99.506% ( 6, 10 ] 2693 0.384% 99.890% ( 10, 15 ] 724 0.103% 99.993% ( 15, 22 ] 67 0.010% 100.003% ( 22, 34 ] 9 0.001% 100.004% ( 34, 51 ] 6 0.001% 100.005% ( 51, 76 ] 7 0.001% 100.006% ( 110, 170 ] 23 0.003% 100.009% ( 170, 250 ] 13 0.002% 100.011% ( 250, 380 ] 17 0.002% 100.013% ( 380, 580 ] 5 0.001% 100.014% ( 580, 870 ] 15 0.002% 100.016% ( 870, 1300 ] 4 0.001% 100.017% ( 1300, 1900 ] 6 0.001% 100.018% ( 1900, 2900 ] 6 0.001% 100.018% ( 2900, 4400 ] 3 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 63969 Average: 2.3147 StdDev: 16.10 Min: 1 Median: 1.4762 Max: 1984 Percentiles: P50: 1.48 P75: 1.85 P99: 5.39 P99.9: 12.54 P99.99: 1007.87 ------------------------------------------------------ [ 0, 1 ] 11737 18.348% 18.348% #### ( 1, 2 ] 42515 66.462% 84.810% ############# ( 2, 3 ] 6477 10.125% 94.935% ## ( 3, 4 ] 1931 3.019% 97.954% # ( 4, 6 ] 966 1.510% 99.464% ( 6, 10 ] 247 0.386% 99.850% ( 10, 15 ] 63 0.098% 99.948% ( 15, 22 ] 7 0.011% 99.959% ( 22, 34 ] 1 0.002% 99.961% ( 110, 170 ] 2 0.003% 99.964% ( 170, 250 ] 4 0.006% 99.970% ( 250, 380 ] 6 0.009% 99.980% ( 380, 580 ] 2 0.003% 99.983% ( 580, 870 ] 3 0.005% 99.987% ( 870, 1300 ] 5 0.008% 99.995% ( 1300, 1900 ] 2 0.003% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47963 Average: 2.2511 StdDev: 5.09 Min: 1 Median: 1.5425 Max: 881 Percentiles: P50: 1.54 P75: 1.91 P99: 5.92 P99.9: 9.98 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 6335 13.208% 13.208% ### ( 1, 2 ] 32527 67.817% 81.025% ############## ( 2, 3 ] 5267 10.981% 92.006% ## ( 3, 4 ] 2107 4.393% 96.399% # ( 4, 6 ] 1301 2.713% 99.112% # ( 6, 10 ] 380 0.792% 99.904% ( 10, 15 ] 33 0.069% 99.973% ( 15, 22 ] 6 0.013% 99.985% ( 22, 34 ] 2 0.004% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 2 0.004% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 85 Average: 865.3882 StdDev: 1291.14 Min: 1 Median: 190.0000 Max: 5319 Percentiles: P50: 190.00 P75: 1071.56 P99: 5319.00 P99.9: 5319.00 P99.99: 5319.00 ------------------------------------------------------ [ 0, 1 ] 10 11.765% 11.765% ## ( 1, 2 ] 21 24.706% 36.471% ##### ( 2, 3 ] 1 1.176% 37.647% ( 3, 4 ] 1 1.176% 38.824% ( 4, 6 ] 2 2.353% 41.176% ( 6, 10 ] 2 2.353% 43.529% ( 10, 15 ] 1 1.176% 44.706% ( 51, 76 ] 1 1.176% 45.882% ( 110, 170 ] 3 3.529% 49.412% # ( 170, 250 ] 2 2.353% 51.765% ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 2 2.353% 55.294% ( 580, 870 ] 13 15.294% 70.588% ### ( 870, 1300 ] 8 9.412% 80.000% ## ( 1300, 1900 ] 2 2.353% 82.353% ( 1900, 2900 ] 6 7.059% 89.412% # ( 2900, 4400 ] 5 5.882% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1938.5714 StdDev: 1699.88 Min: 235 Median: 1132.7778 Max: 6294 Percentiles: P50: 1132.78 P75: 3212.50 P99: 6294.00 P99.9: 6294.00 P99.99: 6294.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 2 5.714% 8.571% # ( 580, 870 ] 9 25.714% 34.286% ##### ( 870, 1300 ] 9 25.714% 60.000% ##### ( 1300, 1900 ] 3 8.571% 68.571% ## ( 1900, 2900 ] 1 2.857% 71.429% # ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.037 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.391 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/12-23:43:05 ... thread 0: (1000000,4000000) ops and (332883.9,338364.6) ops/second in (3.004050,11.821567) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.70 GB 25.2 2.4 0.0 2.4 6.1 3.7 0.0 1.6 124.5 315.9 19.73 18.44 62 0.318 2494K 2579 0.0 0.0 L1 8/8 813.80 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.3 236.8 236.1 4.51 4.38 2 2.256 1084K 2855 0.0 0.0 L2 1/0 3.35 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 18/0 928.62 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.5 226.5 0.83 0.76 1 0.827 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1202/22 99.82 GB 0.0 3.8 1.1 2.7 7.5 4.8 0.5 2.0 151.1 297.1 25.84 24.32 67 0.386 3965K 5521 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.1 2.7 7.5 4.8 0.4 2.0 151.1 297.1 25.84 24.32 67 0.386 3965K 5521 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.1 2.7 3.8 1.1 0.0 0.0 256.5 256.1 15.23 14.82 14 1.088 3965K 5521 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 356.0 10.62 9.50 53 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.50 GB write, 637.24 MB/s write, 3.81 GB read, 324.07 MB/s read, 25.8 seconds Interval compaction: 7.50 GB write, 649.47 MB/s write, 3.81 GB read, 330.29 MB/s read, 25.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 964734 Average: 2.0509 StdDev: 12.02 Min: 0 Median: 1.4046 Max: 4209 Percentiles: P50: 1.40 P75: 1.79 P99: 5.16 P99.9: 10.25 P99.99: 14.98 ------------------------------------------------------ [ 0, 1 ] 230520 23.895% 23.895% ##### ( 1, 2 ] 622391 64.514% 88.409% ############# ( 2, 3 ] 70938 7.353% 95.762% # ( 3, 4 ] 24189 2.507% 98.269% # ( 4, 6 ] 12167 1.261% 99.531% ( 6, 10 ] 3519 0.365% 99.895% ( 10, 15 ] 918 0.095% 99.990% ( 15, 22 ] 78 0.008% 99.999% ( 22, 34 ] 11 0.001% 100.000% ( 34, 51 ] 7 0.001% 100.000% ( 51, 76 ] 10 0.001% 100.001% ( 76, 110 ] 13 0.001% 100.003% ( 110, 170 ] 44 0.005% 100.007% ( 170, 250 ] 22 0.002% 100.010% ( 250, 380 ] 25 0.003% 100.012% ( 380, 580 ] 8 0.001% 100.013% ( 580, 870 ] 21 0.002% 100.015% ( 870, 1300 ] 7 0.001% 100.016% ( 1300, 1900 ] 9 0.001% 100.017% ( 1900, 2900 ] 7 0.001% 100.018% ( 2900, 4400 ] 3 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 91108 Average: 2.2702 StdDev: 14.11 Min: 1 Median: 1.4620 Max: 1984 Percentiles: P50: 1.46 P75: 1.84 P99: 5.61 P99.9: 13.51 P99.99: 859.29 ------------------------------------------------------ [ 0, 1 ] 17631 19.352% 19.352% #### ( 1, 2 ] 60442 66.341% 85.693% ############# ( 2, 3 ] 8542 9.376% 95.068% ## ( 3, 4 ] 2577 2.829% 97.897% # ( 4, 6 ] 1248 1.370% 99.267% ( 6, 10 ] 509 0.559% 99.825% ( 10, 15 ] 98 0.108% 99.933% ( 15, 22 ] 12 0.013% 99.946% ( 22, 34 ] 1 0.001% 99.947% ( 76, 110 ] 16 0.018% 99.965% ( 110, 170 ] 5 0.005% 99.970% ( 170, 250 ] 5 0.005% 99.976% ( 250, 380 ] 7 0.008% 99.984% ( 380, 580 ] 4 0.004% 99.988% ( 580, 870 ] 3 0.003% 99.991% ( 870, 1300 ] 6 0.007% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 47963 Average: 2.2511 StdDev: 5.09 Min: 1 Median: 1.5425 Max: 881 Percentiles: P50: 1.54 P75: 1.91 P99: 5.92 P99.9: 9.98 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 6335 13.208% 13.208% ### ( 1, 2 ] 32527 67.817% 81.025% ############## ( 2, 3 ] 5267 10.981% 92.006% ## ( 3, 4 ] 2107 4.393% 96.399% # ( 4, 6 ] 1301 2.713% 99.112% # ( 6, 10 ] 380 0.792% 99.904% ( 10, 15 ] 33 0.069% 99.973% ( 15, 22 ] 6 0.013% 99.985% ( 22, 34 ] 2 0.004% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 2 0.004% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 85 Average: 865.3882 StdDev: 1291.14 Min: 1 Median: 190.0000 Max: 5319 Percentiles: P50: 190.00 P75: 1071.56 P99: 5319.00 P99.9: 5319.00 P99.99: 5319.00 ------------------------------------------------------ [ 0, 1 ] 10 11.765% 11.765% ## ( 1, 2 ] 21 24.706% 36.471% ##### ( 2, 3 ] 1 1.176% 37.647% ( 3, 4 ] 1 1.176% 38.824% ( 4, 6 ] 2 2.353% 41.176% ( 6, 10 ] 2 2.353% 43.529% ( 10, 15 ] 1 1.176% 44.706% ( 51, 76 ] 1 1.176% 45.882% ( 110, 170 ] 3 3.529% 49.412% # ( 170, 250 ] 2 2.353% 51.765% ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 2 2.353% 55.294% ( 580, 870 ] 13 15.294% 70.588% ### ( 870, 1300 ] 8 9.412% 80.000% ## ( 1300, 1900 ] 2 2.353% 82.353% ( 1900, 2900 ] 6 7.059% 89.412% # ( 2900, 4400 ] 5 5.882% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1938.5714 StdDev: 1699.88 Min: 235 Median: 1132.7778 Max: 6294 Percentiles: P50: 1132.78 P75: 3212.50 P99: 6294.00 P99.9: 6294.00 P99.99: 6294.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 2 5.714% 8.571% # ( 580, 870 ] 9 25.714% 34.286% ##### ( 870, 1300 ] 9 25.714% 60.000% ##### ( 1300, 1900 ] 3 8.571% 68.571% ## ( 1900, 2900 ] 1 2.857% 71.429% # ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.443 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/12-23:43:09 ... thread 0: (1000000,5000000) ops and (241643.3,313285.2) ops/second in (4.138331,15.959898) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 3.75 GB 163.6 3.4 0.0 3.4 8.2 4.7 0.0 1.7 132.0 313.3 26.73 25.04 82 0.326 3582K 3706 0.0 0.0 L1 8/8 813.80 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.3 236.8 236.1 4.51 4.38 2 2.256 1084K 2855 0.0 0.0 L2 1/0 3.35 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 18/0 928.62 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.5 226.5 0.83 0.76 1 0.827 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1206/18 100.87 GB 0.0 4.9 1.1 3.8 9.6 5.8 0.5 2.0 151.5 299.0 32.84 30.91 87 0.377 5052K 6648 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 1.1 3.8 9.6 5.8 0.4 2.0 151.5 299.0 32.84 30.91 87 0.377 5052K 6648 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 1.1 3.8 4.9 1.1 0.0 0.0 259.1 258.7 19.21 18.72 18 1.067 5052K 6648 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.9 13.63 12.19 69 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.2 total, 16.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.59 GB write, 606.58 MB/s write, 4.86 GB read, 307.38 MB/s read, 32.8 seconds Interval compaction: 9.59 GB write, 615.20 MB/s write, 4.86 GB read, 311.75 MB/s read, 32.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 18, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1400782 Average: 2.1048 StdDev: 11.82 Min: 0 Median: 1.4344 Max: 4209 Percentiles: P50: 1.43 P75: 1.82 P99: 5.29 P99.9: 10.46 P99.99: 17.88 ------------------------------------------------------ [ 0, 1 ] 300814 21.475% 21.475% #### ( 1, 2 ] 919808 65.664% 87.139% ############# ( 2, 3 ] 115460 8.243% 95.381% ## ( 3, 4 ] 38161 2.724% 98.105% # ( 4, 6 ] 19408 1.386% 99.491% ( 6, 10 ] 5609 0.400% 99.891% ( 10, 15 ] 1338 0.096% 99.987% ( 15, 22 ] 109 0.008% 99.995% ( 22, 34 ] 13 0.001% 99.996% ( 34, 51 ] 8 0.001% 99.996% ( 51, 76 ] 17 0.001% 99.997% ( 76, 110 ] 78 0.006% 100.003% ( 110, 170 ] 86 0.006% 100.009% ( 170, 250 ] 37 0.003% 100.012% ( 250, 380 ] 44 0.003% 100.015% ( 380, 580 ] 14 0.001% 100.016% ( 580, 870 ] 35 0.002% 100.018% ( 870, 1300 ] 15 0.001% 100.019% ( 1300, 1900 ] 13 0.001% 100.020% ( 1900, 2900 ] 8 0.001% 100.021% ( 2900, 4400 ] 5 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 156360 Average: 2.3621 StdDev: 12.59 Min: 1 Median: 1.4787 Max: 1984 Percentiles: P50: 1.48 P75: 1.85 P99: 6.50 P99.9: 90.62 P99.99: 597.59 ------------------------------------------------------ [ 0, 1 ] 28372 18.145% 18.145% #### ( 1, 2 ] 104045 66.542% 84.687% ############# ( 2, 3 ] 15216 9.731% 94.419% ## ( 3, 4 ] 4522 2.892% 97.311% # ( 4, 6 ] 2468 1.578% 98.889% ( 6, 10 ] 1387 0.887% 99.776% ( 10, 15 ] 152 0.097% 99.873% ( 15, 22 ] 21 0.013% 99.887% ( 22, 34 ] 1 0.001% 99.887% ( 76, 110 ] 48 0.031% 99.918% ( 110, 170 ] 72 0.046% 99.964% ( 170, 250 ] 16 0.010% 99.974% ( 250, 380 ] 12 0.008% 99.982% ( 380, 580 ] 13 0.008% 99.990% ( 580, 870 ] 6 0.004% 99.994% ( 870, 1300 ] 7 0.004% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 47963 Average: 2.2511 StdDev: 5.09 Min: 1 Median: 1.5425 Max: 881 Percentiles: P50: 1.54 P75: 1.91 P99: 5.92 P99.9: 9.98 P99.99: 37.46 ------------------------------------------------------ [ 0, 1 ] 6335 13.208% 13.208% ### ( 1, 2 ] 32527 67.817% 81.025% ############## ( 2, 3 ] 5267 10.981% 92.006% ## ( 3, 4 ] 2107 4.393% 96.399% # ( 4, 6 ] 1301 2.713% 99.112% # ( 6, 10 ] 380 0.792% 99.904% ( 10, 15 ] 33 0.069% 99.973% ( 15, 22 ] 6 0.013% 99.985% ( 22, 34 ] 2 0.004% 99.990% ( 34, 51 ] 1 0.002% 99.992% ( 51, 76 ] 2 0.004% 99.996% ( 170, 250 ] 1 0.002% 99.998% ( 250, 380 ] 1 0.002% 100.000% ( 380, 580 ] 1 0.002% 100.002% ( 870, 1300 ] 1 0.002% 100.004% ** Level 3 read latency histogram (micros): Count: 85 Average: 865.3882 StdDev: 1291.14 Min: 1 Median: 190.0000 Max: 5319 Percentiles: P50: 190.00 P75: 1071.56 P99: 5319.00 P99.9: 5319.00 P99.99: 5319.00 ------------------------------------------------------ [ 0, 1 ] 10 11.765% 11.765% ## ( 1, 2 ] 21 24.706% 36.471% ##### ( 2, 3 ] 1 1.176% 37.647% ( 3, 4 ] 1 1.176% 38.824% ( 4, 6 ] 2 2.353% 41.176% ( 6, 10 ] 2 2.353% 43.529% ( 10, 15 ] 1 1.176% 44.706% ( 51, 76 ] 1 1.176% 45.882% ( 110, 170 ] 3 3.529% 49.412% # ( 170, 250 ] 2 2.353% 51.765% ( 250, 380 ] 1 1.176% 52.941% ( 380, 580 ] 2 2.353% 55.294% ( 580, 870 ] 13 15.294% 70.588% ### ( 870, 1300 ] 8 9.412% 80.000% ## ( 1300, 1900 ] 2 2.353% 82.353% ( 1900, 2900 ] 6 7.059% 89.412% # ( 2900, 4400 ] 5 5.882% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1938.5714 StdDev: 1699.88 Min: 235 Median: 1132.7778 Max: 6294 Percentiles: P50: 1132.78 P75: 3212.50 P99: 6294.00 P99.9: 6294.00 P99.99: 6294.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 2 5.714% 8.571% # ( 580, 870 ] 9 25.714% 34.286% ##### ( 870, 1300 ] 9 25.714% 60.000% ##### ( 1300, 1900 ] 3 8.571% 68.571% ## ( 1900, 2900 ] 1 2.857% 71.429% # ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 16.2 total, 4.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 303.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.885 H:M:S, 17.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 237.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.442 H:M:S, 34.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/12-23:43:17 ... thread 0: (1000000,6000000) ops and (125799.1,250950.7) ops/second in (7.949183,23.909081) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 2.52 GB 12.6 5.1 0.0 5.1 10.8 5.7 0.0 1.9 146.3 308.3 35.73 33.61 101 0.354 5308K 7993 0.0 0.0 L1 16/16 1.90 GB 0.0 4.0 3.0 1.0 3.9 2.9 0.2 1.3 229.1 226.7 17.83 17.17 3 5.943 4148K 43K 0.0 0.0 L2 9/5 1.01 GB 5.2 0.2 0.1 0.1 0.2 0.1 1.2 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 18/10 928.62 MB 0.1 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.5 226.5 0.83 0.76 1 0.827 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1214/40 101.75 GB 0.0 9.5 3.3 6.2 15.1 8.9 1.5 2.7 175.7 279.9 55.16 52.27 107 0.515 9841K 51K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 3.3 6.2 15.1 8.9 1.4 2.7 175.7 279.9 55.16 52.27 107 0.515 9841K 51K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 3.3 6.2 9.4 3.2 0.0 0.0 249.4 248.0 38.87 37.73 23 1.690 9841K 51K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 355.8 16.29 14.55 84 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.1 total, 23.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.07 GB write, 639.51 MB/s write, 9.47 GB read, 401.55 MB/s read, 55.2 seconds Interval compaction: 15.07 GB write, 645.58 MB/s write, 9.47 GB read, 405.36 MB/s read, 55.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 18, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2159515 Average: 2.2472 StdDev: 13.04 Min: 0 Median: 1.4487 Max: 4209 Percentiles: P50: 1.45 P75: 1.82 P99: 5.56 P99.9: 13.82 P99.99: 186.29 ------------------------------------------------------ [ 0, 1 ] 435344 20.159% 20.159% #### ( 1, 2 ] 1436187 66.505% 86.664% ############# ( 2, 3 ] 182455 8.449% 95.113% ## ( 3, 4 ] 59805 2.769% 97.883% # ( 4, 6 ] 30905 1.431% 99.314% ( 6, 10 ] 11075 0.513% 99.827% ( 10, 15 ] 2073 0.096% 99.923% ( 15, 22 ] 202 0.009% 99.932% ( 22, 34 ] 18 0.001% 99.933% ( 34, 51 ] 11 0.001% 99.933% ( 51, 76 ] 23 0.001% 99.934% ( 76, 110 ] 458 0.021% 99.956% ( 110, 170 ] 697 0.032% 99.988% ( 170, 250 ] 231 0.011% 99.999% ( 250, 380 ] 182 0.008% 100.007% ( 380, 580 ] 127 0.006% 100.013% ( 580, 870 ] 94 0.004% 100.017% ( 870, 1300 ] 30 0.001% 100.019% ( 1300, 1900 ] 22 0.001% 100.020% ( 1900, 2900 ] 10 0.000% 100.020% ( 2900, 4400 ] 8 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 291681 Average: 2.6724 StdDev: 20.04 Min: 1 Median: 1.4986 Max: 3957 Percentiles: P50: 1.50 P75: 1.87 P99: 7.47 P99.9: 143.36 P99.99: 973.89 ------------------------------------------------------ [ 0, 1 ] 48356 16.578% 16.578% ### ( 1, 2 ] 195533 67.037% 83.615% ############# ( 2, 3 ] 29688 10.178% 93.793% ## ( 3, 4 ] 8694 2.981% 96.774% # ( 4, 6 ] 5361 1.838% 98.612% ( 6, 10 ] 3090 1.059% 99.671% ( 10, 15 ] 297 0.102% 99.773% ( 15, 22 ] 40 0.014% 99.787% ( 22, 34 ] 3 0.001% 99.788% ( 51, 76 ] 1 0.000% 99.788% ( 76, 110 ] 224 0.077% 99.865% ( 110, 170 ] 184 0.063% 99.928% ( 170, 250 ] 51 0.017% 99.945% ( 250, 380 ] 47 0.016% 99.962% ( 380, 580 ] 57 0.020% 99.981% ( 580, 870 ] 21 0.007% 99.988% ( 870, 1300 ] 20 0.007% 99.995% ( 1300, 1900 ] 9 0.003% 99.998% ( 1900, 2900 ] 3 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 48065 Average: 2.7632 StdDev: 17.41 Min: 1 Median: 1.5437 Max: 999 Percentiles: P50: 1.54 P75: 1.91 P99: 6.10 P99.9: 185.48 P99.99: 881.89 ------------------------------------------------------ [ 0, 1 ] 6336 13.182% 13.182% ### ( 1, 2 ] 32549 67.719% 80.901% ############## ( 2, 3 ] 5274 10.973% 91.874% ## ( 3, 4 ] 2111 4.392% 96.265% # ( 4, 6 ] 1305 2.715% 98.981% # ( 6, 10 ] 380 0.791% 99.771% ( 10, 15 ] 33 0.069% 99.840% ( 15, 22 ] 6 0.012% 99.852% ( 22, 34 ] 2 0.004% 99.856% ( 34, 51 ] 1 0.002% 99.859% ( 51, 76 ] 2 0.004% 99.863% ( 76, 110 ] 2 0.004% 99.867% ( 110, 170 ] 14 0.029% 99.896% ( 170, 250 ] 10 0.021% 99.917% ( 250, 380 ] 14 0.029% 99.946% ( 380, 580 ] 16 0.033% 99.979% ( 580, 870 ] 5 0.010% 99.990% ( 870, 1300 ] 7 0.015% 100.004% ** Level 3 read latency histogram (micros): Count: 23198 Average: 7.6595 StdDev: 98.08 Min: 1 Median: 1.6593 Max: 5319 Percentiles: P50: 1.66 P75: 2.14 P99: 80.74 P99.9: 990.49 P99.99: 4304.06 ------------------------------------------------------ [ 0, 1 ] 1322 5.699% 5.699% # ( 1, 2 ] 15589 67.200% 72.899% ############# ( 2, 3 ] 3522 15.182% 88.081% ### ( 3, 4 ] 1179 5.082% 93.163% # ( 4, 6 ] 851 3.668% 96.832% # ( 6, 10 ] 432 1.862% 98.694% ( 10, 15 ] 53 0.228% 98.922% ( 15, 22 ] 10 0.043% 98.965% ( 22, 34 ] 1 0.004% 98.970% ( 51, 76 ] 3 0.013% 98.983% ( 76, 110 ] 36 0.155% 99.138% ( 110, 170 ] 59 0.254% 99.392% ( 170, 250 ] 36 0.155% 99.547% ( 250, 380 ] 31 0.134% 99.681% ( 380, 580 ] 27 0.116% 99.797% ( 580, 870 ] 22 0.095% 99.892% ( 870, 1300 ] 10 0.043% 99.935% ( 1300, 1900 ] 3 0.013% 99.948% ( 1900, 2900 ] 6 0.026% 99.974% ( 2900, 4400 ] 5 0.022% 99.996% ( 4400, 6600 ] 4 0.017% 100.013% ** Level 4 read latency histogram (micros): Count: 35 Average: 1938.5714 StdDev: 1699.88 Min: 235 Median: 1132.7778 Max: 6294 Percentiles: P50: 1132.78 P75: 3212.50 P99: 6294.00 P99.9: 6294.00 P99.99: 6294.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 2 5.714% 8.571% # ( 580, 870 ] 9 25.714% 34.286% ##### ( 870, 1300 ] 9 25.714% 60.000% ##### ( 1300, 1900 ] 3 8.571% 68.571% ## ( 1900, 2900 ] 1 2.857% 71.429% # ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 4 11.429% 100.000% ## ** DB Stats ** Uptime(secs): 24.1 total, 7.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 244.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.942 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 123.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.057 H:M:S, 63.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/08/12-23:43:23 ... thread 0: (1000000,7000000) ops and (172666.7,235685.6) ops/second in (5.791503,29.700584) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.50 GB 50.3 5.6 0.0 5.6 12.2 6.6 0.0 1.8 141.4 308.9 40.55 38.10 117 0.347 5820K 8497 0.0 0.0 L1 16/16 1.90 GB 0.0 4.0 3.0 1.0 3.9 2.9 0.2 1.3 229.1 226.7 17.83 17.17 3 5.943 4148K 43K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.2 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 37/0 995.64 MB 1.0 2.2 1.2 1.0 2.2 1.2 0.1 1.8 215.3 214.8 10.36 9.52 7 1.479 2255K 5153 0.0 0.0 L4 126/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/33 102.72 GB 0.0 12.0 4.3 7.7 18.5 10.9 3.4 2.8 176.1 273.1 69.50 65.52 129 0.539 12M 56K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.0 4.3 7.7 18.5 10.9 3.3 2.8 176.1 273.1 69.50 65.52 129 0.539 12M 56K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.0 4.3 7.7 11.9 4.2 0.0 0.0 243.2 242.0 50.33 48.39 31 1.624 12M 56K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 354.8 19.17 17.12 98 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.9 total, 29.7 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.54 GB write, 634.30 MB/s write, 11.95 GB read, 408.91 MB/s read, 69.5 seconds Interval compaction: 18.54 GB write, 639.14 MB/s write, 11.95 GB read, 412.03 MB/s read, 69.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 25, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2617241 Average: 2.3034 StdDev: 12.80 Min: 0 Median: 1.4796 Max: 4209 Percentiles: P50: 1.48 P75: 1.85 P99: 5.77 P99.9: 13.73 P99.99: 199.90 ------------------------------------------------------ [ 0, 1 ] 472739 18.062% 18.062% #### ( 1, 2 ] 1742946 66.595% 84.657% ############# ( 2, 3 ] 249485 9.532% 94.190% ## ( 3, 4 ] 83677 3.197% 97.387% # ( 4, 6 ] 47796 1.826% 99.213% ( 6, 10 ] 15951 0.609% 99.822% ( 10, 15 ] 2725 0.104% 99.927% ( 15, 22 ] 246 0.009% 99.936% ( 22, 34 ] 23 0.001% 99.937% ( 34, 51 ] 12 0.000% 99.937% ( 51, 76 ] 26 0.001% 99.938% ( 76, 110 ] 482 0.018% 99.957% ( 110, 170 ] 769 0.029% 99.986% ( 170, 250 ] 279 0.011% 99.997% ( 250, 380 ] 230 0.009% 100.006% ( 380, 580 ] 173 0.007% 100.012% ( 580, 870 ] 118 0.005% 100.017% ( 870, 1300 ] 39 0.001% 100.018% ( 1300, 1900 ] 24 0.001% 100.019% ( 1900, 2900 ] 11 0.000% 100.019% ( 2900, 4400 ] 9 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 631344 Average: 2.8264 StdDev: 16.92 Min: 1 Median: 1.5882 Max: 3957 Percentiles: P50: 1.59 P75: 1.96 P99: 8.31 P99.9: 144.47 P99.99: 502.62 ------------------------------------------------------ [ 0, 1 ] 66351 10.509% 10.509% ## ( 1, 2 ] 423881 67.139% 77.649% ############# ( 2, 3 ] 83404 13.211% 90.859% ### ( 3, 4 ] 27397 4.339% 95.199% # ( 4, 6 ] 18568 2.941% 98.140% # ( 6, 10 ] 9396 1.488% 99.628% ( 10, 15 ] 932 0.148% 99.776% ( 15, 22 ] 111 0.018% 99.793% ( 22, 34 ] 6 0.001% 99.794% ( 51, 76 ] 14 0.002% 99.797% ( 76, 110 ] 393 0.062% 99.859% ( 110, 170 ] 452 0.072% 99.930% ( 170, 250 ] 163 0.026% 99.956% ( 250, 380 ] 135 0.021% 99.978% ( 380, 580 ] 127 0.020% 99.998% ( 580, 870 ] 48 0.008% 100.005% ( 870, 1300 ] 30 0.005% 100.010% ( 1300, 1900 ] 12 0.002% 100.012% ( 1900, 2900 ] 3 0.000% 100.013% ( 2900, 4400 ] 2 0.000% 100.013% ** Level 2 read latency histogram (micros): Count: 48813 Average: 2.7594 StdDev: 17.28 Min: 1 Median: 1.5464 Max: 999 Percentiles: P50: 1.55 P75: 1.92 P99: 6.15 P99.9: 179.50 P99.99: 877.29 ------------------------------------------------------ [ 0, 1 ] 6359 13.027% 13.027% ### ( 1, 2 ] 33032 67.670% 80.698% ############## ( 2, 3 ] 5431 11.126% 91.824% ## ( 3, 4 ] 2160 4.425% 96.249% # ( 4, 6 ] 1328 2.721% 98.970% # ( 6, 10 ] 392 0.803% 99.773% ( 10, 15 ] 34 0.070% 99.842% ( 15, 22 ] 6 0.012% 99.855% ( 22, 34 ] 2 0.004% 99.859% ( 34, 51 ] 1 0.002% 99.861% ( 51, 76 ] 2 0.004% 99.865% ( 76, 110 ] 2 0.004% 99.869% ( 110, 170 ] 14 0.029% 99.898% ( 170, 250 ] 10 0.020% 99.918% ( 250, 380 ] 14 0.029% 99.947% ( 380, 580 ] 16 0.033% 99.980% ( 580, 870 ] 5 0.010% 99.990% ( 870, 1300 ] 7 0.014% 100.004% ** Level 3 read latency histogram (micros): Count: 228116 Average: 3.4550 StdDev: 34.58 Min: 1 Median: 1.6702 Max: 5319 Percentiles: P50: 1.67 P75: 2.17 P99: 8.76 P99.9: 221.77 P99.99: 810.57 ------------------------------------------------------ [ 0, 1 ] 10883 4.771% 4.771% # ( 1, 2 ] 153955 67.490% 72.261% ############# ( 2, 3 ] 36115 15.832% 88.092% ### ( 3, 4 ] 13196 5.785% 93.877% # ( 4, 6 ] 8962 3.929% 97.806% # ( 6, 10 ] 3941 1.728% 99.534% ( 10, 15 ] 350 0.153% 99.687% ( 15, 22 ] 36 0.016% 99.703% ( 22, 34 ] 9 0.004% 99.707% ( 34, 51 ] 2 0.001% 99.708% ( 51, 76 ] 13 0.006% 99.713% ( 76, 110 ] 108 0.047% 99.761% ( 110, 170 ] 259 0.114% 99.874% ( 170, 250 ] 91 0.040% 99.914% ( 250, 380 ] 79 0.035% 99.949% ( 380, 580 ] 60 0.026% 99.975% ( 580, 870 ] 43 0.019% 99.994% ( 870, 1300 ] 19 0.008% 100.002% ( 1300, 1900 ] 3 0.001% 100.004% ( 1900, 2900 ] 8 0.004% 100.007% ( 2900, 4400 ] 5 0.002% 100.009% ( 4400, 6600 ] 4 0.002% 100.011% ** Level 4 read latency histogram (micros): Count: 35 Average: 1938.5714 StdDev: 1699.88 Min: 235 Median: 1132.7778 Max: 6294 Percentiles: P50: 1132.78 P75: 3212.50 P99: 6294.00 P99.9: 6294.00 P99.99: 6294.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 2 5.714% 8.571% # ( 580, 870 ] 9 25.714% 34.286% ##### ( 870, 1300 ] 9 25.714% 60.000% ##### ( 1300, 1900 ] 3 8.571% 68.571% ## ( 1900, 2900 ] 1 2.857% 71.429% # ( 2900, 4400 ] 6 17.143% 88.571% ### ( 4400, 6600 ] 4 11.429% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 766.5667 StdDev: 939.28 Min: 72 Median: 305.7143 Max: 3760 Percentiles: P50: 305.71 P75: 1192.50 P99: 3760.00 P99.9: 3760.00 P99.99: 3760.00 ------------------------------------------------------ ( 51, 76 ] 3 5.000% 5.000% # ( 76, 110 ] 6 10.000% 15.000% ## ( 110, 170 ] 13 21.667% 36.667% #### ( 170, 250 ] 5 8.333% 45.000% ## ( 250, 380 ] 7 11.667% 56.667% ## ( 380, 580 ] 7 11.667% 68.333% ## ( 580, 870 ] 1 1.667% 70.000% ( 870, 1300 ] 4 6.667% 76.667% # ( 1300, 1900 ] 5 8.333% 85.000% ## ( 1900, 2900 ] 5 8.333% 93.333% ## ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 29.9 total, 5.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 230.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.977 H:M:S, 36.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.035 H:M:S, 52.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/08/12-23:43:40 ... thread 0: (1000000,8000000) ops and (59125.6,171623.2) ops/second in (16.913159,46.613743) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 2.03 GB 25.2 6.7 0.0 6.7 14.3 7.6 0.0 1.9 141.1 300.0 48.67 44.75 135 0.361 6971K 9720 0.0 0.0 L1 13/13 1.39 GB 0.0 8.3 5.3 2.9 8.2 5.2 0.2 1.5 224.7 221.6 37.74 35.79 4 9.436 8206K 43K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.2 0.1 0.1 0.2 0.1 4.0 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 23/5 1.38 GB 0.9 4.4 3.0 1.4 4.4 3.0 1.0 1.4 166.1 165.7 27.09 20.19 21 1.290 4525K 9211 0.0 0.0 L4 155/6 9.81 GB 1.0 0.9 0.8 0.1 0.9 0.8 2.6 1.1 135.4 135.3 6.56 4.09 8 0.820 902K 872 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/34 103.57 GB 0.0 20.4 9.3 11.2 27.9 16.7 10.7 3.7 173.2 236.2 120.85 105.54 170 0.711 20M 63K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.4 9.3 11.2 27.9 16.7 10.6 3.7 173.2 236.2 120.85 105.54 170 0.711 20M 63K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.4 9.3 11.2 20.3 9.1 0.0 0.0 214.0 212.5 97.81 85.96 58 1.686 20M 63K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 336.4 23.03 19.58 112 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.8 total, 46.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.87 GB write, 609.22 MB/s write, 20.44 GB read, 446.77 MB/s read, 120.8 seconds Interval compaction: 27.87 GB write, 612.19 MB/s write, 20.44 GB read, 448.94 MB/s read, 120.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 43, interval: 85 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3292692 Average: 2.5715 StdDev: 19.85 Min: 0 Median: 1.4786 Max: 4732 Percentiles: P50: 1.48 P75: 1.86 P99: 5.97 P99.9: 115.45 P99.99: 418.97 ------------------------------------------------------ [ 0, 1 ] 615354 18.688% 18.688% #### ( 1, 2 ] 2154002 65.418% 84.106% ############# ( 2, 3 ] 311711 9.467% 93.573% ## ( 3, 4 ] 108879 3.307% 96.880% # ( 4, 6 ] 71052 2.158% 99.037% ( 6, 10 ] 21792 0.662% 99.699% ( 10, 15 ] 3991 0.121% 99.820% ( 15, 22 ] 457 0.014% 99.834% ( 22, 34 ] 29 0.001% 99.835% ( 34, 51 ] 15 0.000% 99.836% ( 51, 76 ] 60 0.002% 99.838% ( 76, 110 ] 1873 0.057% 99.894% ( 110, 170 ] 2074 0.063% 99.957% ( 170, 250 ] 514 0.016% 99.973% ( 250, 380 ] 478 0.015% 99.988% ( 380, 580 ] 440 0.013% 100.001% ( 580, 870 ] 306 0.009% 100.010% ( 870, 1300 ] 143 0.004% 100.015% ( 1300, 1900 ] 52 0.002% 100.016% ( 1900, 2900 ] 43 0.001% 100.017% ( 2900, 4400 ] 28 0.001% 100.018% ( 4400, 6600 ] 3 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1617191 Average: 5.2088 StdDev: 88.91 Min: 1 Median: 1.6404 Max: 11710 Percentiles: P50: 1.64 P75: 2.29 P99: 8.89 P99.9: 130.48 P99.99: 355.61 ------------------------------------------------------ [ 0, 1 ] 215018 13.296% 13.296% ### ( 1, 2 ] 926821 57.311% 70.606% ########### ( 2, 3 ] 241389 14.926% 85.533% ### ( 3, 4 ] 105827 6.544% 92.077% # ( 4, 6 ] 93923 5.808% 97.884% # ( 6, 10 ] 24983 1.545% 99.429% ( 10, 15 ] 5078 0.314% 99.743% ( 15, 22 ] 647 0.040% 99.783% ( 22, 34 ] 36 0.002% 99.785% ( 34, 51 ] 15 0.001% 99.786% ( 51, 76 ] 137 0.008% 99.795% ( 76, 110 ] 1266 0.078% 99.873% ( 110, 170 ] 1271 0.079% 99.952% ( 170, 250 ] 325 0.020% 99.972% ( 250, 380 ] 361 0.022% 99.994% ( 380, 580 ] 391 0.024% 100.018% ( 580, 870 ] 350 0.022% 100.040% ( 870, 1300 ] 282 0.017% 100.057% ( 1300, 1900 ] 203 0.013% 100.070% ( 1900, 2900 ] 336 0.021% 100.091% ( 2900, 4400 ] 383 0.024% 100.114% ( 4400, 6600 ] 107 0.007% 100.121% ( 6600, 9900 ] 27 0.002% 100.123% ( 9900, 14000 ] 4 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 48813 Average: 2.7594 StdDev: 17.28 Min: 1 Median: 1.5464 Max: 999 Percentiles: P50: 1.55 P75: 1.92 P99: 6.15 P99.9: 179.50 P99.99: 877.29 ------------------------------------------------------ [ 0, 1 ] 6359 13.027% 13.027% ### ( 1, 2 ] 33032 67.670% 80.698% ############## ( 2, 3 ] 5431 11.126% 91.824% ## ( 3, 4 ] 2160 4.425% 96.249% # ( 4, 6 ] 1328 2.721% 98.970% # ( 6, 10 ] 392 0.803% 99.773% ( 10, 15 ] 34 0.070% 99.842% ( 15, 22 ] 6 0.012% 99.855% ( 22, 34 ] 2 0.004% 99.859% ( 34, 51 ] 1 0.002% 99.861% ( 51, 76 ] 2 0.004% 99.865% ( 76, 110 ] 2 0.004% 99.869% ( 110, 170 ] 14 0.029% 99.898% ( 170, 250 ] 10 0.020% 99.918% ( 250, 380 ] 14 0.029% 99.947% ( 380, 580 ] 16 0.033% 99.980% ( 580, 870 ] 5 0.010% 99.990% ( 870, 1300 ] 7 0.014% 100.004% ** Level 3 read latency histogram (micros): Count: 529845 Average: 6.9919 StdDev: 100.06 Min: 1 Median: 1.8319 Max: 11497 Percentiles: P50: 1.83 P75: 2.74 P99: 9.32 P99.9: 502.48 P99.99: 888.56 ------------------------------------------------------ [ 0, 1 ] 13997 2.642% 2.642% # ( 1, 2 ] 301641 56.930% 59.572% ########### ( 2, 3 ] 110446 20.845% 80.417% #### ( 3, 4 ] 49277 9.300% 89.717% ## ( 4, 6 ] 41738 7.877% 97.594% ## ( 6, 10 ] 8988 1.696% 99.291% ( 10, 15 ] 1722 0.325% 99.616% ( 15, 22 ] 202 0.038% 99.654% ( 22, 34 ] 32 0.006% 99.660% ( 34, 51 ] 11 0.002% 99.662% ( 51, 76 ] 16 0.003% 99.665% ( 76, 110 ] 117 0.022% 99.687% ( 110, 170 ] 322 0.061% 99.748% ( 170, 250 ] 261 0.049% 99.797% ( 250, 380 ] 342 0.065% 99.862% ( 380, 580 ] 335 0.063% 99.925% ( 580, 870 ] 337 0.064% 99.988% ( 870, 1300 ] 232 0.044% 100.032% ( 1300, 1900 ] 152 0.029% 100.061% ( 1900, 2900 ] 148 0.028% 100.089% ( 2900, 4400 ] 152 0.029% 100.118% ( 4400, 6600 ] 39 0.007% 100.125% ( 6600, 9900 ] 8 0.002% 100.126% ( 9900, 14000 ] 1 0.000% 100.127% ** Level 4 read latency histogram (micros): Count: 7390 Average: 29.5096 StdDev: 260.14 Min: 1 Median: 1.8473 Max: 6294 Percentiles: P50: 1.85 P75: 2.88 P99: 830.90 P99.9: 4070.68 P99.99: 5643.49 ------------------------------------------------------ [ 0, 1 ] 276 3.735% 3.735% # ( 1, 2 ] 4036 54.614% 58.349% ########### ( 2, 3 ] 1394 18.863% 77.212% #### ( 3, 4 ] 685 9.269% 86.482% ## ( 4, 6 ] 663 8.972% 95.453% ## ( 6, 10 ] 165 2.233% 97.686% ( 10, 15 ] 12 0.162% 97.848% ( 15, 22 ] 5 0.068% 97.916% ( 22, 34 ] 1 0.014% 97.930% ( 34, 51 ] 1 0.014% 97.943% ( 51, 76 ] 1 0.014% 97.957% ( 76, 110 ] 1 0.014% 97.970% ( 110, 170 ] 8 0.108% 98.078% ( 170, 250 ] 15 0.203% 98.281% ( 250, 380 ] 9 0.122% 98.403% ( 380, 580 ] 21 0.284% 98.687% ( 580, 870 ] 29 0.392% 99.080% ( 870, 1300 ] 27 0.365% 99.445% ( 1300, 1900 ] 11 0.149% 99.594% ( 1900, 2900 ] 9 0.122% 99.716% ( 2900, 4400 ] 20 0.271% 99.986% ( 4400, 6600 ] 4 0.054% 100.041% ** Level 5 read latency histogram (micros): Count: 180 Average: 1213.7000 StdDev: 1270.69 Min: 72 Median: 662.8571 Max: 5264 Percentiles: P50: 662.86 P75: 1833.33 P99: 5264.00 P99.9: 5264.00 P99.99: 5264.00 ------------------------------------------------------ ( 51, 76 ] 3 1.667% 1.667% ( 76, 110 ] 9 5.000% 6.667% # ( 110, 170 ] 19 10.556% 17.222% ## ( 170, 250 ] 15 8.333% 25.556% ## ( 250, 380 ] 21 11.667% 37.222% ## ( 380, 580 ] 19 10.556% 47.778% ## ( 580, 870 ] 14 7.778% 55.556% ## ( 870, 1300 ] 19 10.556% 66.111% ## ( 1300, 1900 ] 18 10.000% 76.111% ## ( 1900, 2900 ] 20 11.111% 87.222% ## ( 2900, 4400 ] 17 9.444% 96.667% ## ( 4400, 6600 ] 6 3.333% 100.000% # ** DB Stats ** Uptime(secs): 46.8 total, 16.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 168.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.466 H:M:S, 52.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.489 H:M:S, 79.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/08/12-23:43:43 ... thread 0: (1000000,9000000) ops and (306977.9,180464.5) ops/second in (3.257563,49.871306) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.01 GB 62.9 7.3 0.0 7.3 15.9 8.5 0.0 1.9 138.7 300.5 54.05 49.74 150 0.360 7610K 10K 0.0 0.0 L1 13/13 1.39 GB 0.0 8.3 5.3 2.9 8.2 5.2 0.2 1.5 224.7 221.6 37.74 35.79 4 9.436 8206K 43K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.0 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 17/0 940.17 MB 0.9 4.6 3.2 1.4 4.6 3.1 1.0 1.4 164.8 164.4 28.45 21.06 22 1.293 4718K 9233 0.0 0.0 L4 151/0 9.42 GB 1.0 1.6 1.3 0.3 1.6 1.2 2.6 1.3 149.9 149.7 10.80 7.23 13 0.831 1516K 1449 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/30 104.55 GB 0.0 22.0 9.9 12.1 30.4 18.3 11.7 3.6 170.5 235.9 131.82 114.55 191 0.690 22M 64K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.0 9.9 12.1 30.4 18.3 11.6 3.6 170.5 235.9 131.82 114.55 191 0.690 22M 64K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.0 9.9 12.1 21.8 9.7 0.0 0.0 212.2 210.9 105.92 92.43 66 1.605 22M 64K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 338.0 25.91 22.12 125 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.1 total, 49.9 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.37 GB write, 620.65 MB/s write, 21.95 GB read, 448.67 MB/s read, 131.8 seconds Interval compaction: 30.37 GB write, 623.48 MB/s write, 21.95 GB read, 450.71 MB/s read, 131.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 49, interval: 91 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3703174 Average: 2.5848 StdDev: 19.31 Min: 0 Median: 1.4945 Max: 4732 Percentiles: P50: 1.49 P75: 1.88 P99: 6.08 P99.9: 108.40 P99.99: 369.37 ------------------------------------------------------ [ 0, 1 ] 654142 17.664% 17.664% #### ( 1, 2 ] 2421308 65.385% 83.049% ############# ( 2, 3 ] 374870 10.123% 93.172% ## ( 3, 4 ] 128975 3.483% 96.655% # ( 4, 6 ] 86294 2.330% 98.985% ( 6, 10 ] 26678 0.720% 99.705% ( 10, 15 ] 4750 0.128% 99.834% ( 15, 22 ] 537 0.015% 99.848% ( 22, 34 ] 32 0.001% 99.849% ( 34, 51 ] 18 0.000% 99.850% ( 51, 76 ] 64 0.002% 99.851% ( 76, 110 ] 1893 0.051% 99.902% ( 110, 170 ] 2159 0.058% 99.961% ( 170, 250 ] 587 0.016% 99.977% ( 250, 380 ] 542 0.015% 99.991% ( 380, 580 ] 500 0.014% 100.005% ( 580, 870 ] 348 0.009% 100.014% ( 870, 1300 ] 159 0.004% 100.018% ( 1300, 1900 ] 56 0.002% 100.020% ( 1900, 2900 ] 44 0.001% 100.021% ( 2900, 4400 ] 29 0.001% 100.022% ( 4400, 6600 ] 3 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1626866 Average: 5.2069 StdDev: 88.76 Min: 1 Median: 1.6420 Max: 11710 Percentiles: P50: 1.64 P75: 2.30 P99: 8.90 P99.9: 131.00 P99.99: 360.72 ------------------------------------------------------ [ 0, 1 ] 215108 13.222% 13.222% ### ( 1, 2 ] 931994 57.288% 70.510% ########### ( 2, 3 ] 243887 14.991% 85.501% ### ( 3, 4 ] 106626 6.554% 92.055% # ( 4, 6 ] 94725 5.823% 97.878% # ( 6, 10 ] 25225 1.551% 99.428% ( 10, 15 ] 5122 0.315% 99.743% ( 15, 22 ] 652 0.040% 99.783% ( 22, 34 ] 36 0.002% 99.785% ( 34, 51 ] 15 0.001% 99.786% ( 51, 76 ] 137 0.008% 99.795% ( 76, 110 ] 1267 0.078% 99.873% ( 110, 170 ] 1272 0.078% 99.951% ( 170, 250 ] 329 0.020% 99.971% ( 250, 380 ] 362 0.022% 99.993% ( 380, 580 ] 396 0.024% 100.018% ( 580, 870 ] 356 0.022% 100.040% ( 870, 1300 ] 283 0.017% 100.057% ( 1300, 1900 ] 204 0.013% 100.069% ( 1900, 2900 ] 338 0.021% 100.090% ( 2900, 4400 ] 384 0.024% 100.114% ( 4400, 6600 ] 107 0.007% 100.120% ( 6600, 9900 ] 27 0.002% 100.122% ( 9900, 14000 ] 4 0.000% 100.122% ** Level 2 read latency histogram (micros): Count: 48813 Average: 2.7594 StdDev: 17.28 Min: 1 Median: 1.5464 Max: 999 Percentiles: P50: 1.55 P75: 1.92 P99: 6.15 P99.9: 179.50 P99.99: 877.29 ------------------------------------------------------ [ 0, 1 ] 6359 13.027% 13.027% ### ( 1, 2 ] 33032 67.670% 80.698% ############## ( 2, 3 ] 5431 11.126% 91.824% ## ( 3, 4 ] 2160 4.425% 96.249% # ( 4, 6 ] 1328 2.721% 98.970% # ( 6, 10 ] 392 0.803% 99.773% ( 10, 15 ] 34 0.070% 99.842% ( 15, 22 ] 6 0.012% 99.855% ( 22, 34 ] 2 0.004% 99.859% ( 34, 51 ] 1 0.002% 99.861% ( 51, 76 ] 2 0.004% 99.865% ( 76, 110 ] 2 0.004% 99.869% ( 110, 170 ] 14 0.029% 99.898% ( 170, 250 ] 10 0.020% 99.918% ( 250, 380 ] 14 0.029% 99.947% ( 380, 580 ] 16 0.033% 99.980% ( 580, 870 ] 5 0.010% 99.990% ( 870, 1300 ] 7 0.014% 100.004% ** Level 3 read latency histogram (micros): Count: 653876 Average: 6.3552 StdDev: 90.71 Min: 1 Median: 1.8321 Max: 11497 Percentiles: P50: 1.83 P75: 2.73 P99: 9.18 P99.9: 386.20 P99.99: 748.39 ------------------------------------------------------ [ 0, 1 ] 16226 2.482% 2.482% ( 1, 2 ] 373425 57.109% 59.591% ########### ( 2, 3 ] 137749 21.067% 80.657% #### ( 3, 4 ] 60037 9.182% 89.839% ## ( 4, 6 ] 50963 7.794% 97.633% ## ( 6, 10 ] 11241 1.719% 99.352% ( 10, 15 ] 2032 0.311% 99.663% ( 15, 22 ] 229 0.035% 99.698% ( 22, 34 ] 32 0.005% 99.703% ( 34, 51 ] 11 0.002% 99.705% ( 51, 76 ] 19 0.003% 99.708% ( 76, 110 ] 132 0.020% 99.728% ( 110, 170 ] 405 0.062% 99.790% ( 170, 250 ] 318 0.049% 99.838% ( 250, 380 ] 391 0.060% 99.898% ( 380, 580 ] 391 0.060% 99.958% ( 580, 870 ] 361 0.055% 100.013% ( 870, 1300 ] 246 0.038% 100.051% ( 1300, 1900 ] 156 0.024% 100.075% ( 1900, 2900 ] 149 0.023% 100.097% ( 2900, 4400 ] 153 0.023% 100.121% ( 4400, 6600 ] 39 0.006% 100.127% ( 6600, 9900 ] 8 0.001% 100.128% ( 9900, 14000 ] 1 0.000% 100.128% ** Level 4 read latency histogram (micros): Count: 32187 Average: 9.9265 StdDev: 129.93 Min: 1 Median: 1.7249 Max: 6294 Percentiles: P50: 1.72 P75: 2.48 P99: 9.81 P99.9: 2081.30 P99.99: 4384.38 ------------------------------------------------------ [ 0, 1 ] 1623 5.042% 5.042% # ( 1, 2 ] 19962 62.019% 67.061% ############ ( 2, 3 ] 5326 16.547% 83.608% ### ( 3, 4 ] 2317 7.199% 90.807% # ( 4, 6 ] 2020 6.276% 97.083% # ( 6, 10 ] 648 2.013% 99.096% ( 10, 15 ] 54 0.168% 99.264% ( 15, 22 ] 10 0.031% 99.295% ( 22, 34 ] 2 0.006% 99.301% ( 34, 51 ] 2 0.006% 99.307% ( 51, 76 ] 1 0.003% 99.310% ( 76, 110 ] 3 0.009% 99.320% ( 110, 170 ] 11 0.034% 99.354% ( 170, 250 ] 30 0.093% 99.447% ( 250, 380 ] 23 0.071% 99.518% ( 380, 580 ] 32 0.099% 99.618% ( 580, 870 ] 43 0.134% 99.751% ( 870, 1300 ] 33 0.103% 99.854% ( 1300, 1900 ] 13 0.040% 99.894% ( 1900, 2900 ] 10 0.031% 99.925% ( 2900, 4400 ] 21 0.065% 99.991% ( 4400, 6600 ] 4 0.012% 100.003% ** Level 5 read latency histogram (micros): Count: 240 Average: 1122.2083 StdDev: 1223.43 Min: 72 Median: 551.4286 Max: 5264 Percentiles: P50: 551.43 P75: 1709.09 P99: 5264.00 P99.9: 5264.00 P99.99: 5264.00 ------------------------------------------------------ ( 51, 76 ] 3 1.250% 1.250% ( 76, 110 ] 17 7.083% 8.333% # ( 110, 170 ] 26 10.833% 19.167% ## ( 170, 250 ] 22 9.167% 28.333% ## ( 250, 380 ] 28 11.667% 40.000% ## ( 380, 580 ] 28 11.667% 51.667% ## ( 580, 870 ] 20 8.333% 60.000% ## ( 870, 1300 ] 21 8.750% 68.750% ## ( 1300, 1900 ] 22 9.167% 77.917% ## ( 1900, 2900 ] 27 11.250% 89.167% ## ( 2900, 4400 ] 19 7.917% 97.083% ## ( 4400, 6600 ] 7 2.917% 100.000% # ** DB Stats ** Uptime(secs): 50.1 total, 3.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 176.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.068 H:M:S, 50.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.602 H:M:S, 18.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/08/12-23:43:48 ... thread 0: (1000000,10000000) ops and (225470.9,184140.1) ops/second in (4.435162,54.306468) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 3.93 GB 220.3 8.7 0.0 8.7 18.1 9.5 0.0 1.9 142.9 298.8 62.15 57.38 170 0.366 9018K 11K 0.0 0.0 L1 13/13 1.39 GB 0.0 8.3 5.3 2.9 8.2 5.2 0.2 1.5 224.7 221.6 37.74 35.79 4 9.436 8206K 43K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.0 1.5 249.3 249.2 0.77 0.73 2 0.386 195K 87 0.0 0.0 L3 17/0 940.17 MB 0.9 4.6 3.2 1.4 4.6 3.1 1.0 1.4 164.8 164.4 28.45 21.06 22 1.293 4718K 9233 0.0 0.0 L4 151/0 9.42 GB 1.0 1.6 1.3 0.3 1.6 1.2 2.6 1.3 149.9 149.7 10.80 7.23 13 0.831 1516K 1449 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/22 105.47 GB 0.0 23.3 9.9 13.4 32.6 19.2 11.7 3.4 170.6 238.9 139.92 122.19 211 0.663 23M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.3 9.9 13.4 32.6 19.2 11.6 3.4 170.6 238.9 139.92 122.19 211 0.663 23M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.3 9.9 13.4 23.2 9.7 0.0 0.0 214.5 213.2 111.25 97.64 71 1.567 23M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 338.4 28.67 24.55 140 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.5 total, 54.3 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.64 GB write, 612.89 MB/s write, 23.30 GB read, 437.59 MB/s read, 139.9 seconds Interval compaction: 32.64 GB write, 615.45 MB/s write, 23.30 GB read, 439.42 MB/s read, 139.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 26, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 26, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 50, total-stops: 49, interval: 99 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4080304 Average: 2.5642 StdDev: 18.64 Min: 0 Median: 1.4982 Max: 4732 Percentiles: P50: 1.50 P75: 1.88 P99: 6.00 P99.9: 103.89 P99.99: 348.50 ------------------------------------------------------ [ 0, 1 ] 706223 17.308% 17.308% ### ( 1, 2 ] 2677263 65.614% 82.922% ############# ( 2, 3 ] 420379 10.303% 93.225% ## ( 3, 4 ] 142036 3.481% 96.706% # ( 4, 6 ] 93736 2.297% 99.003% ( 6, 10 ] 29100 0.713% 99.717% ( 10, 15 ] 5175 0.127% 99.843% ( 15, 22 ] 577 0.014% 99.857% ( 22, 34 ] 34 0.001% 99.858% ( 34, 51 ] 21 0.001% 99.859% ( 51, 76 ] 67 0.002% 99.860% ( 76, 110 ] 1966 0.048% 99.909% ( 110, 170 ] 2252 0.055% 99.964% ( 170, 250 ] 626 0.015% 99.979% ( 250, 380 ] 582 0.014% 99.993% ( 380, 580 ] 530 0.013% 100.006% ( 580, 870 ] 364 0.009% 100.015% ( 870, 1300 ] 163 0.004% 100.019% ( 1300, 1900 ] 59 0.001% 100.021% ( 1900, 2900 ] 45 0.001% 100.022% ( 2900, 4400 ] 29 0.001% 100.023% ( 4400, 6600 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1775206 Average: 4.9771 StdDev: 85.01 Min: 1 Median: 1.6285 Max: 11710 Percentiles: P50: 1.63 P75: 2.23 P99: 8.83 P99.9: 129.57 P99.99: 361.79 ------------------------------------------------------ [ 0, 1 ] 240005 13.520% 13.520% ### ( 1, 2 ] 1030463 58.048% 71.567% ############ ( 2, 3 ] 259323 14.608% 86.175% ### ( 3, 4 ] 110847 6.244% 92.420% # ( 4, 6 ] 97526 5.494% 97.913% # ( 6, 10 ] 27244 1.535% 99.448% ( 10, 15 ] 5278 0.297% 99.745% ( 15, 22 ] 667 0.038% 99.783% ( 22, 34 ] 37 0.002% 99.785% ( 34, 51 ] 17 0.001% 99.786% ( 51, 76 ] 168 0.009% 99.795% ( 76, 110 ] 1418 0.080% 99.875% ( 110, 170 ] 1342 0.076% 99.951% ( 170, 250 ] 365 0.021% 99.971% ( 250, 380 ] 382 0.022% 99.993% ( 380, 580 ] 403 0.023% 100.016% ( 580, 870 ] 362 0.020% 100.036% ( 870, 1300 ] 285 0.016% 100.052% ( 1300, 1900 ] 204 0.011% 100.064% ( 1900, 2900 ] 338 0.019% 100.083% ( 2900, 4400 ] 384 0.022% 100.104% ( 4400, 6600 ] 107 0.006% 100.110% ( 6600, 9900 ] 27 0.002% 100.112% ( 9900, 14000 ] 4 0.000% 100.112% ** Level 2 read latency histogram (micros): Count: 48813 Average: 2.7594 StdDev: 17.28 Min: 1 Median: 1.5464 Max: 999 Percentiles: P50: 1.55 P75: 1.92 P99: 6.15 P99.9: 179.50 P99.99: 877.29 ------------------------------------------------------ [ 0, 1 ] 6359 13.027% 13.027% ### ( 1, 2 ] 33032 67.670% 80.698% ############## ( 2, 3 ] 5431 11.126% 91.824% ## ( 3, 4 ] 2160 4.425% 96.249% # ( 4, 6 ] 1328 2.721% 98.970% # ( 6, 10 ] 392 0.803% 99.773% ( 10, 15 ] 34 0.070% 99.842% ( 15, 22 ] 6 0.012% 99.855% ( 22, 34 ] 2 0.004% 99.859% ( 34, 51 ] 1 0.002% 99.861% ( 51, 76 ] 2 0.004% 99.865% ( 76, 110 ] 2 0.004% 99.869% ( 110, 170 ] 14 0.029% 99.898% ( 170, 250 ] 10 0.020% 99.918% ( 250, 380 ] 14 0.029% 99.947% ( 380, 580 ] 16 0.033% 99.980% ( 580, 870 ] 5 0.010% 99.990% ( 870, 1300 ] 7 0.014% 100.004% ** Level 3 read latency histogram (micros): Count: 653876 Average: 6.3552 StdDev: 90.71 Min: 1 Median: 1.8321 Max: 11497 Percentiles: P50: 1.83 P75: 2.73 P99: 9.18 P99.9: 386.20 P99.99: 748.39 ------------------------------------------------------ [ 0, 1 ] 16226 2.482% 2.482% ( 1, 2 ] 373425 57.109% 59.591% ########### ( 2, 3 ] 137749 21.067% 80.657% #### ( 3, 4 ] 60037 9.182% 89.839% ## ( 4, 6 ] 50963 7.794% 97.633% ## ( 6, 10 ] 11241 1.719% 99.352% ( 10, 15 ] 2032 0.311% 99.663% ( 15, 22 ] 229 0.035% 99.698% ( 22, 34 ] 32 0.005% 99.703% ( 34, 51 ] 11 0.002% 99.705% ( 51, 76 ] 19 0.003% 99.708% ( 76, 110 ] 132 0.020% 99.728% ( 110, 170 ] 405 0.062% 99.790% ( 170, 250 ] 318 0.049% 99.838% ( 250, 380 ] 391 0.060% 99.898% ( 380, 580 ] 391 0.060% 99.958% ( 580, 870 ] 361 0.055% 100.013% ( 870, 1300 ] 246 0.038% 100.051% ( 1300, 1900 ] 156 0.024% 100.075% ( 1900, 2900 ] 149 0.023% 100.097% ( 2900, 4400 ] 153 0.023% 100.121% ( 4400, 6600 ] 39 0.006% 100.127% ( 6600, 9900 ] 8 0.001% 100.128% ( 9900, 14000 ] 1 0.000% 100.128% ** Level 4 read latency histogram (micros): Count: 32187 Average: 9.9265 StdDev: 129.93 Min: 1 Median: 1.7249 Max: 6294 Percentiles: P50: 1.72 P75: 2.48 P99: 9.81 P99.9: 2081.30 P99.99: 4384.38 ------------------------------------------------------ [ 0, 1 ] 1623 5.042% 5.042% # ( 1, 2 ] 19962 62.019% 67.061% ############ ( 2, 3 ] 5326 16.547% 83.608% ### ( 3, 4 ] 2317 7.199% 90.807% # ( 4, 6 ] 2020 6.276% 97.083% # ( 6, 10 ] 648 2.013% 99.096% ( 10, 15 ] 54 0.168% 99.264% ( 15, 22 ] 10 0.031% 99.295% ( 22, 34 ] 2 0.006% 99.301% ( 34, 51 ] 2 0.006% 99.307% ( 51, 76 ] 1 0.003% 99.310% ( 76, 110 ] 3 0.009% 99.320% ( 110, 170 ] 11 0.034% 99.354% ( 170, 250 ] 30 0.093% 99.447% ( 250, 380 ] 23 0.071% 99.518% ( 380, 580 ] 32 0.099% 99.618% ( 580, 870 ] 43 0.134% 99.751% ( 870, 1300 ] 33 0.103% 99.854% ( 1300, 1900 ] 13 0.040% 99.894% ( 1900, 2900 ] 10 0.031% 99.925% ( 2900, 4400 ] 21 0.065% 99.991% ( 4400, 6600 ] 4 0.012% 100.003% ** Level 5 read latency histogram (micros): Count: 240 Average: 1122.2083 StdDev: 1223.43 Min: 72 Median: 551.4286 Max: 5264 Percentiles: P50: 551.43 P75: 1709.09 P99: 5264.00 P99.9: 5264.00 P99.99: 5264.00 ------------------------------------------------------ ( 51, 76 ] 3 1.250% 1.250% ( 76, 110 ] 17 7.083% 8.333% # ( 110, 170 ] 26 10.833% 19.167% ## ( 170, 250 ] 22 9.167% 28.333% ## ( 250, 380 ] 28 11.667% 40.000% ## ( 380, 580 ] 28 11.667% 51.667% ## ( 580, 870 ] 20 8.333% 60.000% ## ( 870, 1300 ] 21 8.750% 68.750% ## ( 1300, 1900 ] 22 9.167% 77.917% ## ( 1900, 2900 ] 27 11.250% 89.167% ## ( 2900, 4400 ] 19 7.917% 97.083% ## ( 4400, 6600 ] 7 2.917% 100.000% # ** DB Stats ** Uptime(secs): 54.5 total, 4.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 180.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.907 H:M:S, 49.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 221.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.839 H:M:S, 41.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.801 micros/op 172378 ops/sec 60.002 seconds 10342999 operations; 167.0 MB/s Microseconds per write: Count: 10342999 Average: 5.8012 StdDev: 349.72 Min: 0 Median: 1.7296 Max: 814960 Percentiles: P50: 1.73 P75: 2.74 P99: 9.39 P99.9: 1154.26 P99.99: 2678.71 ------------------------------------------------------ [ 0, 1 ] 1436589 13.889% 13.889% ### ( 1, 2 ] 5118896 49.491% 63.381% ########## ( 2, 3 ] 1622329 15.685% 79.066% ### ( 3, 4 ] 1406590 13.599% 92.666% ### ( 4, 6 ] 546762 5.286% 97.952% # ( 6, 10 ] 127871 1.236% 99.188% ( 10, 15 ] 40394 0.391% 99.579% ( 15, 22 ] 9139 0.088% 99.667% ( 22, 34 ] 1655 0.016% 99.683% ( 34, 51 ] 201 0.002% 99.685% ( 51, 76 ] 30 0.000% 99.685% ( 76, 110 ] 7411 0.072% 99.757% ( 110, 170 ] 2670 0.026% 99.783% ( 170, 250 ] 248 0.002% 99.785% ( 250, 380 ] 168 0.002% 99.787% ( 380, 580 ] 21 0.000% 99.787% ( 580, 870 ] 11 0.000% 99.787% ( 870, 1300 ] 17655 0.171% 99.958% ( 1300, 1900 ] 58 0.001% 99.958% ( 1900, 2900 ] 4195 0.041% 99.999% ( 2900, 4400 ] 71 0.001% 100.000% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 186929 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10342999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10673974968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 478 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31619348 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29792306949 rocksdb.compact.write.bytes COUNT : 29613839674 rocksdb.flush.write.bytes COUNT : 10569091074 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 59 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 187 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10483876864 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4101120 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29889532610 rocksdb.non.last.level.read.count COUNT : 7220694 rocksdb.block.checksum.compute.count COUNT : 7219797 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.372045 P95 : 3.917219 P99 : 8.008930 P100 : 814950.000000 COUNT : 10342999 SUM : 55154938 rocksdb.compaction.times.micros P50 : 1044166.666667 P95 : 4072500.000000 P99 : 16160000.000000 P100 : 19912690.000000 COUNT : 73 SUM : 116632051 rocksdb.compaction.times.cpu_micros P50 : 956486.486486 P95 : 3722500.000000 P99 : 16160000.000000 P100 : 18622217.000000 COUNT : 73 SUM : 102650614 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 663.424658 P95 : 1216.529412 P99 : 6094.000000 P100 : 16553.000000 COUNT : 146 SUM : 121044 rocksdb.compaction.outfile.sync.micros P50 : 982.173913 P95 : 29370.000000 P99 : 74250.000000 P100 : 203672.000000 COUNT : 306 SUM : 1758185 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.857143 P95 : 789.214286 P99 : 3605.000000 P100 : 4671.000000 COUNT : 259 SUM : 59805 rocksdb.table.open.io.micros P50 : 1484.615385 P95 : 7901.666667 P99 : 12492.461538 P100 : 13256.000000 COUNT : 478 SUM : 1044962 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.615706 P95 : 7.164955 P99 : 10.320910 P100 : 15638.000000 COUNT : 7218569 SUM : 41546210 rocksdb.read.block.get.micros P50 : 488.510638 P95 : 3548.979592 P99 : 5548.400000 P100 : 6368.000000 COUNT : 956 SUM : 857205 rocksdb.write.raw.block.micros P50 : 0.511979 P95 : 0.972759 P99 : 2.794000 P100 : 11990.000000 COUNT : 9737120 SUM : 18374779 rocksdb.numfiles.in.singlecompaction P50 : 3.217391 P95 : 5.440000 P99 : 21.020000 P100 : 25.000000 COUNT : 128 SUM : 478 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562046 P95 : 1161.344231 P99 : 2440.246411 P100 : 814766.000000 COUNT : 199877 SUM : 31638988 rocksdb.sst.read.micros P50 : 1.559878 P95 : 4.087096 P99 : 8.138065 P100 : 11710.000000 COUNT : 7221052 SUM : 26657124 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10342999 SUM : 10673974968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206504.854369 P95 : 347000.000000 P99 : 540866.666667 P100 : 957179.000000 COUNT : 146 SUM : 29757213 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 303 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0