[2024-11-20 21:53:53.061299] Starting SPDK v25.01-pre git sha1 557f022f6 / DPDK 22.11.4 initialization... [2024-11-20 21:53:53.061581] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid125064 ] Set seed to 1732136033054641 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 21:53:53.165722] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 21:53:53.187244] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 21:53:53.187289] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 125064' to capture a snapshot of events at runtime. [2024-11-20 21:53:53.187299] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 21:53:53.187310] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 21:53:53.187319] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid125064 for offline analysis/debug. [2024-11-20 21:53:53.187871] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 21:53:57 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-21:54:00 ... thread 0: (1000000,1000000) ops and (332667.7,332667.7) ops/second in (3.006003,3.006003) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.96 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 347.4 2.54 2.30 12 0.212 0 0 0.0 0.0 L1 3/3 251.77 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 251.7 251.4 1.00 0.98 1 1.001 255K 198 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 17/0 818.38 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.9 210.9 0.30 0.26 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 98.3 301.8 4.33 4.00 15 0.289 432K 229 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 98.3 301.8 4.33 4.00 15 0.289 432K 229 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 237.5 237.3 1.79 1.70 3 0.598 432K 229 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 347.4 2.54 2.30 12 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 406.32 MB/s write, 0.42 GB read, 132.33 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 434.65 MB/s write, 0.42 GB read, 141.56 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104598 Average: 1.7937 StdDev: 17.61 Min: 0 Median: 1.1516 Max: 3425 Percentiles: P50: 1.15 P75: 1.60 P99: 3.41 P99.9: 9.08 P99.99: 264.05 ------------------------------------------------------ [ 0, 1 ] 43533 41.619% 41.619% ######## ( 1, 2 ] 57833 55.291% 96.910% ########### ( 2, 3 ] 1854 1.773% 98.683% ( 3, 4 ] 809 0.773% 99.456% ( 4, 6 ] 310 0.296% 99.752% ( 6, 10 ] 202 0.193% 99.946% ( 10, 15 ] 21 0.020% 99.966% ( 15, 22 ] 7 0.007% 99.972% ( 22, 34 ] 3 0.003% 99.975% ( 51, 76 ] 3 0.003% 99.978% ( 110, 170 ] 4 0.004% 99.982% ( 170, 250 ] 9 0.009% 99.990% ( 250, 380 ] 5 0.005% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 19710 Average: 1.7811 StdDev: 10.07 Min: 1 Median: 1.1688 Max: 1031 Percentiles: P50: 1.17 P75: 1.61 P99: 3.32 P99.9: 9.12 P99.99: 588.41 ------------------------------------------------------ [ 0, 1 ] 7972 40.446% 40.446% ######## ( 1, 2 ] 11154 56.591% 97.037% ########### ( 2, 3 ] 336 1.705% 98.742% ( 3, 4 ] 158 0.802% 99.543% ( 4, 6 ] 50 0.254% 99.797% ( 6, 10 ] 26 0.132% 99.929% ( 10, 15 ] 5 0.025% 99.954% ( 15, 22 ] 4 0.020% 99.975% ( 22, 34 ] 1 0.005% 99.980% ( 250, 380 ] 2 0.010% 99.990% ( 580, 870 ] 1 0.005% 99.995% ( 870, 1300 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 28165 Average: 2.5170 StdDev: 25.19 Min: 1 Median: 1.2268 Max: 2579 Percentiles: P50: 1.23 P75: 1.68 P99: 6.44 P99.9: 238.45 P99.99: 1355.05 ------------------------------------------------------ [ 0, 1 ] 10547 37.447% 37.447% ####### ( 1, 2 ] 15591 55.356% 92.803% ########### ( 2, 3 ] 1097 3.895% 96.698% # ( 3, 4 ] 288 1.023% 97.721% ( 4, 6 ] 340 1.207% 98.928% ( 6, 10 ] 184 0.653% 99.581% ( 10, 15 ] 33 0.117% 99.698% ( 15, 22 ] 7 0.025% 99.723% ( 22, 34 ] 1 0.004% 99.727% ( 34, 51 ] 21 0.075% 99.801% ( 51, 76 ] 8 0.028% 99.830% ( 76, 110 ] 5 0.018% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.908% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 3 0.011% 99.986% ( 870, 1300 ] 1 0.004% 99.989% ( 1300, 1900 ] 2 0.007% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 765.8706 StdDev: 1023.72 Min: 1 Median: 263.0000 Max: 4039 Percentiles: P50: 263.00 P75: 1232.81 P99: 4039.00 P99.9: 4039.00 P99.99: 4039.00 ------------------------------------------------------ [ 0, 1 ] 29 34.118% 34.118% ####### ( 1, 2 ] 5 5.882% 40.000% # ( 2, 3 ] 2 2.353% 42.353% ( 3, 4 ] 1 1.176% 43.529% ( 170, 250 ] 5 5.882% 49.412% # ( 250, 380 ] 5 5.882% 55.294% # ( 380, 580 ] 5 5.882% 61.176% # ( 580, 870 ] 5 5.882% 67.059% # ( 870, 1300 ] 8 9.412% 76.471% ## ( 1300, 1900 ] 7 8.235% 84.706% ## ( 1900, 2900 ] 7 8.235% 92.941% ## ( 2900, 4400 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1706.3667 StdDev: 980.83 Min: 165 Median: 1540.0000 Max: 3847 Percentiles: P50: 1540.00 P75: 2200.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ ( 110, 170 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 5 16.667% 36.667% ### ( 1300, 1900 ] 10 33.333% 70.000% ####### ( 1900, 2900 ] 5 16.667% 86.667% ### ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 305.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.405 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-21:54:03 ... thread 0: (1000000,2000000) ops and (327480.5,330053.7) ops/second in (3.053617,6.059620) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.23 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.4 326.6 7.52 6.94 28 0.269 575K 585 0.0 0.0 L1 6/6 565.49 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 240.1 239.7 3.41 3.33 2 1.705 831K 1416 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 17/0 818.38 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.9 210.9 0.30 0.26 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/15 97.98 GB 0.0 1.5 0.6 0.9 3.4 2.5 0.1 1.8 133.0 294.1 11.72 10.99 32 0.366 1583K 2032 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.4 2.5 0.1 1.8 133.0 294.1 11.72 10.99 32 0.366 1583K 2032 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 246.9 246.6 6.32 6.12 6 1.053 1583K 2032 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.6 5.41 4.86 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.37 GB write, 549.67 MB/s write, 1.52 GB read, 248.67 MB/s read, 11.7 seconds Interval compaction: 3.37 GB write, 568.68 MB/s write, 1.52 GB read, 257.28 MB/s read, 11.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389645 Average: 2.0651 StdDev: 11.54 Min: 0 Median: 1.4150 Max: 3425 Percentiles: P50: 1.41 P75: 1.81 P99: 5.28 P99.9: 9.65 P99.99: 14.56 ------------------------------------------------------ [ 0, 1 ] 92734 23.800% 23.800% ##### ( 1, 2 ] 246018 63.139% 86.939% ############# ( 2, 3 ] 33002 8.470% 95.408% ## ( 3, 4 ] 10054 2.580% 97.989% # ( 4, 6 ] 6144 1.577% 99.566% ( 6, 10 ] 1429 0.367% 99.932% ( 10, 15 ] 247 0.063% 99.996% ( 15, 22 ] 21 0.005% 100.001% ( 22, 34 ] 6 0.002% 100.003% ( 34, 51 ] 2 0.001% 100.003% ( 51, 76 ] 7 0.002% 100.005% ( 110, 170 ] 11 0.003% 100.008% ( 170, 250 ] 13 0.003% 100.011% ( 250, 380 ] 14 0.004% 100.015% ( 380, 580 ] 2 0.001% 100.015% ( 580, 870 ] 6 0.002% 100.017% ( 870, 1300 ] 3 0.001% 100.017% ( 1300, 1900 ] 2 0.001% 100.018% ( 1900, 2900 ] 3 0.001% 100.019% ( 2900, 4400 ] 2 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 94030 Average: 2.0990 StdDev: 9.18 Min: 0 Median: 1.4376 Max: 1344 Percentiles: P50: 1.44 P75: 1.83 P99: 5.29 P99.9: 9.66 P99.99: 316.80 ------------------------------------------------------ [ 0, 1 ] 20653 21.964% 21.964% #### ( 1, 2 ] 60243 64.068% 86.032% ############# ( 2, 3 ] 8884 9.448% 95.480% ## ( 3, 4 ] 2272 2.416% 97.896% ( 4, 6 ] 1617 1.720% 99.616% ( 6, 10 ] 294 0.313% 99.929% ( 10, 15 ] 44 0.047% 99.976% ( 15, 22 ] 7 0.007% 99.983% ( 22, 34 ] 2 0.002% 99.985% ( 34, 51 ] 1 0.001% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 250, 380 ] 7 0.007% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 4 0.004% 100.001% ( 1300, 1900 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 28165 Average: 2.5170 StdDev: 25.19 Min: 1 Median: 1.2268 Max: 2579 Percentiles: P50: 1.23 P75: 1.68 P99: 6.44 P99.9: 238.45 P99.99: 1355.05 ------------------------------------------------------ [ 0, 1 ] 10547 37.447% 37.447% ####### ( 1, 2 ] 15591 55.356% 92.803% ########### ( 2, 3 ] 1097 3.895% 96.698% # ( 3, 4 ] 288 1.023% 97.721% ( 4, 6 ] 340 1.207% 98.928% ( 6, 10 ] 184 0.653% 99.581% ( 10, 15 ] 33 0.117% 99.698% ( 15, 22 ] 7 0.025% 99.723% ( 22, 34 ] 1 0.004% 99.727% ( 34, 51 ] 21 0.075% 99.801% ( 51, 76 ] 8 0.028% 99.830% ( 76, 110 ] 5 0.018% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.908% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 3 0.011% 99.986% ( 870, 1300 ] 1 0.004% 99.989% ( 1300, 1900 ] 2 0.007% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 765.8706 StdDev: 1023.72 Min: 1 Median: 263.0000 Max: 4039 Percentiles: P50: 263.00 P75: 1232.81 P99: 4039.00 P99.9: 4039.00 P99.99: 4039.00 ------------------------------------------------------ [ 0, 1 ] 29 34.118% 34.118% ####### ( 1, 2 ] 5 5.882% 40.000% # ( 2, 3 ] 2 2.353% 42.353% ( 3, 4 ] 1 1.176% 43.529% ( 170, 250 ] 5 5.882% 49.412% # ( 250, 380 ] 5 5.882% 55.294% # ( 380, 580 ] 5 5.882% 61.176% # ( 580, 870 ] 5 5.882% 67.059% # ( 870, 1300 ] 8 9.412% 76.471% ## ( 1300, 1900 ] 7 8.235% 84.706% ## ( 1900, 2900 ] 7 8.235% 92.941% ## ( 2900, 4400 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1706.3667 StdDev: 980.83 Min: 165 Median: 1540.0000 Max: 3847 Percentiles: P50: 1540.00 P75: 2200.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ ( 110, 170 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 5 16.667% 36.667% ### ( 1300, 1900 ] 10 33.333% 70.000% ####### ( 1900, 2900 ] 5 16.667% 86.667% ### ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 6.3 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 313.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.831 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.426 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-21:54:06 ... thread 0: (1000000,3000000) ops and (332017.2,330705.6) ops/second in (3.011892,9.071512) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.15 GB 113.3 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.3 317.7 13.28 12.35 44 0.302 1407K 1423 0.0 0.0 L1 6/6 565.49 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 240.1 239.7 3.41 3.33 2 1.705 831K 1416 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 17/0 818.38 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.9 210.9 0.30 0.26 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1199/15 98.90 GB 0.0 2.3 0.6 1.7 5.1 3.4 0.1 1.8 136.0 298.0 17.48 16.40 48 0.364 2415K 2870 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.6 1.7 5.1 3.4 0.1 1.8 136.0 298.0 17.48 16.40 48 0.364 2415K 2870 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.6 1.7 2.3 0.6 0.0 0.0 252.8 252.5 9.41 9.15 9 1.045 2415K 2870 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.0 8.08 7.25 39 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.09 GB write, 561.24 MB/s write, 2.32 GB read, 256.21 MB/s read, 17.5 seconds Interval compaction: 5.09 GB write, 574.21 MB/s write, 2.32 GB read, 262.13 MB/s read, 17.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 710135 Average: 2.1235 StdDev: 9.39 Min: 0 Median: 1.4688 Max: 3425 Percentiles: P50: 1.47 P75: 1.85 P99: 5.37 P99.9: 9.63 P99.99: 14.11 ------------------------------------------------------ [ 0, 1 ] 138746 19.538% 19.538% #### ( 1, 2 ] 461415 64.976% 84.514% ############# ( 2, 3 ] 72968 10.275% 94.789% ## ( 3, 4 ] 20906 2.944% 97.733% # ( 4, 6 ] 13136 1.850% 99.583% ( 6, 10 ] 2485 0.350% 99.933% ( 10, 15 ] 497 0.070% 100.003% ( 15, 22 ] 54 0.008% 100.010% ( 22, 34 ] 13 0.002% 100.012% ( 34, 51 ] 3 0.000% 100.012% ( 51, 76 ] 9 0.001% 100.014% ( 110, 170 ] 13 0.002% 100.015% ( 170, 250 ] 21 0.003% 100.018% ( 250, 380 ] 19 0.003% 100.021% ( 380, 580 ] 4 0.001% 100.022% ( 580, 870 ] 16 0.002% 100.024% ( 870, 1300 ] 7 0.001% 100.025% ( 1300, 1900 ] 2 0.000% 100.025% ( 1900, 2900 ] 3 0.000% 100.026% ( 2900, 4400 ] 3 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 166137 Average: 2.1346 StdDev: 6.93 Min: 0 Median: 1.4913 Max: 1344 Percentiles: P50: 1.49 P75: 1.87 P99: 5.38 P99.9: 9.85 P99.99: 31.55 ------------------------------------------------------ [ 0, 1 ] 29399 17.696% 17.696% #### ( 1, 2 ] 109248 65.758% 83.453% ############# ( 2, 3 ] 19124 11.511% 94.964% ## ( 3, 4 ] 4520 2.721% 97.685% # ( 4, 6 ] 3172 1.909% 99.594% ( 6, 10 ] 528 0.318% 99.912% ( 10, 15 ] 113 0.068% 99.980% ( 15, 22 ] 14 0.008% 99.989% ( 22, 34 ] 3 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 1 0.001% 99.992% ( 110, 170 ] 1 0.001% 99.992% ( 250, 380 ] 7 0.004% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 4 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28165 Average: 2.5170 StdDev: 25.19 Min: 1 Median: 1.2268 Max: 2579 Percentiles: P50: 1.23 P75: 1.68 P99: 6.44 P99.9: 238.45 P99.99: 1355.05 ------------------------------------------------------ [ 0, 1 ] 10547 37.447% 37.447% ####### ( 1, 2 ] 15591 55.356% 92.803% ########### ( 2, 3 ] 1097 3.895% 96.698% # ( 3, 4 ] 288 1.023% 97.721% ( 4, 6 ] 340 1.207% 98.928% ( 6, 10 ] 184 0.653% 99.581% ( 10, 15 ] 33 0.117% 99.698% ( 15, 22 ] 7 0.025% 99.723% ( 22, 34 ] 1 0.004% 99.727% ( 34, 51 ] 21 0.075% 99.801% ( 51, 76 ] 8 0.028% 99.830% ( 76, 110 ] 5 0.018% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.908% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 3 0.011% 99.986% ( 870, 1300 ] 1 0.004% 99.989% ( 1300, 1900 ] 2 0.007% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 765.8706 StdDev: 1023.72 Min: 1 Median: 263.0000 Max: 4039 Percentiles: P50: 263.00 P75: 1232.81 P99: 4039.00 P99.9: 4039.00 P99.99: 4039.00 ------------------------------------------------------ [ 0, 1 ] 29 34.118% 34.118% ####### ( 1, 2 ] 5 5.882% 40.000% # ( 2, 3 ] 2 2.353% 42.353% ( 3, 4 ] 1 1.176% 43.529% ( 170, 250 ] 5 5.882% 49.412% # ( 250, 380 ] 5 5.882% 55.294% # ( 380, 580 ] 5 5.882% 61.176% # ( 580, 870 ] 5 5.882% 67.059% # ( 870, 1300 ] 8 9.412% 76.471% ## ( 1300, 1900 ] 7 8.235% 84.706% ## ( 1900, 2900 ] 7 8.235% 92.941% ## ( 2900, 4400 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1706.3667 StdDev: 980.83 Min: 165 Median: 1540.0000 Max: 3847 Percentiles: P50: 1540.00 P75: 2200.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ ( 110, 170 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 5 16.667% 36.667% ### ( 1300, 1900 ] 10 33.333% 70.000% ####### ( 1900, 2900 ] 5 16.667% 86.667% ### ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 9.3 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 318.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.216 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.385 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-21:54:09 ... thread 0: (1000000,4000000) ops and (332738.1,331211.4) ops/second in (3.005367,12.076879) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/15 2.34 GB 0.0 2.2 0.0 2.2 5.9 3.8 0.0 1.6 114.5 313.8 19.26 17.96 61 0.316 2238K 2292 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 231.8 230.9 9.50 9.23 3 3.168 2236K 8594 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 17/0 818.38 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.9 210.9 0.30 0.26 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1205/27 99.88 GB 0.0 4.5 1.4 3.1 8.2 5.2 0.1 2.2 155.0 284.6 29.56 27.91 66 0.448 4651K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.4 3.1 8.2 5.2 0.1 2.2 155.0 284.6 29.56 27.91 66 0.448 4651K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.4 3.1 4.5 1.4 0.0 0.0 245.8 245.2 18.63 18.12 13 1.433 4651K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 351.8 10.92 9.79 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.22 GB write, 684.58 MB/s write, 4.47 GB read, 372.80 MB/s read, 29.6 seconds Interval compaction: 8.22 GB write, 696.47 MB/s write, 4.47 GB read, 379.27 MB/s read, 29.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 19, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 963946 Average: 2.2084 StdDev: 12.13 Min: 0 Median: 1.4826 Max: 3605 Percentiles: P50: 1.48 P75: 1.87 P99: 5.48 P99.9: 10.14 P99.99: 21.80 ------------------------------------------------------ [ 0, 1 ] 180324 18.707% 18.707% #### ( 1, 2 ] 625030 64.841% 83.548% ############# ( 2, 3 ] 105635 10.959% 94.506% ## ( 3, 4 ] 29117 3.021% 97.527% # ( 4, 6 ] 19161 1.988% 99.515% ( 6, 10 ] 3694 0.383% 99.898% ( 10, 15 ] 809 0.084% 99.982% ( 15, 22 ] 84 0.009% 99.990% ( 22, 34 ] 17 0.002% 99.992% ( 34, 51 ] 4 0.000% 99.993% ( 51, 76 ] 12 0.001% 99.994% ( 76, 110 ] 36 0.004% 99.998% ( 110, 170 ] 89 0.009% 100.007% ( 170, 250 ] 50 0.005% 100.012% ( 250, 380 ] 53 0.005% 100.018% ( 380, 580 ] 34 0.004% 100.021% ( 580, 870 ] 24 0.002% 100.024% ( 870, 1300 ] 13 0.001% 100.025% ( 1300, 1900 ] 4 0.000% 100.025% ( 1900, 2900 ] 6 0.001% 100.026% ( 2900, 4400 ] 6 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 229626 Average: 2.3318 StdDev: 11.94 Min: 0 Median: 1.4967 Max: 1831 Percentiles: P50: 1.50 P75: 1.88 P99: 5.63 P99.9: 15.69 P99.99: 559.34 ------------------------------------------------------ [ 0, 1 ] 40906 17.814% 17.814% #### ( 1, 2 ] 148791 64.797% 82.611% ############# ( 2, 3 ] 27550 11.998% 94.609% ## ( 3, 4 ] 6228 2.712% 97.321% # ( 4, 6 ] 4744 2.066% 99.387% ( 6, 10 ] 971 0.423% 99.810% ( 10, 15 ] 204 0.089% 99.899% ( 15, 22 ] 24 0.010% 99.909% ( 22, 34 ] 3 0.001% 99.911% ( 34, 51 ] 1 0.000% 99.911% ( 51, 76 ] 7 0.003% 99.914% ( 76, 110 ] 73 0.032% 99.946% ( 110, 170 ] 40 0.017% 99.963% ( 170, 250 ] 22 0.010% 99.973% ( 250, 380 ] 22 0.010% 99.983% ( 380, 580 ] 19 0.008% 99.991% ( 580, 870 ] 8 0.003% 99.994% ( 870, 1300 ] 9 0.004% 99.998% ( 1300, 1900 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28165 Average: 2.5170 StdDev: 25.19 Min: 1 Median: 1.2268 Max: 2579 Percentiles: P50: 1.23 P75: 1.68 P99: 6.44 P99.9: 238.45 P99.99: 1355.05 ------------------------------------------------------ [ 0, 1 ] 10547 37.447% 37.447% ####### ( 1, 2 ] 15591 55.356% 92.803% ########### ( 2, 3 ] 1097 3.895% 96.698% # ( 3, 4 ] 288 1.023% 97.721% ( 4, 6 ] 340 1.207% 98.928% ( 6, 10 ] 184 0.653% 99.581% ( 10, 15 ] 33 0.117% 99.698% ( 15, 22 ] 7 0.025% 99.723% ( 22, 34 ] 1 0.004% 99.727% ( 34, 51 ] 21 0.075% 99.801% ( 51, 76 ] 8 0.028% 99.830% ( 76, 110 ] 5 0.018% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.908% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 3 0.011% 99.986% ( 870, 1300 ] 1 0.004% 99.989% ( 1300, 1900 ] 2 0.007% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 765.8706 StdDev: 1023.72 Min: 1 Median: 263.0000 Max: 4039 Percentiles: P50: 263.00 P75: 1232.81 P99: 4039.00 P99.9: 4039.00 P99.99: 4039.00 ------------------------------------------------------ [ 0, 1 ] 29 34.118% 34.118% ####### ( 1, 2 ] 5 5.882% 40.000% # ( 2, 3 ] 2 2.353% 42.353% ( 3, 4 ] 1 1.176% 43.529% ( 170, 250 ] 5 5.882% 49.412% # ( 250, 380 ] 5 5.882% 55.294% # ( 380, 580 ] 5 5.882% 61.176% # ( 580, 870 ] 5 5.882% 67.059% # ( 870, 1300 ] 8 9.412% 76.471% ## ( 1300, 1900 ] 7 8.235% 84.706% ## ( 1900, 2900 ] 7 8.235% 92.941% ## ( 2900, 4400 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1706.3667 StdDev: 980.83 Min: 165 Median: 1540.0000 Max: 3847 Percentiles: P50: 1540.00 P75: 2200.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ ( 110, 170 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 5 16.667% 36.667% ### ( 1300, 1900 ] 10 33.333% 70.000% ####### ( 1900, 2900 ] 5 16.667% 86.667% ### ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 12.3 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.608 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-21:54:12 ... thread 0: (1000000,5000000) ops and (293583.8,322933.5) ops/second in (3.406183,15.483062) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.26 GB 94.4 3.0 0.0 3.0 7.7 4.7 0.0 1.6 122.2 311.5 25.27 23.62 77 0.328 3134K 3287 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 231.8 230.9 9.50 9.23 3 3.168 2236K 8594 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 17/0 818.38 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.9 210.9 0.30 0.26 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1209/27 100.80 GB 0.0 5.3 1.4 3.9 10.0 6.1 0.1 2.1 153.6 287.9 35.56 33.57 82 0.434 5547K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 1.4 3.9 10.0 6.1 0.1 2.1 153.6 287.9 35.56 33.57 82 0.434 5547K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 1.4 3.9 5.3 1.4 0.0 0.0 249.2 248.6 21.92 21.36 16 1.370 5547K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 351.0 13.64 12.21 66 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.5 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.00 GB write, 652.34 MB/s write, 5.34 GB read, 348.09 MB/s read, 35.6 seconds Interval compaction: 10.00 GB write, 661.17 MB/s write, 5.34 GB read, 352.80 MB/s read, 35.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 23, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1344154 Average: 2.2507 StdDev: 11.91 Min: 0 Median: 1.5037 Max: 3605 Percentiles: P50: 1.50 P75: 1.89 P99: 5.56 P99.9: 10.89 P99.99: 95.55 ------------------------------------------------------ [ 0, 1 ] 229679 17.087% 17.087% ### ( 1, 2 ] 878240 65.338% 82.425% ############# ( 2, 3 ] 158929 11.824% 94.249% ## ( 3, 4 ] 42106 3.133% 97.381% # ( 4, 6 ] 27971 2.081% 99.462% ( 6, 10 ] 5672 0.422% 99.884% ( 10, 15 ] 1197 0.089% 99.973% ( 15, 22 ] 125 0.009% 99.983% ( 22, 34 ] 22 0.002% 99.984% ( 34, 51 ] 9 0.001% 99.985% ( 51, 76 ] 23 0.002% 99.987% ( 76, 110 ] 81 0.006% 99.993% ( 110, 170 ] 157 0.012% 100.004% ( 170, 250 ] 90 0.007% 100.011% ( 250, 380 ] 76 0.006% 100.017% ( 380, 580 ] 51 0.004% 100.020% ( 580, 870 ] 35 0.003% 100.023% ( 870, 1300 ] 18 0.001% 100.024% ( 1300, 1900 ] 8 0.001% 100.025% ( 1900, 2900 ] 7 0.001% 100.025% ( 2900, 4400 ] 7 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 306229 Average: 2.4201 StdDev: 11.36 Min: 0 Median: 1.5235 Max: 1831 Percentiles: P50: 1.52 P75: 1.91 P99: 5.98 P99.9: 92.95 P99.99: 516.13 ------------------------------------------------------ [ 0, 1 ] 48311 15.776% 15.776% ### ( 1, 2 ] 200195 65.374% 81.150% ############# ( 2, 3 ] 39276 12.826% 93.976% ### ( 3, 4 ] 8827 2.882% 96.859% # ( 4, 6 ] 6639 2.168% 99.027% ( 6, 10 ] 2236 0.730% 99.757% ( 10, 15 ] 302 0.099% 99.855% ( 15, 22 ] 43 0.014% 99.869% ( 22, 34 ] 3 0.001% 99.870% ( 34, 51 ] 1 0.000% 99.871% ( 51, 76 ] 7 0.002% 99.873% ( 76, 110 ] 166 0.054% 99.927% ( 110, 170 ] 101 0.033% 99.960% ( 170, 250 ] 37 0.012% 99.972% ( 250, 380 ] 36 0.012% 99.984% ( 380, 580 ] 27 0.009% 99.993% ( 580, 870 ] 8 0.003% 99.995% ( 870, 1300 ] 10 0.003% 99.999% ( 1300, 1900 ] 4 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28165 Average: 2.5170 StdDev: 25.19 Min: 1 Median: 1.2268 Max: 2579 Percentiles: P50: 1.23 P75: 1.68 P99: 6.44 P99.9: 238.45 P99.99: 1355.05 ------------------------------------------------------ [ 0, 1 ] 10547 37.447% 37.447% ####### ( 1, 2 ] 15591 55.356% 92.803% ########### ( 2, 3 ] 1097 3.895% 96.698% # ( 3, 4 ] 288 1.023% 97.721% ( 4, 6 ] 340 1.207% 98.928% ( 6, 10 ] 184 0.653% 99.581% ( 10, 15 ] 33 0.117% 99.698% ( 15, 22 ] 7 0.025% 99.723% ( 22, 34 ] 1 0.004% 99.727% ( 34, 51 ] 21 0.075% 99.801% ( 51, 76 ] 8 0.028% 99.830% ( 76, 110 ] 5 0.018% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.908% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 3 0.011% 99.986% ( 870, 1300 ] 1 0.004% 99.989% ( 1300, 1900 ] 2 0.007% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 765.8706 StdDev: 1023.72 Min: 1 Median: 263.0000 Max: 4039 Percentiles: P50: 263.00 P75: 1232.81 P99: 4039.00 P99.9: 4039.00 P99.99: 4039.00 ------------------------------------------------------ [ 0, 1 ] 29 34.118% 34.118% ####### ( 1, 2 ] 5 5.882% 40.000% # ( 2, 3 ] 2 2.353% 42.353% ( 3, 4 ] 1 1.176% 43.529% ( 170, 250 ] 5 5.882% 49.412% # ( 250, 380 ] 5 5.882% 55.294% # ( 380, 580 ] 5 5.882% 61.176% # ( 580, 870 ] 5 5.882% 67.059% # ( 870, 1300 ] 8 9.412% 76.471% ## ( 1300, 1900 ] 7 8.235% 84.706% ## ( 1900, 2900 ] 7 8.235% 92.941% ## ( 2900, 4400 ] 6 7.059% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1706.3667 StdDev: 980.83 Min: 165 Median: 1540.0000 Max: 3847 Percentiles: P50: 1540.00 P75: 2200.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ ( 110, 170 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 5 16.667% 36.667% ### ( 1300, 1900 ] 10 33.333% 70.000% ####### ( 1900, 2900 ] 5 16.667% 86.667% ### ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 15.7 total, 3.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 313.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.380 H:M:S, 15.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.772 H:M:S, 22.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-21:54:25 ... thread 0: (1000000,6000000) ops and (80722.7,215276.4) ops/second in (12.388082,27.871144) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 2.20 GB 0.0 5.7 0.0 5.7 11.3 5.6 0.0 2.0 148.8 297.4 38.93 36.41 99 0.393 5883K 12K 0.0 0.0 L1 15/15 1.82 GB 0.0 5.5 3.3 2.2 5.5 3.3 0.1 1.6 219.9 217.7 25.72 24.28 4 6.430 5743K 57K 0.0 0.0 L2 13/5 1.56 GB 10.3 0.1 0.1 0.0 0.1 0.1 1.5 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 17/10 818.38 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.9 210.9 0.30 0.26 1 0.296 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1210/35 101.73 GB 0.0 11.4 3.4 7.9 16.9 9.0 1.6 3.0 177.6 265.1 65.44 61.41 105 0.623 11M 69K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.4 3.4 7.9 16.9 9.0 1.6 3.0 177.6 265.1 65.44 61.41 105 0.623 11M 69K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.4 3.4 7.9 11.3 3.4 0.0 0.0 237.6 236.2 48.91 46.64 23 2.127 11M 69K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 350.6 16.53 14.77 82 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.1 total, 27.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.94 GB write, 617.79 MB/s write, 11.35 GB read, 413.92 MB/s read, 65.4 seconds Interval compaction: 16.94 GB write, 622.44 MB/s write, 11.35 GB read, 417.03 MB/s read, 65.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 23, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2364896 Average: 2.6758 StdDev: 15.89 Min: 0 Median: 1.4959 Max: 4336 Percentiles: P50: 1.50 P75: 1.88 P99: 6.15 P99.9: 147.33 P99.99: 324.65 ------------------------------------------------------ [ 0, 1 ] 409844 17.330% 17.330% ### ( 1, 2 ] 1558116 65.885% 83.215% ############# ( 2, 3 ] 253526 10.720% 93.936% ## ( 3, 4 ] 73339 3.101% 97.037% # ( 4, 6 ] 45887 1.940% 98.977% ( 6, 10 ] 14538 0.615% 99.592% ( 10, 15 ] 2372 0.100% 99.692% ( 15, 22 ] 272 0.012% 99.704% ( 22, 34 ] 29 0.001% 99.705% ( 34, 51 ] 15 0.001% 99.706% ( 51, 76 ] 51 0.002% 99.708% ( 76, 110 ] 2538 0.107% 99.815% ( 110, 170 ] 3221 0.136% 99.951% ( 170, 250 ] 660 0.028% 99.979% ( 250, 380 ] 438 0.019% 99.998% ( 380, 580 ] 363 0.015% 100.013% ( 580, 870 ] 144 0.006% 100.019% ( 870, 1300 ] 42 0.002% 100.021% ( 1300, 1900 ] 15 0.001% 100.022% ( 1900, 2900 ] 11 0.000% 100.022% ( 2900, 4400 ] 13 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 581110 Average: 2.7258 StdDev: 16.38 Min: 0 Median: 1.5222 Max: 2085 Percentiles: P50: 1.52 P75: 1.90 P99: 7.66 P99.9: 146.95 P99.99: 837.78 ------------------------------------------------------ [ 0, 1 ] 91827 15.802% 15.802% ### ( 1, 2 ] 380550 65.487% 81.289% ############# ( 2, 3 ] 69181 11.905% 93.194% ## ( 3, 4 ] 18016 3.100% 96.294% # ( 4, 6 ] 13330 2.294% 98.588% ( 6, 10 ] 5767 0.992% 99.580% ( 10, 15 ] 626 0.108% 99.688% ( 15, 22 ] 102 0.018% 99.706% ( 22, 34 ] 8 0.001% 99.707% ( 34, 51 ] 2 0.000% 99.707% ( 51, 76 ] 46 0.008% 99.715% ( 76, 110 ] 751 0.129% 99.844% ( 110, 170 ] 526 0.091% 99.935% ( 170, 250 ] 114 0.020% 99.955% ( 250, 380 ] 97 0.017% 99.971% ( 380, 580 ] 69 0.012% 99.983% ( 580, 870 ] 46 0.008% 99.991% ( 870, 1300 ] 36 0.006% 99.997% ( 1300, 1900 ] 15 0.003% 100.000% ( 1900, 2900 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28184 Average: 2.7176 StdDev: 26.73 Min: 1 Median: 1.2274 Max: 2579 Percentiles: P50: 1.23 P75: 1.68 P99: 6.85 P99.9: 306.45 P99.99: 1354.48 ------------------------------------------------------ [ 0, 1 ] 10547 37.422% 37.422% ####### ( 1, 2 ] 15591 55.319% 92.741% ########### ( 2, 3 ] 1097 3.892% 96.633% # ( 3, 4 ] 288 1.022% 97.655% ( 4, 6 ] 340 1.206% 98.861% ( 6, 10 ] 184 0.653% 99.514% ( 10, 15 ] 33 0.117% 99.631% ( 15, 22 ] 7 0.025% 99.656% ( 22, 34 ] 1 0.004% 99.659% ( 34, 51 ] 21 0.075% 99.734% ( 51, 76 ] 8 0.028% 99.762% ( 76, 110 ] 6 0.021% 99.784% ( 110, 170 ] 8 0.028% 99.812% ( 170, 250 ] 17 0.060% 99.872% ( 250, 380 ] 18 0.064% 99.936% ( 380, 580 ] 9 0.032% 99.968% ( 580, 870 ] 5 0.018% 99.986% ( 870, 1300 ] 1 0.004% 99.989% ( 1300, 1900 ] 2 0.007% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 25907 Average: 7.0631 StdDev: 78.79 Min: 1 Median: 1.6770 Max: 4039 Percentiles: P50: 1.68 P75: 2.25 P99: 12.87 P99.9: 1069.09 P99.99: 3752.32 ------------------------------------------------------ [ 0, 1 ] 1660 6.408% 6.408% # ( 1, 2 ] 16682 64.392% 70.799% ############# ( 2, 3 ] 4338 16.745% 87.544% ### ( 3, 4 ] 1321 5.099% 92.643% # ( 4, 6 ] 1138 4.393% 97.036% # ( 6, 10 ] 494 1.907% 98.942% ( 10, 15 ] 26 0.100% 99.043% ( 15, 22 ] 3 0.012% 99.054% ( 22, 34 ] 1 0.004% 99.058% ( 76, 110 ] 17 0.066% 99.124% ( 110, 170 ] 70 0.270% 99.394% ( 170, 250 ] 43 0.166% 99.560% ( 250, 380 ] 29 0.112% 99.672% ( 380, 580 ] 30 0.116% 99.788% ( 580, 870 ] 24 0.093% 99.880% ( 870, 1300 ] 11 0.042% 99.923% ( 1300, 1900 ] 7 0.027% 99.950% ( 1900, 2900 ] 7 0.027% 99.977% ( 2900, 4400 ] 6 0.023% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1706.3667 StdDev: 980.83 Min: 165 Median: 1540.0000 Max: 3847 Percentiles: P50: 1540.00 P75: 2200.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ ( 110, 170 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 580, 870 ] 3 10.000% 20.000% ## ( 870, 1300 ] 5 16.667% 36.667% ### ( 1300, 1900 ] 10 33.333% 70.000% ####### ( 1900, 2900 ] 5 16.667% 86.667% ### ( 2900, 4400 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 28.1 total, 12.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 210.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.689 H:M:S, 41.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 79.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.310 H:M:S, 75.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-21:54:31 ... thread 0: (1000000,7000000) ops and (159186.7,204959.6) ops/second in (6.281930,34.153074) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 3.19 GB 75.5 6.3 0.0 6.3 12.9 6.6 0.0 1.9 143.5 295.2 44.76 41.47 114 0.393 6522K 13K 0.0 0.0 L1 15/15 1.82 GB 0.0 5.5 3.3 2.2 5.5 3.3 0.1 1.6 219.9 217.7 25.72 24.28 4 6.430 5743K 57K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.5 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 53/0 946.07 MB 0.9 2.6 1.6 1.0 2.6 1.6 0.0 1.6 197.5 197.4 13.73 11.88 11 1.248 2744K 1129 0.0 0.0 L4 131/0 9.67 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 220.9 220.9 0.27 0.26 1 0.272 61K 0 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/24 102.71 GB 0.0 14.6 5.1 9.6 21.2 11.6 4.3 3.2 176.1 255.3 84.98 78.35 131 0.649 15M 71K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 5.1 9.6 21.2 11.6 4.3 3.2 176.1 255.3 84.98 78.35 131 0.649 15M 71K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 5.1 9.6 14.5 5.0 0.0 0.0 229.6 228.5 65.18 60.97 36 1.811 15M 71K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 343.6 19.80 17.38 95 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.4 total, 34.2 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.19 GB write, 631.30 MB/s write, 14.61 GB read, 435.43 MB/s read, 85.0 seconds Interval compaction: 21.19 GB write, 635.18 MB/s write, 14.61 GB read, 438.10 MB/s read, 85.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 32, interval: 53 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2846820 Average: 2.7392 StdDev: 17.82 Min: 0 Median: 1.5309 Max: 4336 Percentiles: P50: 1.53 P75: 1.92 P99: 6.83 P99.9: 143.68 P99.99: 348.65 ------------------------------------------------------ [ 0, 1 ] 439529 15.439% 15.439% ### ( 1, 2 ] 1853067 65.093% 80.532% ############# ( 2, 3 ] 348379 12.237% 92.769% ## ( 3, 4 ] 100420 3.527% 96.297% # ( 4, 6 ] 72408 2.543% 98.840% # ( 6, 10 ] 21828 0.767% 99.607% ( 10, 15 ] 3442 0.121% 99.728% ( 15, 22 ] 373 0.013% 99.741% ( 22, 34 ] 45 0.002% 99.743% ( 34, 51 ] 18 0.001% 99.743% ( 51, 76 ] 54 0.002% 99.745% ( 76, 110 ] 2555 0.090% 99.835% ( 110, 170 ] 3305 0.116% 99.951% ( 170, 250 ] 720 0.025% 99.976% ( 250, 380 ] 517 0.018% 99.994% ( 380, 580 ] 438 0.015% 100.010% ( 580, 870 ] 205 0.007% 100.017% ( 870, 1300 ] 73 0.003% 100.020% ( 1300, 1900 ] 28 0.001% 100.021% ( 1900, 2900 ] 26 0.001% 100.021% ( 2900, 4400 ] 21 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 998775 Average: 3.2458 StdDev: 23.55 Min: 0 Median: 1.6498 Max: 3294 Percentiles: P50: 1.65 P75: 2.21 P99: 8.74 P99.9: 143.17 P99.99: 365.16 ------------------------------------------------------ [ 0, 1 ] 101710 10.183% 10.183% ## ( 1, 2 ] 612014 61.276% 71.460% ############ ( 2, 3 ] 167392 16.760% 88.220% ### ( 3, 4 ] 51424 5.149% 93.368% # ( 4, 6 ] 45299 4.535% 97.904% # ( 6, 10 ] 15972 1.599% 99.503% ( 10, 15 ] 2163 0.217% 99.720% ( 15, 22 ] 364 0.036% 99.756% ( 22, 34 ] 22 0.002% 99.758% ( 34, 51 ] 3 0.000% 99.759% ( 51, 76 ] 51 0.005% 99.764% ( 76, 110 ] 922 0.092% 99.856% ( 110, 170 ] 798 0.080% 99.936% ( 170, 250 ] 287 0.029% 99.965% ( 250, 380 ] 288 0.029% 99.993% ( 380, 580 ] 260 0.026% 100.019% ( 580, 870 ] 169 0.017% 100.036% ( 870, 1300 ] 111 0.011% 100.047% ( 1300, 1900 ] 39 0.004% 100.051% ( 1900, 2900 ] 17 0.002% 100.053% ( 2900, 4400 ] 4 0.000% 100.053% ** Level 2 read latency histogram (micros): Count: 40586 Average: 3.2387 StdDev: 26.68 Min: 1 Median: 1.4295 Max: 2579 Percentiles: P50: 1.43 P75: 1.89 P99: 8.83 P99.9: 350.48 P99.99: 1186.20 ------------------------------------------------------ [ 0, 1 ] 10811 26.637% 26.637% ##### ( 1, 2 ] 22077 54.396% 81.033% ########### ( 2, 3 ] 3713 9.148% 90.181% ## ( 3, 4 ] 1513 3.728% 93.909% # ( 4, 6 ] 1694 4.174% 98.083% # ( 6, 10 ] 526 1.296% 99.379% ( 10, 15 ] 83 0.205% 99.584% ( 15, 22 ] 11 0.027% 99.611% ( 22, 34 ] 1 0.002% 99.613% ( 34, 51 ] 21 0.052% 99.665% ( 51, 76 ] 8 0.020% 99.685% ( 76, 110 ] 11 0.027% 99.712% ( 110, 170 ] 25 0.062% 99.773% ( 170, 250 ] 29 0.071% 99.845% ( 250, 380 ] 29 0.071% 99.916% ( 380, 580 ] 20 0.049% 99.966% ( 580, 870 ] 7 0.017% 99.983% ( 870, 1300 ] 4 0.010% 99.993% ( 1300, 1900 ] 2 0.005% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 283749 Average: 3.4665 StdDev: 29.62 Min: 1 Median: 1.7106 Max: 4039 Percentiles: P50: 1.71 P75: 2.38 P99: 8.78 P99.9: 209.32 P99.99: 720.70 ------------------------------------------------------ [ 0, 1 ] 17350 6.115% 6.115% # ( 1, 2 ] 175235 61.757% 67.872% ############ ( 2, 3 ] 53587 18.885% 86.757% #### ( 3, 4 ] 17175 6.053% 92.810% # ( 4, 6 ] 14224 5.013% 97.823% # ( 6, 10 ] 4801 1.692% 99.515% ( 10, 15 ] 527 0.186% 99.700% ( 15, 22 ] 63 0.022% 99.723% ( 22, 34 ] 7 0.002% 99.725% ( 34, 51 ] 1 0.000% 99.725% ( 51, 76 ] 10 0.004% 99.729% ( 76, 110 ] 120 0.042% 99.771% ( 110, 170 ] 293 0.103% 99.875% ( 170, 250 ] 147 0.052% 99.926% ( 250, 380 ] 89 0.031% 99.958% ( 380, 580 ] 63 0.022% 99.980% ( 580, 870 ] 59 0.021% 100.001% ( 870, 1300 ] 22 0.008% 100.008% ( 1300, 1900 ] 12 0.004% 100.013% ( 1900, 2900 ] 10 0.004% 100.016% ( 2900, 4400 ] 7 0.002% 100.019% ** Level 4 read latency histogram (micros): Count: 40 Average: 1301.7250 StdDev: 1105.93 Min: 1 Median: 1214.0000 Max: 3847 Percentiles: P50: 1214.00 P75: 1840.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ [ 0, 1 ] 1 2.500% 2.500% # ( 1, 2 ] 3 7.500% 10.000% ## ( 2, 3 ] 2 5.000% 15.000% # ( 6, 10 ] 2 5.000% 20.000% # ( 110, 170 ] 2 5.000% 25.000% # ( 170, 250 ] 1 2.500% 27.500% # ( 250, 380 ] 1 2.500% 30.000% # ( 580, 870 ] 4 10.000% 40.000% ## ( 870, 1300 ] 5 12.500% 52.500% ### ( 1300, 1900 ] 10 25.000% 77.500% ##### ( 1900, 2900 ] 5 12.500% 90.000% ### ( 2900, 4400 ] 4 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 80 Average: 1162.1500 StdDev: 1233.29 Min: 78 Median: 561.8182 Max: 4777 Percentiles: P50: 561.82 P75: 1990.91 P99: 4777.00 P99.9: 4777.00 P99.99: 4777.00 ------------------------------------------------------ ( 76, 110 ] 1 1.250% 1.250% ( 110, 170 ] 12 15.000% 16.250% ### ( 170, 250 ] 8 10.000% 26.250% ## ( 250, 380 ] 9 11.250% 37.500% ## ( 380, 580 ] 11 13.750% 51.250% ### ( 580, 870 ] 11 13.750% 65.000% ### ( 870, 1300 ] 2 2.500% 67.500% # ( 1300, 1900 ] 5 6.250% 73.750% # ( 1900, 2900 ] 11 13.750% 87.500% ### ( 2900, 4400 ] 9 11.250% 98.750% ## ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 34.4 total, 6.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 200.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.106 H:M:S, 44.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 156.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.417 H:M:S, 54.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-21:54:40 ... thread 0: (1000000,8000000) ops and (112638.1,185912.2) ops/second in (8.877989,43.031063) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/5 4.23 GB 207.7 7.4 0.0 7.4 15.1 7.7 0.0 2.0 145.0 295.7 52.14 48.45 133 0.392 7674K 14K 0.0 0.0 L1 15/15 1.82 GB 0.0 5.5 3.3 2.2 5.5 3.3 0.1 1.6 219.9 217.7 25.72 24.28 4 6.430 5743K 57K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.5 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 53/0 946.07 MB 0.9 2.6 1.6 1.0 2.6 1.6 0.0 1.6 197.5 197.4 13.73 11.88 11 1.248 2744K 1129 0.0 0.0 L4 131/0 9.67 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.4 1.0 220.9 220.9 0.27 0.26 1 0.272 61K 0 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/20 103.75 GB 0.0 15.7 5.1 10.7 23.3 12.7 4.3 3.0 174.3 258.8 92.36 85.33 150 0.616 16M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.7 5.1 10.7 23.3 12.7 4.3 3.0 174.3 258.8 92.36 85.33 150 0.616 16M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.7 5.1 10.7 15.6 5.0 0.0 0.0 231.7 230.6 69.47 65.18 40 1.737 16M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.7 7.7 0.0 0.0 0.0 344.1 22.89 20.15 110 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.2 total, 43.0 interval Flush(GB): cumulative 7.690, interval 7.690 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.34 GB write, 552.64 MB/s write, 15.72 GB read, 372.25 MB/s read, 92.4 seconds Interval compaction: 23.34 GB write, 555.34 MB/s write, 15.72 GB read, 374.07 MB/s read, 92.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 34, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3313500 Average: 2.6686 StdDev: 16.98 Min: 0 Median: 1.5242 Max: 4336 Percentiles: P50: 1.52 P75: 1.91 P99: 6.50 P99.9: 137.48 P99.99: 339.43 ------------------------------------------------------ [ 0, 1 ] 524342 15.824% 15.824% ### ( 1, 2 ] 2160285 65.196% 81.021% ############# ( 2, 3 ] 398592 12.029% 93.050% ## ( 3, 4 ] 112200 3.386% 96.436% # ( 4, 6 ] 81939 2.473% 98.909% ( 6, 10 ] 24151 0.729% 99.638% ( 10, 15 ] 3898 0.118% 99.756% ( 15, 22 ] 456 0.014% 99.770% ( 22, 34 ] 50 0.002% 99.771% ( 34, 51 ] 20 0.001% 99.772% ( 51, 76 ] 59 0.002% 99.773% ( 76, 110 ] 2632 0.079% 99.853% ( 110, 170 ] 3414 0.103% 99.956% ( 170, 250 ] 754 0.023% 99.979% ( 250, 380 ] 549 0.017% 99.995% ( 380, 580 ] 458 0.014% 100.009% ( 580, 870 ] 215 0.006% 100.016% ( 870, 1300 ] 80 0.002% 100.018% ( 1300, 1900 ] 30 0.001% 100.019% ( 1900, 2900 ] 28 0.001% 100.020% ( 2900, 4400 ] 22 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 1312675 Average: 3.0051 StdDev: 21.00 Min: 0 Median: 1.5839 Max: 3294 Percentiles: P50: 1.58 P75: 1.99 P99: 8.43 P99.9: 135.97 P99.99: 363.90 ------------------------------------------------------ [ 0, 1 ] 186780 14.229% 14.229% ### ( 1, 2 ] 804184 61.263% 75.492% ############ ( 2, 3 ] 188740 14.378% 89.870% ### ( 3, 4 ] 57171 4.355% 94.226% # ( 4, 6 ] 51449 3.919% 98.145% # ( 6, 10 ] 18472 1.407% 99.552% ( 10, 15 ] 2341 0.178% 99.730% ( 15, 22 ] 455 0.035% 99.765% ( 22, 34 ] 24 0.002% 99.767% ( 34, 51 ] 4 0.000% 99.767% ( 51, 76 ] 78 0.006% 99.773% ( 76, 110 ] 1232 0.094% 99.867% ( 110, 170 ] 1001 0.076% 99.943% ( 170, 250 ] 336 0.026% 99.969% ( 250, 380 ] 317 0.024% 99.993% ( 380, 580 ] 277 0.021% 100.014% ( 580, 870 ] 176 0.013% 100.028% ( 870, 1300 ] 111 0.008% 100.036% ( 1300, 1900 ] 39 0.003% 100.039% ( 1900, 2900 ] 18 0.001% 100.040% ( 2900, 4400 ] 4 0.000% 100.041% ** Level 2 read latency histogram (micros): Count: 40586 Average: 3.2387 StdDev: 26.68 Min: 1 Median: 1.4295 Max: 2579 Percentiles: P50: 1.43 P75: 1.89 P99: 8.83 P99.9: 350.48 P99.99: 1186.20 ------------------------------------------------------ [ 0, 1 ] 10811 26.637% 26.637% ##### ( 1, 2 ] 22077 54.396% 81.033% ########### ( 2, 3 ] 3713 9.148% 90.181% ## ( 3, 4 ] 1513 3.728% 93.909% # ( 4, 6 ] 1694 4.174% 98.083% # ( 6, 10 ] 526 1.296% 99.379% ( 10, 15 ] 83 0.205% 99.584% ( 15, 22 ] 11 0.027% 99.611% ( 22, 34 ] 1 0.002% 99.613% ( 34, 51 ] 21 0.052% 99.665% ( 51, 76 ] 8 0.020% 99.685% ( 76, 110 ] 11 0.027% 99.712% ( 110, 170 ] 25 0.062% 99.773% ( 170, 250 ] 29 0.071% 99.845% ( 250, 380 ] 29 0.071% 99.916% ( 380, 580 ] 20 0.049% 99.966% ( 580, 870 ] 7 0.017% 99.983% ( 870, 1300 ] 4 0.010% 99.993% ( 1300, 1900 ] 2 0.005% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 283749 Average: 3.4665 StdDev: 29.62 Min: 1 Median: 1.7106 Max: 4039 Percentiles: P50: 1.71 P75: 2.38 P99: 8.78 P99.9: 209.32 P99.99: 720.70 ------------------------------------------------------ [ 0, 1 ] 17350 6.115% 6.115% # ( 1, 2 ] 175235 61.757% 67.872% ############ ( 2, 3 ] 53587 18.885% 86.757% #### ( 3, 4 ] 17175 6.053% 92.810% # ( 4, 6 ] 14224 5.013% 97.823% # ( 6, 10 ] 4801 1.692% 99.515% ( 10, 15 ] 527 0.186% 99.700% ( 15, 22 ] 63 0.022% 99.723% ( 22, 34 ] 7 0.002% 99.725% ( 34, 51 ] 1 0.000% 99.725% ( 51, 76 ] 10 0.004% 99.729% ( 76, 110 ] 120 0.042% 99.771% ( 110, 170 ] 293 0.103% 99.875% ( 170, 250 ] 147 0.052% 99.926% ( 250, 380 ] 89 0.031% 99.958% ( 380, 580 ] 63 0.022% 99.980% ( 580, 870 ] 59 0.021% 100.001% ( 870, 1300 ] 22 0.008% 100.008% ( 1300, 1900 ] 12 0.004% 100.013% ( 1900, 2900 ] 10 0.004% 100.016% ( 2900, 4400 ] 7 0.002% 100.019% ** Level 4 read latency histogram (micros): Count: 40 Average: 1301.7250 StdDev: 1105.93 Min: 1 Median: 1214.0000 Max: 3847 Percentiles: P50: 1214.00 P75: 1840.00 P99: 3847.00 P99.9: 3847.00 P99.99: 3847.00 ------------------------------------------------------ [ 0, 1 ] 1 2.500% 2.500% # ( 1, 2 ] 3 7.500% 10.000% ## ( 2, 3 ] 2 5.000% 15.000% # ( 6, 10 ] 2 5.000% 20.000% # ( 110, 170 ] 2 5.000% 25.000% # ( 170, 250 ] 1 2.500% 27.500% # ( 250, 380 ] 1 2.500% 30.000% # ( 580, 870 ] 4 10.000% 40.000% ## ( 870, 1300 ] 5 12.500% 52.500% ### ( 1300, 1900 ] 10 25.000% 77.500% ##### ( 1900, 2900 ] 5 12.500% 90.000% ### ( 2900, 4400 ] 4 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 80 Average: 1162.1500 StdDev: 1233.29 Min: 78 Median: 561.8182 Max: 4777 Percentiles: P50: 561.82 P75: 1990.91 P99: 4777.00 P99.9: 4777.00 P99.99: 4777.00 ------------------------------------------------------ ( 76, 110 ] 1 1.250% 1.250% ( 110, 170 ] 12 15.000% 16.250% ### ( 170, 250 ] 8 10.000% 26.250% ## ( 250, 380 ] 9 11.250% 37.500% ## ( 380, 580 ] 11 13.750% 51.250% ### ( 580, 870 ] 11 13.750% 65.000% ### ( 870, 1300 ] 2 2.500% 67.500% # ( 1300, 1900 ] 5 6.250% 73.750% # ( 1900, 2900 ] 11 13.750% 87.500% ### ( 2900, 4400 ] 9 11.250% 98.750% ## ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 43.2 total, 8.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 182.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.031 H:M:S, 48.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.925 H:M:S, 66.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-21:54:47 ... thread 0: (1000000,9000000) ops and (137592.5,178930.4) ops/second in (7.267837,50.298900) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.83 GB 56.7 7.7 0.0 7.7 16.2 8.5 0.0 1.9 139.2 292.6 56.56 51.79 145 0.390 7994K 14K 0.0 0.0 L1 16/16 1.96 GB 0.0 9.5 5.5 4.0 9.4 5.4 0.1 1.7 221.6 219.0 44.10 41.63 5 8.820 9082K 57K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 3.5 1.8 224.7 224.7 0.50 0.46 1 0.496 113K 31 0.0 0.0 L3 19/0 979.62 MB 1.0 4.0 2.7 1.3 4.0 2.7 0.9 1.5 184.2 184.0 22.27 18.33 21 1.060 4147K 3670 0.0 0.0 L4 159/0 9.67 GB 1.0 1.0 0.8 0.2 1.0 0.8 2.6 1.3 168.7 168.5 6.08 4.69 9 0.676 1042K 1365 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/30 104.49 GB 0.0 22.3 9.1 13.2 30.7 17.5 10.4 3.6 176.7 242.8 129.51 116.90 181 0.716 22M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.3 9.1 13.2 30.7 17.5 10.4 3.6 176.7 242.8 129.51 116.90 181 0.716 22M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.3 9.1 13.2 22.2 9.0 0.0 0.0 221.3 220.0 103.41 94.60 60 1.724 22M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 333.1 26.10 22.30 121 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.5 total, 50.3 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.70 GB write, 622.47 MB/s write, 22.35 GB read, 453.07 MB/s read, 129.5 seconds Interval compaction: 30.70 GB write, 625.07 MB/s write, 22.35 GB read, 454.96 MB/s read, 129.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 31, pending-compaction-bytes-stops: 0, total-delays: 44, total-stops: 43, interval: 87 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3675988 Average: 2.8279 StdDev: 22.90 Min: 0 Median: 1.5296 Max: 6008 Percentiles: P50: 1.53 P75: 1.92 P99: 6.87 P99.9: 147.08 P99.99: 453.78 ------------------------------------------------------ [ 0, 1 ] 575208 15.648% 15.648% ### ( 1, 2 ] 2384436 64.865% 80.513% ############# ( 2, 3 ] 447818 12.182% 92.695% ## ( 3, 4 ] 128207 3.488% 96.183% # ( 4, 6 ] 97388 2.649% 98.832% # ( 6, 10 ] 28437 0.774% 99.606% ( 10, 15 ] 4554 0.124% 99.730% ( 15, 22 ] 516 0.014% 99.744% ( 22, 34 ] 51 0.001% 99.745% ( 34, 51 ] 23 0.001% 99.746% ( 51, 76 ] 100 0.003% 99.748% ( 76, 110 ] 3198 0.087% 99.835% ( 110, 170 ] 3845 0.105% 99.940% ( 170, 250 ] 894 0.024% 99.964% ( 250, 380 ] 713 0.019% 99.984% ( 380, 580 ] 630 0.017% 100.001% ( 580, 870 ] 352 0.010% 100.010% ( 870, 1300 ] 161 0.004% 100.015% ( 1300, 1900 ] 78 0.002% 100.017% ( 1900, 2900 ] 60 0.002% 100.019% ( 2900, 4400 ] 47 0.001% 100.020% ( 4400, 6600 ] 4 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1744927 Average: 3.2828 StdDev: 28.83 Min: 0 Median: 1.6287 Max: 5151 Percentiles: P50: 1.63 P75: 2.21 P99: 8.59 P99.9: 111.11 P99.99: 204.78 ------------------------------------------------------ [ 0, 1 ] 232053 13.299% 13.299% ### ( 1, 2 ] 1018663 58.379% 71.677% ############ ( 2, 3 ] 275728 15.802% 87.479% ### ( 3, 4 ] 94633 5.423% 92.902% # ( 4, 6 ] 89341 5.120% 98.022% # ( 6, 10 ] 26323 1.509% 99.531% ( 10, 15 ] 3948 0.226% 99.757% ( 15, 22 ] 645 0.037% 99.794% ( 22, 34 ] 36 0.002% 99.796% ( 34, 51 ] 12 0.001% 99.797% ( 51, 76 ] 160 0.009% 99.806% ( 76, 110 ] 1614 0.092% 99.899% ( 110, 170 ] 1410 0.081% 99.979% ( 170, 250 ] 429 0.025% 100.004% ( 250, 380 ] 450 0.026% 100.030% ( 380, 580 ] 405 0.023% 100.053% ( 580, 870 ] 309 0.018% 100.071% ( 870, 1300 ] 178 0.010% 100.081% ( 1300, 1900 ] 77 0.004% 100.085% ( 1900, 2900 ] 51 0.003% 100.088% ( 2900, 4400 ] 29 0.002% 100.090% ( 4400, 6600 ] 3 0.000% 100.090% ** Level 2 read latency histogram (micros): Count: 40586 Average: 3.2387 StdDev: 26.68 Min: 1 Median: 1.4295 Max: 2579 Percentiles: P50: 1.43 P75: 1.89 P99: 8.83 P99.9: 350.48 P99.99: 1186.20 ------------------------------------------------------ [ 0, 1 ] 10811 26.637% 26.637% ##### ( 1, 2 ] 22077 54.396% 81.033% ########### ( 2, 3 ] 3713 9.148% 90.181% ## ( 3, 4 ] 1513 3.728% 93.909% # ( 4, 6 ] 1694 4.174% 98.083% # ( 6, 10 ] 526 1.296% 99.379% ( 10, 15 ] 83 0.205% 99.584% ( 15, 22 ] 11 0.027% 99.611% ( 22, 34 ] 1 0.002% 99.613% ( 34, 51 ] 21 0.052% 99.665% ( 51, 76 ] 8 0.020% 99.685% ( 76, 110 ] 11 0.027% 99.712% ( 110, 170 ] 25 0.062% 99.773% ( 170, 250 ] 29 0.071% 99.845% ( 250, 380 ] 29 0.071% 99.916% ( 380, 580 ] 20 0.049% 99.966% ( 580, 870 ] 7 0.017% 99.983% ( 870, 1300 ] 4 0.010% 99.993% ( 1300, 1900 ] 2 0.005% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 539208 Average: 5.1782 StdDev: 66.35 Min: 1 Median: 1.8411 Max: 7501 Percentiles: P50: 1.84 P75: 2.73 P99: 9.14 P99.9: 292.78 P99.99: 608.97 ------------------------------------------------------ [ 0, 1 ] 19394 3.597% 3.597% # ( 1, 2 ] 297488 55.171% 58.768% ########### ( 2, 3 ] 120685 22.382% 81.150% #### ( 3, 4 ] 46111 8.552% 89.702% ## ( 4, 6 ] 42997 7.974% 97.676% ## ( 6, 10 ] 9092 1.686% 99.362% ( 10, 15 ] 1724 0.320% 99.682% ( 15, 22 ] 185 0.034% 99.716% ( 22, 34 ] 20 0.004% 99.720% ( 34, 51 ] 4 0.001% 99.720% ( 51, 76 ] 16 0.003% 99.723% ( 76, 110 ] 146 0.027% 99.750% ( 110, 170 ] 403 0.075% 99.825% ( 170, 250 ] 310 0.057% 99.883% ( 250, 380 ] 285 0.053% 99.935% ( 380, 580 ] 272 0.050% 99.986% ( 580, 870 ] 221 0.041% 100.027% ( 870, 1300 ] 133 0.025% 100.052% ( 1300, 1900 ] 81 0.015% 100.067% ( 1900, 2900 ] 100 0.019% 100.085% ( 2900, 4400 ] 71 0.013% 100.098% ( 4400, 6600 ] 8 0.001% 100.100% ( 6600, 9900 ] 3 0.001% 100.100% ** Level 4 read latency histogram (micros): Count: 15395 Average: 16.1328 StdDev: 156.89 Min: 1 Median: 2.0087 Max: 3847 Percentiles: P50: 2.01 P75: 3.02 P99: 301.15 P99.9: 2785.95 P99.99: 3847.00 ------------------------------------------------------ [ 0, 1 ] 252 1.637% 1.637% ( 1, 2 ] 7412 48.146% 49.782% ########## ( 2, 3 ] 3851 25.015% 74.797% ##### ( 3, 4 ] 1574 10.224% 85.021% ## ( 4, 6 ] 1577 10.244% 95.265% ## ( 6, 10 ] 449 2.917% 98.181% # ( 10, 15 ] 69 0.448% 98.629% ( 15, 22 ] 9 0.058% 98.688% ( 22, 34 ] 1 0.006% 98.694% ( 34, 51 ] 1 0.006% 98.701% ( 51, 76 ] 1 0.006% 98.707% ( 76, 110 ] 2 0.013% 98.720% ( 110, 170 ] 10 0.065% 98.785% ( 170, 250 ] 24 0.156% 98.941% ( 250, 380 ] 23 0.149% 99.091% ( 380, 580 ] 35 0.227% 99.318% ( 580, 870 ] 24 0.156% 99.474% ( 870, 1300 ] 29 0.188% 99.662% ( 1300, 1900 ] 18 0.117% 99.779% ( 1900, 2900 ] 21 0.136% 99.916% ( 2900, 4400 ] 13 0.084% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1221.3750 StdDev: 1262.26 Min: 78 Median: 661.2000 Max: 5781 Percentiles: P50: 661.20 P75: 2037.93 P99: 5720.00 P99.9: 5781.00 P99.99: 5781.00 ------------------------------------------------------ ( 76, 110 ] 3 1.500% 1.500% ( 110, 170 ] 22 11.000% 12.500% ## ( 170, 250 ] 18 9.000% 21.500% ## ( 250, 380 ] 24 12.000% 33.500% ## ( 380, 580 ] 26 13.000% 46.500% ### ( 580, 870 ] 25 12.500% 59.000% ### ( 870, 1300 ] 17 8.500% 67.500% ## ( 1300, 1900 ] 11 5.500% 73.000% # ( 1900, 2900 ] 29 14.500% 87.500% ### ( 2900, 4400 ] 20 10.000% 97.500% ## ( 4400, 6600 ] 5 2.500% 100.000% # ** DB Stats ** Uptime(secs): 50.5 total, 7.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 175.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.387 H:M:S, 50.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 135.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.356 H:M:S, 59.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.049 micros/op 165307 ops/sec 60.046 seconds 9925999 operations; 160.2 MB/s Microseconds per write: Count: 9925999 Average: 6.0493 StdDev: 331.32 Min: 0 Median: 1.7323 Max: 597422 Percentiles: P50: 1.73 P75: 2.77 P99: 10.15 P99.9: 1162.21 P99.99: 2649.97 ------------------------------------------------------ [ 0, 1 ] 1372004 13.822% 13.822% ### ( 1, 2 ] 4903537 49.401% 63.223% ########## ( 2, 3 ] 1508779 15.200% 78.424% ### ( 3, 4 ] 1351840 13.619% 92.043% ### ( 4, 6 ] 542955 5.470% 97.513% # ( 6, 10 ] 145992 1.471% 98.984% ( 10, 15 ] 53863 0.543% 99.526% ( 15, 22 ] 11900 0.120% 99.646% ( 22, 34 ] 1913 0.019% 99.665% ( 34, 51 ] 260 0.003% 99.668% ( 51, 76 ] 48 0.000% 99.668% ( 76, 110 ] 6621 0.067% 99.735% ( 110, 170 ] 2895 0.029% 99.764% ( 170, 250 ] 303 0.003% 99.767% ( 250, 380 ] 227 0.002% 99.770% ( 380, 580 ] 30 0.000% 99.770% ( 580, 870 ] 19 0.000% 99.770% ( 870, 1300 ] 18964 0.191% 99.961% ( 1300, 1900 ] 53 0.001% 99.962% ( 1900, 2900 ] 3738 0.038% 99.999% ( 2900, 4400 ] 24 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 5 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 4 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 182578 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9925999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10243630968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 467 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32360891 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29696377414 rocksdb.compact.write.bytes COUNT : 29520076315 rocksdb.flush.write.bytes COUNT : 10238783333 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 50 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 214 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10156392448 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4105216 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29787157981 rocksdb.non.last.level.read.count COUNT : 7197674 rocksdb.block.checksum.compute.count COUNT : 7196790 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.382268 P95 : 3.977598 P99 : 8.870074 P100 : 597419.000000 COUNT : 9925999 SUM : 55366797 rocksdb.compaction.times.micros P50 : 1004242.424242 P95 : 5070000.000000 P99 : 18378551.000000 P100 : 18378551.000000 COUNT : 66 SUM : 111438696 rocksdb.compaction.times.cpu_micros P50 : 930344.827586 P95 : 5070000.000000 P99 : 17348377.000000 P100 : 17348377.000000 COUNT : 66 SUM : 102502366 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 688.291139 P95 : 1345.000000 P99 : 97050.000000 P100 : 263323.000000 COUNT : 137 SUM : 477929 rocksdb.compaction.outfile.sync.micros P50 : 859.804688 P95 : 24750.000000 P99 : 109562.500000 P100 : 136780.000000 COUNT : 305 SUM : 1614560 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 96.670455 P95 : 692.375000 P99 : 3655.000000 P100 : 4589.000000 COUNT : 249 SUM : 59088 rocksdb.table.open.io.micros P50 : 1363.750000 P95 : 7737.321429 P99 : 10170.600000 P100 : 12421.000000 COUNT : 467 SUM : 961435 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.626735 P95 : 6.980625 P99 : 9.933077 P100 : 10696.000000 COUNT : 7195828 SUM : 36944365 rocksdb.read.block.get.micros P50 : 472.452830 P95 : 3232.352941 P99 : 4331.176471 P100 : 5939.000000 COUNT : 934 SUM : 770140 rocksdb.write.raw.block.micros P50 : 0.510985 P95 : 0.970871 P99 : 2.834275 P100 : 9372.000000 COUNT : 9630669 SUM : 17363033 rocksdb.numfiles.in.singlecompaction P50 : 3.294118 P95 : 6.000000 P99 : 26.000000 P100 : 26.000000 COUNT : 120 SUM : 475 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563492 P95 : 1155.319566 P99 : 2365.012087 P100 : 597204.000000 COUNT : 203476 SUM : 32384661 rocksdb.sst.read.micros P50 : 1.572684 P95 : 4.037830 P99 : 7.874402 P100 : 7501.000000 COUNT : 7198415 SUM : 22422207 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9925999 SUM : 10243630968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215098.039216 P95 : 361475.000000 P99 : 546566.666667 P100 : 739943.000000 COUNT : 137 SUM : 29232275 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 295 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0