Invalid opts->opts_size 0 too small, please set opts_size correctly [2024-08-11 06:57:33.927630] Starting SPDK v24.09-pre git sha1 227b8322c / DPDK 22.11.4 initialization... [2024-08-11 06:57:33.927781] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid18566 ] Set seed to 1723352253923694 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-08-11 06:57:34.020085] app.c: 910:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-08-11 06:57:34.058927] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-08-11 06:57:34.058975] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 18566' to capture a snapshot of events at runtime. [2024-08-11 06:57:34.058985] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-08-11 06:57:34.058999] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-08-11 06:57:34.059007] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid18566 for offline analysis/debug. [2024-08-11 06:57:34.059090] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Aug 11 06:57:38 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/08/11-06:57:41 ... thread 0: (1000000,1000000) ops and (335532.6,335532.6) ops/second in (2.980336,2.980336) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.98 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 344.3 2.56 2.31 12 0.213 0 0 0.0 0.0 L2 3/2 237.20 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 9/0 755.91 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.8 313.3 3.93 3.63 14 0.281 354K 177 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 88.8 313.3 3.93 3.63 14 0.281 354K 177 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 344.3 2.56 2.31 12 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 386.14 MB/s write, 0.34 GB read, 109.45 MB/s read, 3.9 seconds Interval compaction: 1.20 GB write, 412.67 MB/s write, 0.34 GB read, 116.97 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 134554 Average: 1.9710 StdDev: 16.53 Min: 0 Median: 1.3034 Max: 4056 Percentiles: P50: 1.30 P75: 1.73 P99: 5.08 P99.9: 9.35 P99.99: 17.48 ------------------------------------------------------ [ 0, 1 ] 43349 32.217% 32.217% ###### ( 1, 2 ] 78856 58.605% 90.822% ############ ( 2, 3 ] 7042 5.234% 96.056% # ( 3, 4 ] 2941 2.186% 98.242% ( 4, 6 ] 1890 1.405% 99.646% ( 6, 10 ] 410 0.305% 99.951% ( 10, 15 ] 51 0.038% 99.989% ( 15, 22 ] 10 0.007% 99.996% ( 34, 51 ] 1 0.001% 99.997% ( 51, 76 ] 2 0.001% 99.999% ( 110, 170 ] 7 0.005% 100.004% ( 170, 250 ] 3 0.002% 100.006% ( 250, 380 ] 7 0.005% 100.011% ( 580, 870 ] 1 0.001% 100.012% ( 870, 1300 ] 1 0.001% 100.013% ( 1300, 1900 ] 3 0.002% 100.015% ( 2900, 4400 ] 2 0.001% 100.016% ** Level 2 read latency histogram (micros): Count: 79565 Average: 2.1375 StdDev: 16.04 Min: 1 Median: 1.3274 Max: 3388 Percentiles: P50: 1.33 P75: 1.74 P99: 5.56 P99.9: 34.90 P99.99: 582.52 ------------------------------------------------------ [ 0, 1 ] 24149 30.351% 30.351% ###### ( 1, 2 ] 47752 60.016% 90.368% ############ ( 2, 3 ] 4292 5.394% 95.762% # ( 3, 4 ] 1626 2.044% 97.806% ( 4, 6 ] 1220 1.533% 99.339% ( 6, 10 ] 381 0.479% 99.818% ( 10, 15 ] 45 0.057% 99.874% ( 15, 22 ] 12 0.015% 99.889% ( 22, 34 ] 7 0.009% 99.898% ( 34, 51 ] 27 0.034% 99.932% ( 51, 76 ] 8 0.010% 99.942% ( 76, 110 ] 2 0.003% 99.945% ( 110, 170 ] 3 0.004% 99.948% ( 170, 250 ] 18 0.023% 99.971% ( 250, 380 ] 12 0.015% 99.986% ( 380, 580 ] 3 0.004% 99.990% ( 580, 870 ] 5 0.006% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 1213.2000 StdDev: 1222.58 Min: 60 Median: 609.0000 Max: 4646 Percentiles: P50: 609.00 P75: 1650.00 P99: 4646.00 P99.9: 4646.00 P99.99: 4646.00 ------------------------------------------------------ ( 51, 76 ] 1 2.222% 2.222% ( 76, 110 ] 1 2.222% 4.444% ( 170, 250 ] 4 8.889% 13.333% ## ( 250, 380 ] 7 15.556% 28.889% ### ( 380, 580 ] 9 20.000% 48.889% #### ( 580, 870 ] 5 11.111% 60.000% ## ( 870, 1300 ] 5 11.111% 71.111% ## ( 1300, 1900 ] 3 6.667% 77.778% # ( 1900, 2900 ] 4 8.889% 86.667% ## ( 2900, 4400 ] 4 8.889% 95.556% ## ( 4400, 6600 ] 2 4.444% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1396.1000 StdDev: 855.61 Min: 441 Median: 1300.0000 Max: 3601 Percentiles: P50: 1300.00 P75: 1800.00 P99: 3601.00 P99.9: 3601.00 P99.99: 3601.00 ------------------------------------------------------ ( 380, 580 ] 5 16.667% 16.667% ### ( 580, 870 ] 7 23.333% 40.000% ##### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 9 30.000% 80.000% ###### ( 1900, 2900 ] 4 13.333% 93.333% ### ( 2900, 4400 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 308.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.420 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.420 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/08/11-06:57:44 ... thread 0: (1000000,2000000) ops and (329692.0,332586.7) ops/second in (3.033134,6.013470) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.35 GB 25.2 0.6 0.0 0.6 2.4 1.8 0.0 1.3 74.9 324.3 7.57 6.96 28 0.271 575K 624 0.0 0.0 L1 1/1 2.51 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 248.2 247.8 1.27 1.23 1 1.269 319K 433 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.3 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 25/0 971.38 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 204.2 204.0 3.36 2.93 3 1.121 697K 596 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/11 97.98 GB 0.0 1.9 1.0 0.9 3.7 2.8 0.8 2.0 141.3 280.4 13.57 12.43 34 0.399 1946K 1830 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 1.0 0.9 3.7 2.8 0.8 2.0 141.3 280.4 13.57 12.43 34 0.399 1946K 1830 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 1.0 0.9 1.9 1.0 0.0 0.0 235.0 234.7 8.16 7.59 8 1.020 1946K 1830 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.2 5.41 4.84 26 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.72 GB write, 611.82 MB/s write, 1.87 GB read, 308.28 MB/s read, 13.6 seconds Interval compaction: 3.72 GB write, 632.66 MB/s write, 1.87 GB read, 318.78 MB/s read, 13.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 416409 Average: 2.1269 StdDev: 13.24 Min: 0 Median: 1.4364 Max: 4056 Percentiles: P50: 1.44 P75: 1.83 P99: 5.58 P99.9: 10.06 P99.99: 14.93 ------------------------------------------------------ [ 0, 1 ] 92875 22.304% 22.304% #### ( 1, 2 ] 264282 63.467% 85.771% ############# ( 2, 3 ] 34953 8.394% 94.165% ## ( 3, 4 ] 13316 3.198% 97.362% # ( 4, 6 ] 8651 2.078% 99.440% ( 6, 10 ] 1914 0.460% 99.900% ( 10, 15 ] 385 0.092% 99.992% ( 15, 22 ] 40 0.010% 100.002% ( 22, 34 ] 9 0.002% 100.004% ( 34, 51 ] 4 0.001% 100.005% ( 51, 76 ] 4 0.001% 100.006% ( 110, 170 ] 10 0.002% 100.008% ( 170, 250 ] 12 0.003% 100.011% ( 250, 380 ] 12 0.003% 100.014% ( 380, 580 ] 1 0.000% 100.014% ( 580, 870 ] 6 0.001% 100.016% ( 870, 1300 ] 5 0.001% 100.017% ( 1300, 1900 ] 5 0.001% 100.018% ( 1900, 2900 ] 2 0.000% 100.018% ( 2900, 4400 ] 3 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 79214 Average: 2.3483 StdDev: 4.56 Min: 1 Median: 1.5927 Max: 997 Percentiles: P50: 1.59 P75: 1.97 P99: 5.93 P99.9: 12.73 P99.99: 20.72 ------------------------------------------------------ [ 0, 1 ] 8184 10.332% 10.332% ## ( 1, 2 ] 53016 66.928% 77.259% ############# ( 2, 3 ] 10227 12.911% 90.170% ### ( 3, 4 ] 3900 4.923% 95.093% # ( 4, 6 ] 3209 4.051% 99.144% # ( 6, 10 ] 529 0.668% 99.812% ( 10, 15 ] 128 0.162% 99.973% ( 15, 22 ] 16 0.020% 99.994% ( 22, 34 ] 4 0.005% 99.999% ( 110, 170 ] 1 0.001% 100.000% ( 170, 250 ] 1 0.001% 100.001% ( 250, 380 ] 2 0.003% 100.004% ( 380, 580 ] 2 0.003% 100.006% ( 870, 1300 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47891 Average: 3.5456 StdDev: 53.21 Min: 0 Median: 1.5756 Max: 4646 Percentiles: P50: 1.58 P75: 1.95 P99: 6.63 P99.9: 112.18 P99.99: 1232.14 ------------------------------------------------------ [ 0, 1 ] 5722 11.948% 11.948% ## ( 1, 2 ] 31660 66.108% 78.056% ############# ( 2, 3 ] 5883 12.284% 90.341% ## ( 3, 4 ] 2301 4.805% 95.145% # ( 4, 6 ] 1791 3.740% 98.885% # ( 6, 10 ] 351 0.733% 99.618% ( 10, 15 ] 83 0.173% 99.791% ( 15, 22 ] 35 0.073% 99.864% ( 22, 34 ] 15 0.031% 99.896% ( 51, 76 ] 1 0.002% 99.898% ( 76, 110 ] 1 0.002% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 170, 250 ] 6 0.013% 99.919% ( 250, 380 ] 10 0.021% 99.939% ( 380, 580 ] 13 0.027% 99.967% ( 580, 870 ] 7 0.015% 99.981% ( 870, 1300 ] 5 0.010% 99.992% ( 1300, 1900 ] 3 0.006% 99.998% ( 1900, 2900 ] 4 0.008% 100.006% ( 2900, 4400 ] 4 0.008% 100.015% ( 4400, 6600 ] 2 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 1396.1000 StdDev: 855.61 Min: 441 Median: 1300.0000 Max: 3601 Percentiles: P50: 1300.00 P75: 1800.00 P99: 3601.00 P99.9: 3601.00 P99.99: 3601.00 ------------------------------------------------------ ( 380, 580 ] 5 16.667% 16.667% ### ( 580, 870 ] 7 23.333% 40.000% ##### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 9 30.000% 80.000% ###### ( 1900, 2900 ] 4 13.333% 93.333% ### ( 2900, 4400 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.831 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/11-06:57:47 ... thread 0: (1000000,3000000) ops and (355396.0,339857.3) ops/second in (2.813763,8.827233) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.35 GB 113.3 1.4 0.0 1.4 4.1 2.7 0.0 1.5 105.7 317.0 13.11 12.16 44 0.298 1407K 1473 0.0 0.0 L1 8/0 880.60 MB 88.1 1.2 1.2 0.0 1.2 1.2 0.2 1.0 239.7 238.9 5.00 4.88 2 2.501 1217K 3468 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.3 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 25/0 971.38 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 204.2 204.0 3.36 2.93 3 1.121 697K 596 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/4 98.84 GB 0.0 3.5 1.8 1.7 6.2 4.5 0.8 2.3 158.5 279.6 22.84 21.28 51 0.448 3675K 5714 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 1.8 1.7 6.2 4.5 0.8 2.3 158.5 279.6 22.84 21.28 51 0.448 3675K 5714 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 1.8 1.7 3.5 1.8 0.0 0.0 242.0 241.6 14.96 14.25 12 1.247 3675K 5714 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 351.5 7.89 7.03 39 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.24 GB write, 706.92 MB/s write, 3.54 GB read, 400.75 MB/s read, 22.8 seconds Interval compaction: 6.24 GB write, 723.33 MB/s write, 3.54 GB read, 410.05 MB/s read, 22.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 751204 Average: 2.1099 StdDev: 11.52 Min: 0 Median: 1.4464 Max: 4056 Percentiles: P50: 1.45 P75: 1.83 P99: 5.42 P99.9: 9.70 P99.99: 13.93 ------------------------------------------------------ [ 0, 1 ] 157626 20.983% 20.983% #### ( 1, 2 ] 488296 65.002% 85.985% ############# ( 2, 3 ] 63816 8.495% 94.480% ## ( 3, 4 ] 23976 3.192% 97.672% # ( 4, 6 ] 14078 1.874% 99.546% ( 6, 10 ] 2881 0.384% 99.929% ( 10, 15 ] 582 0.077% 100.007% ( 15, 22 ] 58 0.008% 100.015% ( 22, 34 ] 11 0.001% 100.016% ( 34, 51 ] 5 0.001% 100.017% ( 51, 76 ] 7 0.001% 100.018% ( 110, 170 ] 18 0.002% 100.020% ( 170, 250 ] 18 0.002% 100.022% ( 250, 380 ] 17 0.002% 100.025% ( 380, 580 ] 4 0.001% 100.025% ( 580, 870 ] 10 0.001% 100.026% ( 870, 1300 ] 7 0.001% 100.027% ( 1300, 1900 ] 8 0.001% 100.028% ( 1900, 2900 ] 3 0.000% 100.029% ( 2900, 4400 ] 4 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 79890 Average: 2.4525 StdDev: 10.34 Min: 0 Median: 1.5911 Max: 1403 Percentiles: P50: 1.59 P75: 1.96 P99: 5.94 P99.9: 13.29 P99.99: 343.06 ------------------------------------------------------ [ 0, 1 ] 8349 10.451% 10.451% ## ( 1, 2 ] 53449 66.903% 77.354% ############# ( 2, 3 ] 10265 12.849% 90.203% ### ( 3, 4 ] 3918 4.904% 95.107% # ( 4, 6 ] 3212 4.021% 99.128% # ( 6, 10 ] 533 0.667% 99.795% ( 10, 15 ] 128 0.160% 99.955% ( 15, 22 ] 16 0.020% 99.975% ( 22, 34 ] 5 0.006% 99.981% ( 110, 170 ] 1 0.001% 99.982% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 7 0.009% 99.992% ( 380, 580 ] 6 0.008% 100.000% ( 580, 870 ] 1 0.001% 100.001% ( 870, 1300 ] 4 0.005% 100.006% ( 1300, 1900 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47891 Average: 3.5456 StdDev: 53.21 Min: 0 Median: 1.5756 Max: 4646 Percentiles: P50: 1.58 P75: 1.95 P99: 6.63 P99.9: 112.18 P99.99: 1232.14 ------------------------------------------------------ [ 0, 1 ] 5722 11.948% 11.948% ## ( 1, 2 ] 31660 66.108% 78.056% ############# ( 2, 3 ] 5883 12.284% 90.341% ## ( 3, 4 ] 2301 4.805% 95.145% # ( 4, 6 ] 1791 3.740% 98.885% # ( 6, 10 ] 351 0.733% 99.618% ( 10, 15 ] 83 0.173% 99.791% ( 15, 22 ] 35 0.073% 99.864% ( 22, 34 ] 15 0.031% 99.896% ( 51, 76 ] 1 0.002% 99.898% ( 76, 110 ] 1 0.002% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 170, 250 ] 6 0.013% 99.919% ( 250, 380 ] 10 0.021% 99.939% ( 380, 580 ] 13 0.027% 99.967% ( 580, 870 ] 7 0.015% 99.981% ( 870, 1300 ] 5 0.010% 99.992% ( 1300, 1900 ] 3 0.006% 99.998% ( 1900, 2900 ] 4 0.008% 100.006% ( 2900, 4400 ] 4 0.008% 100.015% ( 4400, 6600 ] 2 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 1396.1000 StdDev: 855.61 Min: 441 Median: 1300.0000 Max: 3601 Percentiles: P50: 1300.00 P75: 1800.00 P99: 3601.00 P99.9: 3601.00 P99.99: 3601.00 ------------------------------------------------------ ( 380, 580 ] 5 16.667% 16.667% ### ( 580, 870 ] 7 23.333% 40.000% ##### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 9 30.000% 80.000% ###### ( 1900, 2900 ] 4 13.333% 93.333% ### ( 2900, 4400 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.043 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.211 H:M:S, 7.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/11-06:57:50 ... thread 0: (1000000,4000000) ops and (338365.7,339483.2) ops/second in (2.955382,11.782615) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.34 GB 182.5 2.2 0.0 2.2 5.8 3.7 0.0 1.6 116.9 317.0 18.87 17.57 61 0.309 2238K 2344 0.0 0.0 L1 8/0 880.60 MB 88.1 1.2 1.2 0.0 1.2 1.2 0.2 1.0 239.7 238.9 5.00 4.88 2 2.501 1217K 3468 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.3 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 25/0 971.38 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 204.2 204.0 3.36 2.93 3 1.121 697K 596 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1246/8 99.82 GB 0.0 4.3 1.8 2.5 8.0 5.5 0.8 2.2 155.2 287.1 28.60 26.70 68 0.421 4507K 6585 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.8 2.5 8.0 5.5 0.8 2.2 155.2 287.1 28.60 26.70 68 0.421 4507K 6585 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.8 2.5 4.3 1.8 0.0 0.0 247.3 246.9 17.95 17.19 15 1.197 4507K 6585 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.9 10.65 9.51 53 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.02 GB write, 684.97 MB/s write, 4.34 GB read, 370.27 MB/s read, 28.6 seconds Interval compaction: 8.02 GB write, 696.88 MB/s write, 4.34 GB read, 376.71 MB/s read, 28.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1007008 Average: 2.0516 StdDev: 11.59 Min: 0 Median: 1.4084 Max: 4335 Percentiles: P50: 1.41 P75: 1.80 P99: 5.28 P99.9: 9.70 P99.99: 14.33 ------------------------------------------------------ [ 0, 1 ] 241770 24.009% 24.009% ##### ( 1, 2 ] 640925 63.646% 87.655% ############# ( 2, 3 ] 75529 7.500% 95.156% ## ( 3, 4 ] 28368 2.817% 97.973% # ( 4, 6 ] 16121 1.601% 99.573% ( 6, 10 ] 3558 0.353% 99.927% ( 10, 15 ] 738 0.073% 100.000% ( 15, 22 ] 96 0.010% 100.010% ( 22, 34 ] 13 0.001% 100.011% ( 34, 51 ] 11 0.001% 100.012% ( 51, 76 ] 9 0.001% 100.013% ( 110, 170 ] 29 0.003% 100.016% ( 170, 250 ] 20 0.002% 100.018% ( 250, 380 ] 25 0.002% 100.020% ( 380, 580 ] 8 0.001% 100.021% ( 580, 870 ] 14 0.001% 100.022% ( 870, 1300 ] 10 0.001% 100.023% ( 1300, 1900 ] 8 0.001% 100.024% ( 1900, 2900 ] 3 0.000% 100.025% ( 2900, 4400 ] 6 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 79890 Average: 2.4525 StdDev: 10.34 Min: 0 Median: 1.5911 Max: 1403 Percentiles: P50: 1.59 P75: 1.96 P99: 5.94 P99.9: 13.29 P99.99: 343.06 ------------------------------------------------------ [ 0, 1 ] 8349 10.451% 10.451% ## ( 1, 2 ] 53449 66.903% 77.354% ############# ( 2, 3 ] 10265 12.849% 90.203% ### ( 3, 4 ] 3918 4.904% 95.107% # ( 4, 6 ] 3212 4.021% 99.128% # ( 6, 10 ] 533 0.667% 99.795% ( 10, 15 ] 128 0.160% 99.955% ( 15, 22 ] 16 0.020% 99.975% ( 22, 34 ] 5 0.006% 99.981% ( 110, 170 ] 1 0.001% 99.982% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 7 0.009% 99.992% ( 380, 580 ] 6 0.008% 100.000% ( 580, 870 ] 1 0.001% 100.001% ( 870, 1300 ] 4 0.005% 100.006% ( 1300, 1900 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47891 Average: 3.5456 StdDev: 53.21 Min: 0 Median: 1.5756 Max: 4646 Percentiles: P50: 1.58 P75: 1.95 P99: 6.63 P99.9: 112.18 P99.99: 1232.14 ------------------------------------------------------ [ 0, 1 ] 5722 11.948% 11.948% ## ( 1, 2 ] 31660 66.108% 78.056% ############# ( 2, 3 ] 5883 12.284% 90.341% ## ( 3, 4 ] 2301 4.805% 95.145% # ( 4, 6 ] 1791 3.740% 98.885% # ( 6, 10 ] 351 0.733% 99.618% ( 10, 15 ] 83 0.173% 99.791% ( 15, 22 ] 35 0.073% 99.864% ( 22, 34 ] 15 0.031% 99.896% ( 51, 76 ] 1 0.002% 99.898% ( 76, 110 ] 1 0.002% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 170, 250 ] 6 0.013% 99.919% ( 250, 380 ] 10 0.021% 99.939% ( 380, 580 ] 13 0.027% 99.967% ( 580, 870 ] 7 0.015% 99.981% ( 870, 1300 ] 5 0.010% 99.992% ( 1300, 1900 ] 3 0.006% 99.998% ( 1900, 2900 ] 4 0.008% 100.006% ( 2900, 4400 ] 4 0.008% 100.015% ( 4400, 6600 ] 2 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 1396.1000 StdDev: 855.61 Min: 441 Median: 1300.0000 Max: 3601 Percentiles: P50: 1300.00 P75: 1800.00 P99: 3601.00 P99.9: 3601.00 P99.99: 3601.00 ------------------------------------------------------ ( 380, 580 ] 5 16.667% 16.667% ### ( 580, 870 ] 7 23.333% 40.000% ##### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 9 30.000% 80.000% ###### ( 1900, 2900 ] 4 13.333% 93.333% ### ( 2900, 4400 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.432 H:M:S, 11.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.389 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/11-06:57:53 ... thread 0: (1000000,5000000) ops and (278686.1,325290.4) ops/second in (3.588266,15.370881) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 3.38 GB 62.9 3.3 0.0 3.3 8.0 4.7 0.0 1.7 128.4 314.8 26.01 24.32 80 0.325 3390K 3631 0.0 0.0 L1 8/8 880.60 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 239.7 238.9 5.00 4.88 2 2.501 1217K 3468 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.3 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 25/0 971.38 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 204.2 204.0 3.36 2.93 3 1.121 697K 596 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/24 100.87 GB 0.0 5.4 1.8 3.6 10.2 6.6 0.8 2.1 156.0 291.5 35.74 33.44 87 0.411 5658K 7872 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.8 3.6 10.2 6.6 0.8 2.1 156.0 291.5 35.74 33.44 87 0.411 5658K 7872 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.8 3.6 5.4 1.8 0.0 0.0 252.2 251.8 22.10 21.26 19 1.163 5658K 7872 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.7 13.64 12.18 68 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.17 GB write, 668.64 MB/s write, 5.44 GB read, 357.77 MB/s read, 35.7 seconds Interval compaction: 10.17 GB write, 677.55 MB/s write, 5.44 GB read, 362.54 MB/s read, 35.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 17, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1369354 Average: 2.0674 StdDev: 11.04 Min: 0 Median: 1.4220 Max: 4335 Percentiles: P50: 1.42 P75: 1.81 P99: 5.26 P99.9: 9.73 P99.99: 14.31 ------------------------------------------------------ [ 0, 1 ] 311444 22.744% 22.744% ##### ( 1, 2 ] 884487 64.592% 87.335% ############# ( 2, 3 ] 106591 7.784% 95.119% ## ( 3, 4 ] 39833 2.909% 98.028% # ( 4, 6 ] 21134 1.543% 99.572% ( 6, 10 ] 4818 0.352% 99.924% ( 10, 15 ] 1057 0.077% 100.001% ( 15, 22 ] 120 0.009% 100.009% ( 22, 34 ] 15 0.001% 100.011% ( 34, 51 ] 12 0.001% 100.011% ( 51, 76 ] 9 0.001% 100.012% ( 76, 110 ] 9 0.001% 100.013% ( 110, 170 ] 58 0.004% 100.017% ( 170, 250 ] 31 0.002% 100.019% ( 250, 380 ] 34 0.002% 100.022% ( 380, 580 ] 12 0.001% 100.023% ( 580, 870 ] 20 0.001% 100.024% ( 870, 1300 ] 16 0.001% 100.025% ( 1300, 1900 ] 9 0.001% 100.026% ( 1900, 2900 ] 4 0.000% 100.026% ( 2900, 4400 ] 7 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 123682 Average: 2.5153 StdDev: 11.15 Min: 0 Median: 1.5564 Max: 1416 Percentiles: P50: 1.56 P75: 1.93 P99: 6.95 P99.9: 85.63 P99.99: 427.85 ------------------------------------------------------ [ 0, 1 ] 15685 12.682% 12.682% ### ( 1, 2 ] 82951 67.068% 79.750% ############# ( 2, 3 ] 14239 11.513% 91.262% ## ( 3, 4 ] 5336 4.314% 95.577% # ( 4, 6 ] 3957 3.199% 98.776% # ( 6, 10 ] 1166 0.943% 99.719% ( 10, 15 ] 175 0.141% 99.860% ( 15, 22 ] 24 0.019% 99.880% ( 22, 34 ] 5 0.004% 99.884% ( 51, 76 ] 7 0.006% 99.889% ( 76, 110 ] 47 0.038% 99.927% ( 110, 170 ] 46 0.037% 99.964% ( 170, 250 ] 13 0.011% 99.975% ( 250, 380 ] 16 0.013% 99.988% ( 380, 580 ] 11 0.009% 99.997% ( 580, 870 ] 4 0.003% 100.000% ( 870, 1300 ] 4 0.003% 100.003% ( 1300, 1900 ] 2 0.002% 100.005% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47891 Average: 3.5456 StdDev: 53.21 Min: 0 Median: 1.5756 Max: 4646 Percentiles: P50: 1.58 P75: 1.95 P99: 6.63 P99.9: 112.18 P99.99: 1232.14 ------------------------------------------------------ [ 0, 1 ] 5722 11.948% 11.948% ## ( 1, 2 ] 31660 66.108% 78.056% ############# ( 2, 3 ] 5883 12.284% 90.341% ## ( 3, 4 ] 2301 4.805% 95.145% # ( 4, 6 ] 1791 3.740% 98.885% # ( 6, 10 ] 351 0.733% 99.618% ( 10, 15 ] 83 0.173% 99.791% ( 15, 22 ] 35 0.073% 99.864% ( 22, 34 ] 15 0.031% 99.896% ( 51, 76 ] 1 0.002% 99.898% ( 76, 110 ] 1 0.002% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 170, 250 ] 6 0.013% 99.919% ( 250, 380 ] 10 0.021% 99.939% ( 380, 580 ] 13 0.027% 99.967% ( 580, 870 ] 7 0.015% 99.981% ( 870, 1300 ] 5 0.010% 99.992% ( 1300, 1900 ] 3 0.006% 99.998% ( 1900, 2900 ] 4 0.008% 100.006% ( 2900, 4400 ] 4 0.008% 100.015% ( 4400, 6600 ] 2 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 1396.1000 StdDev: 855.61 Min: 441 Median: 1300.0000 Max: 3601 Percentiles: P50: 1300.00 P75: 1800.00 P99: 3601.00 P99.9: 3601.00 P99.99: 3601.00 ------------------------------------------------------ ( 380, 580 ] 5 16.667% 16.667% ### ( 580, 870 ] 7 23.333% 40.000% ##### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 9 30.000% 80.000% ###### ( 1900, 2900 ] 4 13.333% 93.333% ### ( 2900, 4400 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 315.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.387 H:M:S, 15.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.955 H:M:S, 26.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/11-06:58:06 ... thread 0: (1000000,6000000) ops and (79511.2,214686.5) ops/second in (12.576845,27.947726) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 1.84 GB 0.0 5.3 0.0 5.3 11.0 5.7 0.0 1.9 148.6 309.0 36.47 34.35 102 0.358 5500K 7298 0.0 0.0 L1 15/15 1.82 GB 0.0 4.6 3.7 0.9 4.5 3.6 0.2 1.2 228.0 225.2 20.44 19.42 3 6.812 4731K 57K 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.8 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 37/17 2.46 GB 1.7 0.7 0.5 0.2 0.7 0.5 1.5 1.4 204.2 204.0 3.36 2.93 3 1.121 697K 596 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/37 101.79 GB 0.0 10.9 4.4 6.5 16.5 10.0 3.8 2.9 180.3 274.3 61.63 58.02 110 0.560 11M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.9 4.4 6.5 16.5 10.0 3.8 2.9 180.3 274.3 61.63 58.02 110 0.560 11M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.9 4.4 6.5 10.8 4.3 0.0 0.0 246.0 244.5 45.18 43.34 26 1.738 11M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.1 16.45 14.68 84 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.2 total, 28.0 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.51 GB write, 600.43 MB/s write, 10.85 GB read, 394.69 MB/s read, 61.6 seconds Interval compaction: 16.51 GB write, 604.83 MB/s write, 10.85 GB read, 397.58 MB/s read, 61.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 17, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2380880 Average: 2.2501 StdDev: 12.59 Min: 0 Median: 1.4182 Max: 4335 Percentiles: P50: 1.42 P75: 1.80 P99: 5.45 P99.9: 87.96 P99.99: 167.75 ------------------------------------------------------ [ 0, 1 ] 540428 22.699% 22.699% ##### ( 1, 2 ] 1554202 65.278% 87.977% ############# ( 2, 3 ] 172061 7.227% 95.204% # ( 3, 4 ] 65398 2.747% 97.951% # ( 4, 6 ] 34486 1.448% 99.399% ( 6, 10 ] 9279 0.390% 99.789% ( 10, 15 ] 1789 0.075% 99.864% ( 15, 22 ] 252 0.011% 99.875% ( 22, 34 ] 17 0.001% 99.875% ( 34, 51 ] 15 0.001% 99.876% ( 51, 76 ] 64 0.003% 99.879% ( 76, 110 ] 1444 0.061% 99.939% ( 110, 170 ] 1254 0.053% 99.992% ( 170, 250 ] 226 0.009% 100.001% ( 250, 380 ] 202 0.008% 100.010% ( 380, 580 ] 157 0.007% 100.017% ( 580, 870 ] 65 0.003% 100.019% ( 870, 1300 ] 36 0.002% 100.021% ( 1300, 1900 ] 13 0.001% 100.021% ( 1900, 2900 ] 11 0.000% 100.022% ( 2900, 4400 ] 9 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 303619 Average: 2.7371 StdDev: 20.49 Min: 0 Median: 1.4623 Max: 3151 Percentiles: P50: 1.46 P75: 1.85 P99: 7.36 P99.9: 151.98 P99.99: 824.82 ------------------------------------------------------ [ 0, 1 ] 60803 20.026% 20.026% #### ( 1, 2 ] 196872 64.842% 84.868% ############# ( 2, 3 ] 25111 8.271% 93.138% ## ( 3, 4 ] 9798 3.227% 96.366% # ( 4, 6 ] 7134 2.350% 98.715% ( 6, 10 ] 2543 0.838% 99.553% ( 10, 15 ] 338 0.111% 99.664% ( 15, 22 ] 63 0.021% 99.685% ( 22, 34 ] 5 0.002% 99.686% ( 34, 51 ] 2 0.001% 99.687% ( 51, 76 ] 33 0.011% 99.698% ( 76, 110 ] 351 0.116% 99.814% ( 110, 170 ] 375 0.124% 99.937% ( 170, 250 ] 42 0.014% 99.951% ( 250, 380 ] 44 0.014% 99.965% ( 380, 580 ] 51 0.017% 99.982% ( 580, 870 ] 28 0.009% 99.991% ( 870, 1300 ] 17 0.006% 99.997% ( 1300, 1900 ] 8 0.003% 100.000% ( 1900, 2900 ] 5 0.002% 100.001% ( 2900, 4400 ] 2 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47899 Average: 3.5772 StdDev: 53.27 Min: 0 Median: 1.5757 Max: 4646 Percentiles: P50: 1.58 P75: 1.95 P99: 6.72 P99.9: 171.35 P99.99: 1232.07 ------------------------------------------------------ [ 0, 1 ] 5722 11.946% 11.946% ## ( 1, 2 ] 31660 66.097% 78.043% ############# ( 2, 3 ] 5883 12.282% 90.325% ## ( 3, 4 ] 2301 4.804% 95.129% # ( 4, 6 ] 1791 3.739% 98.868% # ( 6, 10 ] 351 0.733% 99.601% ( 10, 15 ] 83 0.173% 99.775% ( 15, 22 ] 35 0.073% 99.848% ( 22, 34 ] 15 0.031% 99.879% ( 51, 76 ] 1 0.002% 99.881% ( 76, 110 ] 2 0.004% 99.885% ( 110, 170 ] 7 0.015% 99.900% ( 170, 250 ] 6 0.013% 99.912% ( 250, 380 ] 13 0.027% 99.939% ( 380, 580 ] 13 0.027% 99.967% ( 580, 870 ] 7 0.015% 99.981% ( 870, 1300 ] 5 0.010% 99.992% ( 1300, 1900 ] 3 0.006% 99.998% ( 1900, 2900 ] 4 0.008% 100.006% ( 2900, 4400 ] 4 0.008% 100.015% ( 4400, 6600 ] 2 0.004% 100.019% ** Level 4 read latency histogram (micros): Count: 30 Average: 1396.1000 StdDev: 855.61 Min: 441 Median: 1300.0000 Max: 3601 Percentiles: P50: 1300.00 P75: 1800.00 P99: 3601.00 P99.9: 3601.00 P99.99: 3601.00 ------------------------------------------------------ ( 380, 580 ] 5 16.667% 16.667% ### ( 580, 870 ] 7 23.333% 40.000% ##### ( 870, 1300 ] 3 10.000% 50.000% ## ( 1300, 1900 ] 9 30.000% 80.000% ###### ( 1900, 2900 ] 4 13.333% 93.333% ### ( 2900, 4400 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 28.2 total, 12.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 209.73 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.875 H:M:S, 42.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 78.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.488 H:M:S, 75.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 0 2024/08/11-06:58:09 ... thread 0: (1000000,7000000) ops and (309979.2,224547.9) ops/second in (3.226023,31.173749) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/5 2.70 GB 88.1 5.8 0.0 5.8 12.4 6.6 0.0 1.9 144.5 307.1 41.41 38.70 116 0.357 6076K 7899 0.0 0.0 L1 15/15 1.82 GB 0.0 4.6 3.7 0.9 4.5 3.6 0.2 1.2 228.0 225.2 20.44 19.42 3 6.812 4731K 57K 0.0 0.0 L2 1/0 49.90 MB 0.5 0.3 0.2 0.2 0.3 0.2 1.8 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 14/0 950.96 MB 1.0 0.7 0.5 0.2 0.7 0.5 1.5 1.4 204.2 204.0 3.36 2.93 3 1.121 697K 596 0.0 0.0 L4 166/0 9.68 GB 1.0 0.8 0.7 0.1 0.8 0.7 1.1 1.2 155.7 155.1 5.57 4.01 6 0.929 857K 2623 0.0 0.0 L5 1064/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/20 102.65 GB 0.0 12.3 5.1 7.2 18.8 11.6 6.2 2.9 173.9 266.4 72.15 66.38 130 0.555 12M 68K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.3 5.1 7.2 18.8 11.6 6.2 2.9 173.9 266.4 72.15 66.38 130 0.555 12M 68K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.3 5.1 7.2 12.2 5.0 0.0 0.0 237.3 235.9 52.88 49.45 34 1.555 12M 68K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.9 19.27 16.93 96 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.4 total, 31.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.77 GB write, 612.41 MB/s write, 12.25 GB read, 399.83 MB/s read, 72.1 seconds Interval compaction: 18.77 GB write, 616.43 MB/s write, 12.25 GB read, 402.46 MB/s read, 72.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 29, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2695807 Average: 2.3387 StdDev: 18.39 Min: 0 Median: 1.4321 Max: 6440 Percentiles: P50: 1.43 P75: 1.81 P99: 5.60 P99.9: 84.99 P99.99: 184.54 ------------------------------------------------------ [ 0, 1 ] 586574 21.759% 21.759% #### ( 1, 2 ] 1762096 65.364% 87.123% ############# ( 2, 3 ] 206513 7.661% 94.784% ## ( 3, 4 ] 78389 2.908% 97.691% # ( 4, 6 ] 44155 1.638% 99.329% ( 6, 10 ] 12399 0.460% 99.789% ( 10, 15 ] 2195 0.081% 99.871% ( 15, 22 ] 304 0.011% 99.882% ( 22, 34 ] 18 0.001% 99.883% ( 34, 51 ] 16 0.001% 99.883% ( 51, 76 ] 68 0.003% 99.886% ( 76, 110 ] 1457 0.054% 99.940% ( 110, 170 ] 1305 0.048% 99.988% ( 170, 250 ] 272 0.010% 99.998% ( 250, 380 ] 261 0.010% 100.008% ( 380, 580 ] 203 0.008% 100.016% ( 580, 870 ] 109 0.004% 100.020% ( 870, 1300 ] 57 0.002% 100.022% ( 1300, 1900 ] 23 0.001% 100.023% ( 1900, 2900 ] 31 0.001% 100.024% ( 2900, 4400 ] 21 0.001% 100.024% ( 4400, 6600 ] 6 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 466284 Average: 3.3111 StdDev: 41.05 Min: 0 Median: 1.5964 Max: 7421 Percentiles: P50: 1.60 P75: 2.03 P99: 8.01 P99.9: 101.40 P99.99: 160.83 ------------------------------------------------------ [ 0, 1 ] 63621 13.644% 13.644% ### ( 1, 2 ] 284230 60.956% 74.601% ############ ( 2, 3 ] 62327 13.367% 87.967% ### ( 3, 4 ] 25795 5.532% 93.499% # ( 4, 6 ] 22919 4.915% 98.415% # ( 6, 10 ] 5430 1.165% 99.579% ( 10, 15 ] 1043 0.224% 99.803% ( 15, 22 ] 145 0.031% 99.834% ( 22, 34 ] 8 0.002% 99.836% ( 34, 51 ] 3 0.001% 99.836% ( 51, 76 ] 33 0.007% 99.843% ( 76, 110 ] 353 0.076% 99.919% ( 110, 170 ] 390 0.084% 100.003% ( 170, 250 ] 58 0.012% 100.015% ( 250, 380 ] 70 0.015% 100.030% ( 380, 580 ] 75 0.016% 100.046% ( 580, 870 ] 63 0.014% 100.060% ( 870, 1300 ] 32 0.007% 100.067% ( 1300, 1900 ] 16 0.003% 100.070% ( 1900, 2900 ] 31 0.007% 100.077% ( 2900, 4400 ] 24 0.005% 100.082% ( 4400, 6600 ] 4 0.001% 100.083% ( 6600, 9900 ] 1 0.000% 100.083% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 104582 Average: 9.4850 StdDev: 103.37 Min: 0 Median: 1.7298 Max: 6263 Percentiles: P50: 1.73 P75: 2.54 P99: 105.36 P99.9: 1019.24 P99.99: 2238.54 ------------------------------------------------------ [ 0, 1 ] 7826 7.483% 7.483% # ( 1, 2 ] 60927 58.258% 65.741% ############ ( 2, 3 ] 17841 17.059% 82.800% ### ( 3, 4 ] 8262 7.900% 90.700% ## ( 4, 6 ] 6286 6.011% 96.711% # ( 6, 10 ] 1851 1.770% 98.481% ( 10, 15 ] 388 0.371% 98.852% ( 15, 22 ] 90 0.086% 98.938% ( 22, 34 ] 18 0.017% 98.955% ( 34, 51 ] 3 0.003% 98.958% ( 51, 76 ] 1 0.001% 98.959% ( 76, 110 ] 50 0.048% 99.007% ( 110, 170 ] 140 0.134% 99.140% ( 170, 250 ] 164 0.157% 99.297% ( 250, 380 ] 214 0.205% 99.502% ( 380, 580 ] 222 0.212% 99.714% ( 580, 870 ] 167 0.160% 99.874% ( 870, 1300 ] 79 0.076% 99.949% ( 1300, 1900 ] 29 0.028% 99.977% ( 1900, 2900 ] 40 0.038% 100.015% ( 2900, 4400 ] 35 0.033% 100.049% ( 4400, 6600 ] 5 0.005% 100.054% ** Level 4 read latency histogram (micros): Count: 190 Average: 282.3842 StdDev: 616.40 Min: 1 Median: 2.5789 Max: 3601 Percentiles: P50: 2.58 P75: 210.00 P99: 2975.00 P99.9: 3601.00 P99.99: 3601.00 ------------------------------------------------------ [ 0, 1 ] 25 13.158% 13.158% ### ( 1, 2 ] 59 31.053% 44.211% ###### ( 2, 3 ] 19 10.000% 54.211% ## ( 3, 4 ] 3 1.579% 55.789% ( 4, 6 ] 6 3.158% 58.947% # ( 6, 10 ] 3 1.579% 60.526% ( 10, 15 ] 8 4.211% 64.737% # ( 15, 22 ] 4 2.105% 66.842% ( 22, 34 ] 2 1.053% 67.895% ( 34, 51 ] 2 1.053% 68.947% ( 110, 170 ] 8 4.211% 73.158% # ( 170, 250 ] 7 3.684% 76.842% # ( 250, 380 ] 3 1.579% 78.421% ( 380, 580 ] 10 5.263% 83.684% # ( 580, 870 ] 11 5.789% 89.474% # ( 870, 1300 ] 4 2.105% 91.579% ( 1300, 1900 ] 10 5.263% 96.842% # ( 1900, 2900 ] 4 2.105% 98.947% ( 2900, 4400 ] 2 1.053% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1077.7100 StdDev: 1169.48 Min: 87 Median: 472.3077 Max: 4777 Percentiles: P50: 472.31 P75: 1780.00 P99: 4777.00 P99.9: 4777.00 P99.99: 4777.00 ------------------------------------------------------ ( 76, 110 ] 1 1.000% 1.000% ( 110, 170 ] 12 12.000% 13.000% ## ( 170, 250 ] 11 11.000% 24.000% ## ( 250, 380 ] 20 20.000% 44.000% #### ( 380, 580 ] 13 13.000% 57.000% ### ( 580, 870 ] 8 8.000% 65.000% ## ( 870, 1300 ] 6 6.000% 71.000% # ( 1300, 1900 ] 5 5.000% 76.000% # ( 1900, 2900 ] 16 16.000% 92.000% ### ( 2900, 4400 ] 6 6.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 31.4 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 219.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.420 H:M:S, 39.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.545 H:M:S, 16.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/11-06:58:24 ... thread 0: (1000000,8000000) ops and (64716.0,171578.5) ops/second in (15.452141,46.625890) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/3 1.84 GB 18.9 8.0 0.0 8.0 15.5 7.6 0.0 2.1 151.7 295.0 53.97 49.53 133 0.406 8313K 16K 0.0 0.0 L1 11/11 1.27 GB 0.0 8.2 5.5 2.7 8.1 5.4 0.2 1.5 227.6 224.6 36.94 34.86 4 9.236 7692K 57K 0.0 0.0 L2 2/1 140.50 MB 0.7 0.3 0.2 0.2 0.3 0.2 4.2 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 37/9 2.66 GB 1.8 1.6 0.8 0.8 1.6 0.8 3.4 2.0 141.1 140.0 11.95 7.68 8 1.493 1711K 13K 0.0 0.0 L4 171/13 10.19 GB 1.0 1.4 1.2 0.2 1.4 1.2 1.1 1.1 131.4 130.9 11.00 6.78 10 1.100 1443K 5301 0.0 0.0 L5 1064/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/37 103.56 GB 0.0 19.6 7.8 11.8 27.0 15.2 10.4 3.6 174.2 240.2 115.23 100.17 157 0.734 19M 92K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.6 7.8 11.8 27.0 15.2 10.4 3.6 174.2 240.2 115.23 100.17 157 0.734 19M 92K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.6 7.8 11.8 19.5 7.6 0.0 0.0 218.2 216.6 92.02 80.58 48 1.917 19M 92K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 333.9 23.21 19.58 109 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.8 total, 46.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.03 GB write, 591.04 MB/s write, 19.60 GB read, 428.63 MB/s read, 115.2 seconds Interval compaction: 27.03 GB write, 593.63 MB/s write, 19.60 GB read, 430.52 MB/s read, 115.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 43, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3626297 Average: 2.5865 StdDev: 30.80 Min: 0 Median: 1.4436 Max: 21586 Percentiles: P50: 1.44 P75: 1.83 P99: 5.84 P99.9: 118.77 P99.99: 295.45 ------------------------------------------------------ [ 0, 1 ] 762815 21.036% 21.036% #### ( 1, 2 ] 2367911 65.298% 86.334% ############# ( 2, 3 ] 286590 7.903% 94.237% ## ( 3, 4 ] 110631 3.051% 97.288% # ( 4, 6 ] 67482 1.861% 99.149% ( 6, 10 ] 19603 0.541% 99.689% ( 10, 15 ] 3175 0.088% 99.777% ( 15, 22 ] 520 0.014% 99.791% ( 22, 34 ] 32 0.001% 99.792% ( 34, 51 ] 17 0.000% 99.793% ( 51, 76 ] 132 0.004% 99.796% ( 76, 110 ] 3338 0.092% 99.888% ( 110, 170 ] 2914 0.080% 99.969% ( 170, 250 ] 596 0.016% 99.985% ( 250, 380 ] 513 0.014% 99.999% ( 380, 580 ] 403 0.011% 100.010% ( 580, 870 ] 205 0.006% 100.016% ( 870, 1300 ] 82 0.002% 100.018% ( 1300, 1900 ] 38 0.001% 100.019% ( 1900, 2900 ] 45 0.001% 100.021% ( 2900, 4400 ] 57 0.002% 100.022% ( 4400, 6600 ] 25 0.001% 100.023% ( 6600, 9900 ] 10 0.000% 100.023% ( 9900, 14000 ] 1 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1376344 Average: 4.9319 StdDev: 95.59 Min: 0 Median: 1.6250 Max: 18286 Percentiles: P50: 1.63 P75: 2.23 P99: 8.66 P99.9: 106.56 P99.99: 204.54 ------------------------------------------------------ [ 0, 1 ] 189838 13.793% 13.793% ### ( 1, 2 ] 797327 57.931% 71.724% ############ ( 2, 3 ] 192711 14.002% 85.725% ### ( 3, 4 ] 84556 6.144% 91.869% # ( 4, 6 ] 83794 6.088% 97.957% # ( 6, 10 ] 21606 1.570% 99.527% ( 10, 15 ] 3343 0.243% 99.770% ( 15, 22 ] 573 0.042% 99.811% ( 22, 34 ] 35 0.003% 99.814% ( 34, 51 ] 17 0.001% 99.815% ( 51, 76 ] 160 0.012% 99.827% ( 76, 110 ] 1121 0.081% 99.908% ( 110, 170 ] 998 0.073% 99.981% ( 170, 250 ] 295 0.021% 100.002% ( 250, 380 ] 298 0.022% 100.024% ( 380, 580 ] 344 0.025% 100.049% ( 580, 870 ] 372 0.027% 100.076% ( 870, 1300 ] 235 0.017% 100.093% ( 1300, 1900 ] 111 0.008% 100.101% ( 1900, 2900 ] 122 0.009% 100.110% ( 2900, 4400 ] 223 0.016% 100.126% ( 4400, 6600 ] 104 0.008% 100.134% ( 6600, 9900 ] 58 0.004% 100.138% ( 9900, 14000 ] 5 0.000% 100.138% ( 14000, 22000 ] 5 0.000% 100.139% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 181309 Average: 11.7273 StdDev: 132.28 Min: 0 Median: 1.8250 Max: 8280 Percentiles: P50: 1.83 P75: 2.80 P99: 100.04 P99.9: 1191.42 P99.99: 1893.72 ------------------------------------------------------ [ 0, 1 ] 9092 5.015% 5.015% # ( 1, 2 ] 98863 54.527% 59.542% ########### ( 2, 3 ] 35004 19.306% 78.848% #### ( 3, 4 ] 17619 9.718% 88.566% ## ( 4, 6 ] 14871 8.202% 96.768% ## ( 6, 10 ] 3316 1.829% 98.597% ( 10, 15 ] 546 0.301% 98.898% ( 15, 22 ] 125 0.069% 98.967% ( 22, 34 ] 20 0.011% 98.978% ( 34, 51 ] 3 0.002% 98.980% ( 51, 76 ] 1 0.001% 98.980% ( 76, 110 ] 55 0.030% 99.011% ( 110, 170 ] 163 0.090% 99.100% ( 170, 250 ] 217 0.120% 99.220% ( 250, 380 ] 327 0.180% 99.400% ( 380, 580 ] 390 0.215% 99.616% ( 580, 870 ] 352 0.194% 99.810% ( 870, 1300 ] 223 0.123% 99.933% ( 1300, 1900 ] 108 0.060% 99.992% ( 1900, 2900 ] 76 0.042% 100.034% ( 2900, 4400 ] 78 0.043% 100.077% ( 4400, 6600 ] 22 0.012% 100.089% ( 6600, 9900 ] 6 0.003% 100.093% ** Level 4 read latency histogram (micros): Count: 18228 Average: 16.7537 StdDev: 154.99 Min: 1 Median: 1.9080 Max: 5317 Percentiles: P50: 1.91 P75: 2.96 P99: 444.31 P99.9: 2298.35 P99.99: 3929.53 ------------------------------------------------------ [ 0, 1 ] 599 3.286% 3.286% # ( 1, 2 ] 9378 51.448% 54.734% ########## ( 2, 3 ] 3854 21.143% 75.878% #### ( 3, 4 ] 1995 10.945% 86.822% ## ( 4, 6 ] 1673 9.178% 96.001% ## ( 6, 10 ] 363 1.991% 97.992% ( 10, 15 ] 75 0.411% 98.404% ( 15, 22 ] 13 0.071% 98.475% ( 22, 34 ] 4 0.022% 98.497% ( 34, 51 ] 3 0.016% 98.513% ( 76, 110 ] 3 0.016% 98.530% ( 110, 170 ] 12 0.066% 98.596% ( 170, 250 ] 32 0.176% 98.771% ( 250, 380 ] 25 0.137% 98.908% ( 380, 580 ] 52 0.285% 99.194% ( 580, 870 ] 53 0.291% 99.484% ( 870, 1300 ] 41 0.225% 99.709% ( 1300, 1900 ] 28 0.154% 99.863% ( 1900, 2900 ] 17 0.093% 99.956% ( 2900, 4400 ] 9 0.049% 100.005% ( 4400, 6600 ] 2 0.011% 100.016% ** Level 5 read latency histogram (micros): Count: 100 Average: 1077.7100 StdDev: 1169.48 Min: 87 Median: 472.3077 Max: 4777 Percentiles: P50: 472.31 P75: 1780.00 P99: 4777.00 P99.9: 4777.00 P99.99: 4777.00 ------------------------------------------------------ ( 76, 110 ] 1 1.000% 1.000% ( 110, 170 ] 12 12.000% 13.000% ## ( 170, 250 ] 11 11.000% 24.000% ## ( 250, 380 ] 20 20.000% 44.000% #### ( 380, 580 ] 13 13.000% 57.000% ### ( 580, 870 ] 8 8.000% 65.000% ## ( 870, 1300 ] 6 6.000% 71.000% # ( 1300, 1900 ] 5 5.000% 76.000% # ( 1900, 2900 ] 16 16.000% 92.000% ### ( 2900, 4400 ] 6 6.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 46.8 total, 15.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 168.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.953 H:M:S, 53.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 63.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.534 H:M:S, 81.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/08/11-06:58:29 ... thread 0: (1000000,9000000) ops and (238381.5,177092.7) ops/second in (4.194956,50.820846) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/7 2.76 GB 81.8 8.7 0.0 8.7 17.1 8.5 0.0 2.0 146.4 289.5 60.64 54.65 147 0.413 9016K 16K 0.0 0.0 L1 11/11 1.27 GB 0.0 8.2 5.5 2.7 8.1 5.4 0.2 1.5 227.6 224.6 36.94 34.86 4 9.236 7692K 57K 0.0 0.0 L2 1/0 69.69 MB 0.7 0.3 0.2 0.2 0.3 0.2 4.2 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 21/0 945.62 MB 0.9 1.8 0.9 0.9 1.8 0.9 3.4 2.0 140.4 139.2 13.43 8.60 9 1.492 1914K 15K 0.0 0.0 L4 157/0 9.64 GB 1.0 3.8 3.0 0.8 3.8 3.0 1.1 1.3 127.4 126.9 30.66 18.08 28 1.095 3935K 14K 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/18 104.47 GB 0.0 22.9 9.7 13.2 31.2 18.0 12.8 3.7 163.8 223.5 143.04 117.50 190 0.753 22M 104K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.9 9.7 13.2 31.2 18.0 12.8 3.7 163.8 223.5 143.04 117.50 190 0.753 22M 104K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.9 9.7 13.2 22.7 9.5 0.0 0.0 202.1 200.8 115.91 95.43 69 1.680 22M 104K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 320.4 27.13 22.06 121 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.0 total, 50.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.22 GB write, 626.43 MB/s write, 22.88 GB read, 459.12 MB/s read, 143.0 seconds Interval compaction: 31.22 GB write, 628.96 MB/s write, 22.88 GB read, 460.97 MB/s read, 143.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 57, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4035565 Average: 2.6825 StdDev: 34.57 Min: 0 Median: 1.4677 Max: 21586 Percentiles: P50: 1.47 P75: 1.85 P99: 5.96 P99.9: 112.76 P99.99: 295.53 ------------------------------------------------------ [ 0, 1 ] 793034 19.651% 19.651% #### ( 1, 2 ] 2618732 64.891% 84.542% ############# ( 2, 3 ] 357874 8.868% 93.410% ## ( 3, 4 ] 135940 3.369% 96.779% # ( 4, 6 ] 91323 2.263% 99.042% ( 6, 10 ] 26144 0.648% 99.690% ( 10, 15 ] 4180 0.104% 99.793% ( 15, 22 ] 626 0.016% 99.809% ( 22, 34 ] 40 0.001% 99.810% ( 34, 51 ] 21 0.001% 99.810% ( 51, 76 ] 136 0.003% 99.814% ( 76, 110 ] 3345 0.083% 99.897% ( 110, 170 ] 2941 0.073% 99.970% ( 170, 250 ] 631 0.016% 99.985% ( 250, 380 ] 558 0.014% 99.999% ( 380, 580 ] 455 0.011% 100.010% ( 580, 870 ] 264 0.007% 100.017% ( 870, 1300 ] 114 0.003% 100.020% ( 1300, 1900 ] 59 0.001% 100.021% ( 1900, 2900 ] 76 0.002% 100.023% ( 2900, 4400 ] 76 0.002% 100.025% ( 4400, 6600 ] 34 0.001% 100.026% ( 6600, 9900 ] 15 0.000% 100.026% ( 9900, 14000 ] 3 0.000% 100.026% ( 14000, 22000 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 1566859 Average: 5.4671 StdDev: 105.23 Min: 0 Median: 1.6627 Max: 18286 Percentiles: P50: 1.66 P75: 2.38 P99: 8.85 P99.9: 115.21 P99.99: 319.61 ------------------------------------------------------ [ 0, 1 ] 192035 12.256% 12.256% ## ( 1, 2 ] 892347 56.951% 69.207% ########### ( 2, 3 ] 237230 15.140% 84.348% ### ( 3, 4 ] 105537 6.736% 91.083% # ( 4, 6 ] 104931 6.697% 97.780% # ( 6, 10 ] 26864 1.715% 99.495% ( 10, 15 ] 4244 0.271% 99.766% ( 15, 22 ] 669 0.043% 99.808% ( 22, 34 ] 43 0.003% 99.811% ( 34, 51 ] 22 0.001% 99.813% ( 51, 76 ] 162 0.010% 99.823% ( 76, 110 ] 1121 0.072% 99.894% ( 110, 170 ] 1004 0.064% 99.959% ( 170, 250 ] 315 0.020% 99.979% ( 250, 380 ] 333 0.021% 100.000% ( 380, 580 ] 409 0.026% 100.026% ( 580, 870 ] 455 0.029% 100.055% ( 870, 1300 ] 296 0.019% 100.074% ( 1300, 1900 ] 160 0.010% 100.084% ( 1900, 2900 ] 223 0.014% 100.098% ( 2900, 4400 ] 325 0.021% 100.119% ( 4400, 6600 ] 135 0.009% 100.128% ( 6600, 9900 ] 73 0.005% 100.132% ( 9900, 14000 ] 10 0.001% 100.133% ( 14000, 22000 ] 6 0.000% 100.133% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 428810 Average: 10.1263 StdDev: 135.14 Min: 0 Median: 1.8879 Max: 13419 Percentiles: P50: 1.89 P75: 2.89 P99: 10.00 P99.9: 988.38 P99.99: 1609.55 ------------------------------------------------------ [ 0, 1 ] 12923 3.014% 3.014% # ( 1, 2 ] 226930 52.921% 55.935% ########### ( 2, 3 ] 92222 21.506% 77.441% #### ( 3, 4 ] 44703 10.425% 87.866% ## ( 4, 6 ] 40215 9.378% 97.244% ## ( 6, 10 ] 7530 1.756% 99.000% ( 10, 15 ] 1387 0.323% 99.324% ( 15, 22 ] 233 0.054% 99.378% ( 22, 34 ] 29 0.007% 99.385% ( 34, 51 ] 5 0.001% 99.386% ( 51, 76 ] 2 0.000% 99.386% ( 76, 110 ] 61 0.014% 99.401% ( 110, 170 ] 184 0.043% 99.444% ( 170, 250 ] 284 0.066% 99.510% ( 250, 380 ] 427 0.100% 99.609% ( 380, 580 ] 566 0.132% 99.741% ( 580, 870 ] 572 0.133% 99.875% ( 870, 1300 ] 393 0.092% 99.966% ( 1300, 1900 ] 196 0.046% 100.012% ( 1900, 2900 ] 162 0.038% 100.050% ( 2900, 4400 ] 194 0.045% 100.095% ( 4400, 6600 ] 54 0.013% 100.108% ( 6600, 9900 ] 11 0.003% 100.110% ( 9900, 14000 ] 7 0.002% 100.112% ** Level 4 read latency histogram (micros): Count: 119783 Average: 14.4717 StdDev: 175.44 Min: 1 Median: 1.9659 Max: 11517 Percentiles: P50: 1.97 P75: 3.01 P99: 14.42 P99.9: 2051.24 P99.99: 3324.57 ------------------------------------------------------ [ 0, 1 ] 1655 1.382% 1.382% ( 1, 2 ] 60292 50.334% 51.716% ########## ( 2, 3 ] 27798 23.207% 74.923% ##### ( 3, 4 ] 13264 11.073% 85.996% ## ( 4, 6 ] 12232 10.212% 96.208% ## ( 6, 10 ] 2884 2.408% 98.616% ( 10, 15 ] 521 0.435% 99.051% ( 15, 22 ] 67 0.056% 99.107% ( 22, 34 ] 11 0.009% 99.116% ( 34, 51 ] 5 0.004% 99.120% ( 51, 76 ] 3 0.003% 99.123% ( 76, 110 ] 22 0.018% 99.141% ( 110, 170 ] 54 0.045% 99.186% ( 170, 250 ] 109 0.091% 99.277% ( 250, 380 ] 113 0.094% 99.371% ( 380, 580 ] 176 0.147% 99.518% ( 580, 870 ] 199 0.166% 99.684% ( 870, 1300 ] 146 0.122% 99.806% ( 1300, 1900 ] 98 0.082% 99.888% ( 1900, 2900 ] 94 0.078% 99.967% ( 2900, 4400 ] 99 0.083% 100.049% ( 4400, 6600 ] 23 0.019% 100.068% ( 6600, 9900 ] 5 0.004% 100.073% ( 9900, 14000 ] 3 0.003% 100.075% ** Level 5 read latency histogram (micros): Count: 240 Average: 1359.3417 StdDev: 1370.74 Min: 87 Median: 710.9677 Max: 5356 Percentiles: P50: 710.97 P75: 2175.86 P99: 5356.00 P99.9: 5356.00 P99.99: 5356.00 ------------------------------------------------------ ( 76, 110 ] 2 0.833% 0.833% ( 110, 170 ] 18 7.500% 8.333% ## ( 170, 250 ] 17 7.083% 15.417% # ( 250, 380 ] 36 15.000% 30.417% ### ( 380, 580 ] 33 13.750% 44.167% ### ( 580, 870 ] 31 12.917% 57.083% ### ( 870, 1300 ] 19 7.917% 65.000% ## ( 1300, 1900 ] 16 6.667% 71.667% # ( 1900, 2900 ] 29 12.083% 83.750% ## ( 2900, 4400 ] 26 10.833% 94.583% ## ( 4400, 6600 ] 13 5.417% 100.000% # ** DB Stats ** Uptime(secs): 51.0 total, 4.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 173.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.427 H:M:S, 51.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 234.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.474 H:M:S, 35.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/11-06:58:32 ... thread 0: (1000000,10000000) ops and (308898.6,184986.0) ops/second in (3.237308,54.058154) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/7 3.80 GB 188.8 9.5 0.0 9.5 19.0 9.5 0.0 2.0 145.2 291.1 66.80 60.42 164 0.407 9848K 17K 0.0 0.0 L1 11/11 1.27 GB 0.0 8.2 5.5 2.7 8.1 5.4 0.2 1.5 227.6 224.6 36.94 34.86 4 9.236 7692K 57K 0.0 0.0 L2 1/0 69.69 MB 0.7 0.3 0.2 0.2 0.3 0.2 4.2 1.8 255.4 255.3 1.37 1.31 2 0.683 354K 177 0.0 0.0 L3 21/0 945.62 MB 0.9 1.8 0.9 0.9 1.8 0.9 3.4 2.0 140.4 139.2 13.43 8.60 9 1.492 1914K 15K 0.0 0.0 L4 157/0 9.64 GB 1.0 3.8 3.0 0.8 3.8 3.0 1.1 1.3 127.4 126.9 30.66 18.08 28 1.095 3935K 14K 0.0 0.0 L5 1092/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/18 105.52 GB 0.0 23.7 9.7 14.0 33.1 19.0 12.8 3.5 162.5 226.9 149.20 123.27 207 0.721 23M 105K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.7 9.7 14.0 33.1 19.0 12.8 3.5 162.5 226.9 149.20 123.27 207 0.721 23M 105K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.7 9.7 14.0 23.5 9.5 0.0 0.0 203.7 202.4 119.01 98.48 72 1.653 23M 105K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 323.4 30.19 24.79 135 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.3 total, 54.1 interval Flush(GB): cumulative 9.535, interval 9.535 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.06 GB write, 623.87 MB/s write, 23.68 GB read, 446.82 MB/s read, 149.2 seconds Interval compaction: 33.06 GB write, 626.23 MB/s write, 23.68 GB read, 448.51 MB/s read, 149.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 12, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 62, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4354780 Average: 2.6539 StdDev: 33.47 Min: 0 Median: 1.4729 Max: 21586 Percentiles: P50: 1.47 P75: 1.86 P99: 5.95 P99.9: 107.33 P99.99: 262.94 ------------------------------------------------------ [ 0, 1 ] 835986 19.197% 19.197% #### ( 1, 2 ] 2836619 65.138% 84.335% ############# ( 2, 3 ] 394690 9.063% 93.398% ## ( 3, 4 ] 147556 3.388% 96.787% # ( 4, 6 ] 98907 2.271% 99.058% ( 6, 10 ] 28290 0.650% 99.708% ( 10, 15 ] 4423 0.102% 99.809% ( 15, 22 ] 649 0.015% 99.824% ( 22, 34 ] 48 0.001% 99.825% ( 34, 51 ] 23 0.001% 99.826% ( 51, 76 ] 138 0.003% 99.829% ( 76, 110 ] 3360 0.077% 99.906% ( 110, 170 ] 2952 0.068% 99.974% ( 170, 250 ] 647 0.015% 99.989% ( 250, 380 ] 568 0.013% 100.002% ( 380, 580 ] 462 0.011% 100.012% ( 580, 870 ] 273 0.006% 100.019% ( 870, 1300 ] 115 0.003% 100.021% ( 1300, 1900 ] 61 0.001% 100.023% ( 1900, 2900 ] 79 0.002% 100.024% ( 2900, 4400 ] 78 0.002% 100.026% ( 4400, 6600 ] 34 0.001% 100.027% ( 6600, 9900 ] 15 0.000% 100.027% ( 9900, 14000 ] 3 0.000% 100.027% ( 14000, 22000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1663744 Average: 5.2946 StdDev: 102.15 Min: 0 Median: 1.6524 Max: 18286 Percentiles: P50: 1.65 P75: 2.33 P99: 8.80 P99.9: 116.97 P99.99: 323.43 ------------------------------------------------------ [ 0, 1 ] 206383 12.405% 12.405% ## ( 1, 2 ] 958788 57.628% 70.033% ############ ( 2, 3 ] 247049 14.849% 84.882% ### ( 3, 4 ] 108286 6.509% 91.391% # ( 4, 6 ] 106800 6.419% 97.810% # ( 6, 10 ] 28278 1.700% 99.510% ( 10, 15 ] 4282 0.257% 99.767% ( 15, 22 ] 675 0.041% 99.807% ( 22, 34 ] 44 0.003% 99.810% ( 34, 51 ] 22 0.001% 99.811% ( 51, 76 ] 170 0.010% 99.822% ( 76, 110 ] 1176 0.071% 99.892% ( 110, 170 ] 1095 0.066% 99.958% ( 170, 250 ] 337 0.020% 99.978% ( 250, 380 ] 341 0.020% 99.999% ( 380, 580 ] 421 0.025% 100.024% ( 580, 870 ] 458 0.028% 100.052% ( 870, 1300 ] 296 0.018% 100.070% ( 1300, 1900 ] 161 0.010% 100.079% ( 1900, 2900 ] 223 0.013% 100.093% ( 2900, 4400 ] 325 0.020% 100.112% ( 4400, 6600 ] 135 0.008% 100.120% ( 6600, 9900 ] 73 0.004% 100.125% ( 9900, 14000 ] 10 0.001% 100.125% ( 14000, 22000 ] 6 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 88161 Average: 2.1501 StdDev: 15.24 Min: 1 Median: 1.3555 Max: 3388 Percentiles: P50: 1.36 P75: 1.76 P99: 5.60 P99.9: 23.26 P99.99: 525.59 ------------------------------------------------------ [ 0, 1 ] 24944 28.294% 28.294% ###### ( 1, 2 ] 53832 61.061% 89.355% ############ ( 2, 3 ] 5232 5.935% 95.289% # ( 3, 4 ] 2060 2.337% 97.626% ( 4, 6 ] 1516 1.720% 99.346% ( 6, 10 ] 427 0.484% 99.830% ( 10, 15 ] 49 0.056% 99.885% ( 15, 22 ] 12 0.014% 99.899% ( 22, 34 ] 8 0.009% 99.908% ( 34, 51 ] 27 0.031% 99.939% ( 51, 76 ] 8 0.009% 99.948% ( 76, 110 ] 2 0.002% 99.950% ( 110, 170 ] 3 0.003% 99.953% ( 170, 250 ] 18 0.020% 99.974% ( 250, 380 ] 12 0.014% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 5 0.006% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 428810 Average: 10.1263 StdDev: 135.14 Min: 0 Median: 1.8879 Max: 13419 Percentiles: P50: 1.89 P75: 2.89 P99: 10.00 P99.9: 988.38 P99.99: 1609.55 ------------------------------------------------------ [ 0, 1 ] 12923 3.014% 3.014% # ( 1, 2 ] 226930 52.921% 55.935% ########### ( 2, 3 ] 92222 21.506% 77.441% #### ( 3, 4 ] 44703 10.425% 87.866% ## ( 4, 6 ] 40215 9.378% 97.244% ## ( 6, 10 ] 7530 1.756% 99.000% ( 10, 15 ] 1387 0.323% 99.324% ( 15, 22 ] 233 0.054% 99.378% ( 22, 34 ] 29 0.007% 99.385% ( 34, 51 ] 5 0.001% 99.386% ( 51, 76 ] 2 0.000% 99.386% ( 76, 110 ] 61 0.014% 99.401% ( 110, 170 ] 184 0.043% 99.444% ( 170, 250 ] 284 0.066% 99.510% ( 250, 380 ] 427 0.100% 99.609% ( 380, 580 ] 566 0.132% 99.741% ( 580, 870 ] 572 0.133% 99.875% ( 870, 1300 ] 393 0.092% 99.966% ( 1300, 1900 ] 196 0.046% 100.012% ( 1900, 2900 ] 162 0.038% 100.050% ( 2900, 4400 ] 194 0.045% 100.095% ( 4400, 6600 ] 54 0.013% 100.108% ( 6600, 9900 ] 11 0.003% 100.110% ( 9900, 14000 ] 7 0.002% 100.112% ** Level 4 read latency histogram (micros): Count: 119783 Average: 14.4717 StdDev: 175.44 Min: 1 Median: 1.9659 Max: 11517 Percentiles: P50: 1.97 P75: 3.01 P99: 14.42 P99.9: 2051.24 P99.99: 3324.57 ------------------------------------------------------ [ 0, 1 ] 1655 1.382% 1.382% ( 1, 2 ] 60292 50.334% 51.716% ########## ( 2, 3 ] 27798 23.207% 74.923% ##### ( 3, 4 ] 13264 11.073% 85.996% ## ( 4, 6 ] 12232 10.212% 96.208% ## ( 6, 10 ] 2884 2.408% 98.616% ( 10, 15 ] 521 0.435% 99.051% ( 15, 22 ] 67 0.056% 99.107% ( 22, 34 ] 11 0.009% 99.116% ( 34, 51 ] 5 0.004% 99.120% ( 51, 76 ] 3 0.003% 99.123% ( 76, 110 ] 22 0.018% 99.141% ( 110, 170 ] 54 0.045% 99.186% ( 170, 250 ] 109 0.091% 99.277% ( 250, 380 ] 113 0.094% 99.371% ( 380, 580 ] 176 0.147% 99.518% ( 580, 870 ] 199 0.166% 99.684% ( 870, 1300 ] 146 0.122% 99.806% ( 1300, 1900 ] 98 0.082% 99.888% ( 1900, 2900 ] 94 0.078% 99.967% ( 2900, 4400 ] 99 0.083% 100.049% ( 4400, 6600 ] 23 0.019% 100.068% ( 6600, 9900 ] 5 0.004% 100.073% ( 9900, 14000 ] 3 0.003% 100.075% ** Level 5 read latency histogram (micros): Count: 240 Average: 1359.3417 StdDev: 1370.74 Min: 87 Median: 710.9677 Max: 5356 Percentiles: P50: 710.97 P75: 2175.86 P99: 5356.00 P99.9: 5356.00 P99.99: 5356.00 ------------------------------------------------------ ( 76, 110 ] 2 0.833% 0.833% ( 110, 170 ] 18 7.500% 8.333% ## ( 170, 250 ] 17 7.083% 15.417% # ( 250, 380 ] 36 15.000% 30.417% ### ( 380, 580 ] 33 13.750% 44.167% ### ( 580, 870 ] 31 12.917% 57.083% ### ( 870, 1300 ] 19 7.917% 65.000% ## ( 1300, 1900 ] 16 6.667% 71.667% # ( 1900, 2900 ] 29 12.083% 83.750% ## ( 2900, 4400 ] 26 10.833% 94.583% ## ( 4400, 6600 ] 13 5.417% 100.000% # ** DB Stats ** Uptime(secs): 54.3 total, 3.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 181.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.014 H:M:S, 49.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.587 H:M:S, 18.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.865 micros/op 170517 ops/sec 60.047 seconds 10238999 operations; 165.2 MB/s Microseconds per write: Count: 10238999 Average: 5.8645 StdDev: 448.60 Min: 0 Median: 1.7328 Max: 834810 Percentiles: P50: 1.73 P75: 2.74 P99: 9.13 P99.9: 1132.01 P99.99: 2571.59 ------------------------------------------------------ [ 0, 1 ] 1422720 13.895% 13.895% ### ( 1, 2 ] 5044412 49.267% 63.162% ########## ( 2, 3 ] 1631453 15.934% 79.095% ### ( 3, 4 ] 1400785 13.681% 92.776% ### ( 4, 6 ] 544990 5.323% 98.099% # ( 6, 10 ] 117814 1.151% 99.250% ( 10, 15 ] 35002 0.342% 99.592% ( 15, 22 ] 8199 0.080% 99.672% ( 22, 34 ] 1458 0.014% 99.686% ( 34, 51 ] 218 0.002% 99.688% ( 51, 76 ] 31 0.000% 99.688% ( 76, 110 ] 7207 0.070% 99.759% ( 110, 170 ] 2692 0.026% 99.785% ( 170, 250 ] 307 0.003% 99.788% ( 250, 380 ] 161 0.002% 99.790% ( 380, 580 ] 28 0.000% 99.790% ( 580, 870 ] 21 0.000% 99.790% ( 870, 1300 ] 18483 0.181% 99.971% ( 1300, 1900 ] 25 0.000% 99.971% ( 1900, 2900 ] 2932 0.029% 99.999% ( 2900, 4400 ] 23 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 6 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 19 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 193687 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10238999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10566646968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 521 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32052188 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31039236193 rocksdb.compact.write.bytes COUNT : 30829841073 rocksdb.flush.write.bytes COUNT : 10436831810 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 58 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 245 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10352857088 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4186112 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31137680755 rocksdb.non.last.level.read.count COUNT : 7521194 rocksdb.block.checksum.compute.count COUNT : 7520210 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.378742 P95 : 3.908255 P99 : 7.596992 P100 : 834806.000000 COUNT : 10238999 SUM : 55325781 rocksdb.compaction.times.micros P50 : 1127142.857143 P95 : 4850000.000000 P99 : 16507241.000000 P100 : 16507241.000000 COUNT : 75 SUM : 136142934 rocksdb.compaction.times.cpu_micros P50 : 938108.108108 P95 : 4850000.000000 P99 : 15438004.000000 P100 : 15438004.000000 COUNT : 75 SUM : 113542541 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 701.728395 P95 : 1360.000000 P99 : 96700.000000 P100 : 127015.000000 COUNT : 138 SUM : 339611 rocksdb.compaction.outfile.sync.micros P50 : 1020.205479 P95 : 139700.000000 P99 : 190410.000000 P100 : 190410.000000 COUNT : 321 SUM : 6208298 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.523810 P95 : 1690.000000 P99 : 3160.000000 P100 : 3576.000000 COUNT : 248 SUM : 79353 rocksdb.table.open.io.micros P50 : 1419.354839 P95 : 7995.000000 P99 : 11123.166667 P100 : 20471.000000 COUNT : 521 SUM : 1091706 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.612031 P95 : 7.246940 P99 : 9.975786 P100 : 21591.000000 COUNT : 7519078 SUM : 46714121 rocksdb.read.block.get.micros P50 : 451.641791 P95 : 3480.555556 P99 : 5393.473684 P100 : 5962.000000 COUNT : 1042 SUM : 883084 rocksdb.write.raw.block.micros P50 : 0.512546 P95 : 0.973837 P99 : 2.748272 P100 : 40264.000000 COUNT : 9999162 SUM : 20499014 rocksdb.numfiles.in.singlecompaction P50 : 3.288043 P95 : 4.433333 P99 : 16.855000 P100 : 20.000000 COUNT : 147 SUM : 548 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559568 P95 : 1133.795844 P99 : 2219.760438 P100 : 834618.000000 COUNT : 202266 SUM : 32070327 rocksdb.sst.read.micros P50 : 1.545746 P95 : 4.196329 P99 : 7.959175 P100 : 21586.000000 COUNT : 7521969 SUM : 31143424 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10238999 SUM : 10566646968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212247.191011 P95 : 432250.000000 P99 : 823266.666667 P100 : 956306.000000 COUNT : 138 SUM : 31093803 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 310 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0