[2024-11-06 02:49:56.981821] Starting SPDK v25.01-pre git sha1 f220d590c / DPDK 22.11.4 initialization... [2024-11-06 02:49:56.981921] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid744210 ] Set seed to 1730857796979386 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-06 02:49:57.074064] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-06 02:49:57.097213] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-06 02:49:57.097254] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 744210' to capture a snapshot of events at runtime. [2024-11-06 02:49:57.097264] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-06 02:49:57.097274] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-06 02:49:57.097281] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid744210 for offline analysis/debug. [2024-11-06 02:49:57.097834] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 6 02:50:01 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/06-02:50:04 ... thread 0: (1000000,1000000) ops and (358043.0,358043.0) ops/second in (2.792961,2.792961) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.01 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 359.9 2.28 2.05 12 0.190 0 0 0.0 0.0 L1 3/3 188.88 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 249.8 249.7 0.76 0.73 1 0.757 191K 95 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 9/0 741.25 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 88.2 317.7 3.57 3.30 14 0.255 319K 131 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.3 1.4 88.2 317.7 3.57 3.30 14 0.255 319K 131 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 243.5 243.4 1.29 1.25 2 0.647 319K 131 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 359.9 2.28 2.05 12 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 374.42 MB/s write, 0.31 GB read, 104.01 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 405.72 MB/s write, 0.31 GB read, 112.71 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 118702 Average: 1.8955 StdDev: 19.29 Min: 1 Median: 1.1781 Max: 3374 Percentiles: P50: 1.18 P75: 1.64 P99: 4.38 P99.9: 9.52 P99.99: 204.08 ------------------------------------------------------ [ 0, 1 ] 48014 40.449% 40.449% ######## ( 1, 2 ] 63647 53.619% 94.068% ########### ( 2, 3 ] 3946 3.324% 97.393% # ( 3, 4 ] 1725 1.453% 98.846% ( 4, 6 ] 967 0.815% 99.660% ( 6, 10 ] 324 0.273% 99.933% ( 10, 15 ] 41 0.035% 99.968% ( 15, 22 ] 11 0.009% 99.977% ( 22, 34 ] 4 0.003% 99.981% ( 34, 51 ] 3 0.003% 99.983% ( 51, 76 ] 2 0.002% 99.985% ( 110, 170 ] 5 0.004% 99.989% ( 170, 250 ] 5 0.004% 99.993% ( 250, 380 ] 5 0.004% 99.997% ( 580, 870 ] 1 0.001% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ( 1300, 1900 ] 3 0.003% 100.003% ( 1900, 2900 ] 2 0.002% 100.004% ( 2900, 4400 ] 2 0.002% 100.006% ** Level 1 read latency histogram (micros): Count: 21913 Average: 2.0811 StdDev: 22.76 Min: 1 Median: 1.2290 Max: 2794 Percentiles: P50: 1.23 P75: 1.67 P99: 3.99 P99.9: 8.47 P99.99: 1043.87 ------------------------------------------------------ [ 0, 1 ] 8122 37.065% 37.065% ####### ( 1, 2 ] 12376 56.478% 93.543% ########### ( 2, 3 ] 821 3.747% 97.289% # ( 3, 4 ] 377 1.720% 99.010% ( 4, 6 ] 179 0.817% 99.827% ( 6, 10 ] 26 0.119% 99.945% ( 10, 15 ] 2 0.009% 99.954% ( 15, 22 ] 1 0.005% 99.959% ( 170, 250 ] 1 0.005% 99.963% ( 250, 380 ] 1 0.005% 99.968% ( 380, 580 ] 2 0.009% 99.977% ( 580, 870 ] 2 0.009% 99.986% ( 870, 1300 ] 2 0.009% 99.995% ( 1900, 2900 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 10602 Average: 2.3864 StdDev: 9.25 Min: 1 Median: 1.5601 Max: 858 Percentiles: P50: 1.56 P75: 1.93 P99: 6.04 P99.9: 12.85 P99.99: 567.94 ------------------------------------------------------ [ 0, 1 ] 1306 12.318% 12.318% ## ( 1, 2 ] 7134 67.289% 79.608% ############# ( 2, 3 ] 1106 10.432% 90.040% ## ( 3, 4 ] 587 5.537% 95.576% # ( 4, 6 ] 363 3.424% 99.000% # ( 6, 10 ] 89 0.839% 99.840% ( 10, 15 ] 13 0.123% 99.962% ( 15, 22 ] 3 0.028% 99.991% ( 380, 580 ] 1 0.009% 100.000% ( 580, 870 ] 1 0.009% 100.009% ** Level 3 read latency histogram (micros): Count: 40 Average: 1722.0000 StdDev: 1319.43 Min: 153 Median: 1420.0000 Max: 5143 Percentiles: P50: 1420.00 P75: 2566.67 P99: 5143.00 P99.9: 5143.00 P99.99: 5143.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 170, 250 ] 2 5.000% 7.500% # ( 250, 380 ] 5 12.500% 20.000% ### ( 380, 580 ] 2 5.000% 25.000% # ( 580, 870 ] 3 7.500% 32.500% ## ( 870, 1300 ] 6 15.000% 47.500% ### ( 1300, 1900 ] 5 12.500% 60.000% ### ( 1900, 2900 ] 9 22.500% 82.500% ##### ( 2900, 4400 ] 4 10.000% 92.500% ## ( 4400, 6600 ] 3 7.500% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 2068.3429 StdDev: 1378.05 Min: 216 Median: 1690.0000 Max: 5153 Percentiles: P50: 1690.00 P75: 2953.57 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 580, 870 ] 2 5.714% 17.143% # ( 870, 1300 ] 5 14.286% 31.429% ### ( 1300, 1900 ] 10 28.571% 60.000% ###### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 7 20.000% 94.286% #### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 324.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.211 H:M:S, 7.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.211 H:M:S, 7.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/06-02:50:07 ... thread 0: (1000000,2000000) ops and (328776.1,342785.9) ops/second in (3.041584,5.834545) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/5 1.23 GB 50.4 0.7 0.0 0.7 2.5 1.8 0.0 1.4 96.1 328.1 7.87 7.30 29 0.271 767K 799 0.0 0.0 L1 5/5 440.06 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.8 242.5 2.59 2.53 2 1.297 639K 866 0.0 0.0 L2 1/0 962.92 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 17/0 866.27 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 217.2 217.2 0.58 0.52 1 0.576 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1192/10 97.92 GB 0.0 1.6 0.6 1.0 3.4 2.4 0.4 1.9 141.4 299.0 11.58 10.86 33 0.351 1662K 1701 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.6 1.0 3.4 2.4 0.3 1.9 141.4 299.0 11.58 10.86 33 0.351 1662K 1701 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.6 1.0 1.6 0.6 0.0 0.0 251.4 251.1 6.51 6.31 7 0.930 1662K 1701 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 360.7 5.07 4.55 26 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.38 GB write, 570.37 MB/s write, 1.60 GB read, 269.68 MB/s read, 11.6 seconds Interval compaction: 3.38 GB write, 593.20 MB/s write, 1.60 GB read, 280.47 MB/s read, 11.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 393237 Average: 2.0271 StdDev: 14.30 Min: 1 Median: 1.3710 Max: 3968 Percentiles: P50: 1.37 P75: 1.78 P99: 5.13 P99.9: 9.60 P99.99: 14.25 ------------------------------------------------------ [ 0, 1 ] 106782 27.155% 27.155% ##### ( 1, 2 ] 242177 61.586% 88.740% ############ ( 2, 3 ] 27460 6.983% 95.723% # ( 3, 4 ] 9985 2.539% 98.262% # ( 4, 6 ] 5149 1.309% 99.572% ( 6, 10 ] 1435 0.365% 99.937% ( 10, 15 ] 248 0.063% 100.000% ( 15, 22 ] 28 0.007% 100.007% ( 22, 34 ] 9 0.002% 100.009% ( 34, 51 ] 5 0.001% 100.010% ( 51, 76 ] 3 0.001% 100.011% ( 110, 170 ] 11 0.003% 100.014% ( 170, 250 ] 12 0.003% 100.017% ( 250, 380 ] 14 0.004% 100.021% ( 380, 580 ] 3 0.001% 100.021% ( 580, 870 ] 7 0.002% 100.023% ( 870, 1300 ] 3 0.001% 100.024% ( 1300, 1900 ] 3 0.001% 100.025% ( 1900, 2900 ] 2 0.001% 100.025% ( 2900, 4400 ] 4 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 81648 Average: 2.1102 StdDev: 13.73 Min: 1 Median: 1.4102 Max: 2794 Percentiles: P50: 1.41 P75: 1.80 P99: 5.07 P99.9: 9.46 P99.99: 569.01 ------------------------------------------------------ [ 0, 1 ] 19417 23.781% 23.781% ##### ( 1, 2 ] 52183 63.912% 87.694% ############# ( 2, 3 ] 6367 7.798% 95.492% ## ( 3, 4 ] 2243 2.747% 98.239% # ( 4, 6 ] 1160 1.421% 99.660% ( 6, 10 ] 227 0.278% 99.938% ( 10, 15 ] 30 0.037% 99.974% ( 15, 22 ] 3 0.004% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 110, 170 ] 1 0.001% 99.980% ( 170, 250 ] 2 0.002% 99.983% ( 250, 380 ] 3 0.004% 99.987% ( 380, 580 ] 3 0.004% 99.990% ( 580, 870 ] 3 0.004% 99.994% ( 870, 1300 ] 3 0.004% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31746 Average: 2.3388 StdDev: 5.44 Min: 1 Median: 1.5799 Max: 858 Percentiles: P50: 1.58 P75: 1.95 P99: 6.44 P99.9: 12.47 P99.99: 50.01 ------------------------------------------------------ [ 0, 1 ] 3384 10.660% 10.660% ## ( 1, 2 ] 21537 67.842% 78.501% ############## ( 2, 3 ] 3752 11.819% 90.320% ## ( 3, 4 ] 1688 5.317% 95.637% # ( 4, 6 ] 1035 3.260% 98.897% # ( 6, 10 ] 298 0.939% 99.836% ( 10, 15 ] 41 0.129% 99.965% ( 15, 22 ] 3 0.009% 99.975% ( 22, 34 ] 2 0.006% 99.981% ( 34, 51 ] 3 0.009% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 876.6750 StdDev: 1261.94 Min: 2 Median: 210.0000 Max: 5143 Percentiles: P50: 210.00 P75: 1420.00 P99: 5143.00 P99.9: 5143.00 P99.99: 5143.00 ------------------------------------------------------ ( 1, 2 ] 12 15.000% 15.000% ### ( 2, 3 ] 16 20.000% 35.000% #### ( 3, 4 ] 4 5.000% 40.000% # ( 4, 6 ] 4 5.000% 45.000% # ( 6, 10 ] 1 1.250% 46.250% ( 10, 15 ] 1 1.250% 47.500% ( 110, 170 ] 1 1.250% 48.750% ( 170, 250 ] 2 2.500% 51.250% # ( 250, 380 ] 5 6.250% 57.500% # ( 380, 580 ] 3 3.750% 61.250% # ( 580, 870 ] 4 5.000% 66.250% # ( 870, 1300 ] 6 7.500% 73.750% ## ( 1300, 1900 ] 5 6.250% 80.000% # ( 1900, 2900 ] 9 11.250% 91.250% ## ( 2900, 4400 ] 4 5.000% 96.250% # ( 4400, 6600 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 2068.3429 StdDev: 1378.05 Min: 216 Median: 1690.0000 Max: 5153 Percentiles: P50: 1690.00 P75: 2953.57 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 580, 870 ] 2 5.714% 17.143% # ( 870, 1300 ] 5 14.286% 31.429% ### ( 1300, 1900 ] 10 28.571% 60.000% ###### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 7 20.000% 94.286% #### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.616 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/06-02:50:10 ... thread 0: (1000000,3000000) ops and (330477.9,338582.6) ops/second in (3.025921,8.860466) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 2.21 GB 119.6 1.5 0.0 1.5 4.3 2.8 0.0 1.6 114.7 320.9 13.73 12.82 46 0.299 1599K 1734 0.0 0.0 L1 5/5 440.06 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 242.8 242.5 2.59 2.53 2 1.297 639K 866 0.0 0.0 L2 1/0 962.92 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 17/0 866.27 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 217.2 217.2 0.58 0.52 1 0.576 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/14 98.90 GB 0.0 2.4 0.6 1.8 5.2 3.4 0.4 1.9 140.8 303.2 17.44 16.38 50 0.349 2493K 2636 0.0 0.0 Int 0/0 0.00 KB 0.0 2.4 0.6 1.8 5.2 3.4 0.3 1.9 140.8 303.2 17.44 16.38 50 0.349 2493K 2636 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.4 0.6 1.8 2.4 0.6 0.0 0.0 257.6 257.3 9.53 9.28 10 0.953 2493K 2636 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 358.5 7.91 7.10 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.16 GB write, 581.35 MB/s write, 2.40 GB read, 270.00 MB/s read, 17.4 seconds Interval compaction: 5.16 GB write, 596.68 MB/s write, 2.40 GB read, 277.12 MB/s read, 17.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 722879 Average: 2.0786 StdDev: 11.12 Min: 0 Median: 1.4318 Max: 3968 Percentiles: P50: 1.43 P75: 1.82 P99: 5.27 P99.9: 9.49 P99.99: 12.94 ------------------------------------------------------ [ 0, 1 ] 160574 22.213% 22.213% #### ( 1, 2 ] 465211 64.355% 86.568% ############# ( 2, 3 ] 61501 8.508% 95.076% ## ( 3, 4 ] 21262 2.941% 98.018% # ( 4, 6 ] 11163 1.544% 99.562% ( 6, 10 ] 2807 0.388% 99.950% ( 10, 15 ] 492 0.068% 100.018% ( 15, 22 ] 46 0.006% 100.024% ( 22, 34 ] 13 0.002% 100.026% ( 34, 51 ] 7 0.001% 100.027% ( 51, 76 ] 5 0.001% 100.028% ( 110, 170 ] 14 0.002% 100.030% ( 170, 250 ] 22 0.003% 100.033% ( 250, 380 ] 23 0.003% 100.036% ( 380, 580 ] 7 0.001% 100.037% ( 580, 870 ] 11 0.002% 100.039% ( 870, 1300 ] 6 0.001% 100.039% ( 1300, 1900 ] 4 0.001% 100.040% ( 1900, 2900 ] 2 0.000% 100.040% ( 2900, 4400 ] 4 0.001% 100.041% ** Level 1 read latency histogram (micros): Count: 148408 Average: 2.1062 StdDev: 10.20 Min: 1 Median: 1.4575 Max: 2794 Percentiles: P50: 1.46 P75: 1.83 P99: 5.13 P99.9: 9.43 P99.99: 216.37 ------------------------------------------------------ [ 0, 1 ] 29147 19.640% 19.640% #### ( 1, 2 ] 98483 66.360% 85.999% ############# ( 2, 3 ] 13590 9.157% 95.157% ## ( 3, 4 ] 4447 2.996% 98.153% # ( 4, 6 ] 2224 1.499% 99.652% ( 6, 10 ] 430 0.290% 99.941% ( 10, 15 ] 65 0.044% 99.985% ( 15, 22 ] 4 0.003% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 110, 170 ] 1 0.001% 99.989% ( 170, 250 ] 2 0.001% 99.991% ( 250, 380 ] 3 0.002% 99.993% ( 380, 580 ] 3 0.002% 99.995% ( 580, 870 ] 3 0.002% 99.997% ( 870, 1300 ] 3 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31746 Average: 2.3388 StdDev: 5.44 Min: 1 Median: 1.5799 Max: 858 Percentiles: P50: 1.58 P75: 1.95 P99: 6.44 P99.9: 12.47 P99.99: 50.01 ------------------------------------------------------ [ 0, 1 ] 3384 10.660% 10.660% ## ( 1, 2 ] 21537 67.842% 78.501% ############## ( 2, 3 ] 3752 11.819% 90.320% ## ( 3, 4 ] 1688 5.317% 95.637% # ( 4, 6 ] 1035 3.260% 98.897% # ( 6, 10 ] 298 0.939% 99.836% ( 10, 15 ] 41 0.129% 99.965% ( 15, 22 ] 3 0.009% 99.975% ( 22, 34 ] 2 0.006% 99.981% ( 34, 51 ] 3 0.009% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 876.6750 StdDev: 1261.94 Min: 2 Median: 210.0000 Max: 5143 Percentiles: P50: 210.00 P75: 1420.00 P99: 5143.00 P99.9: 5143.00 P99.99: 5143.00 ------------------------------------------------------ ( 1, 2 ] 12 15.000% 15.000% ### ( 2, 3 ] 16 20.000% 35.000% #### ( 3, 4 ] 4 5.000% 40.000% # ( 4, 6 ] 4 5.000% 45.000% # ( 6, 10 ] 1 1.250% 46.250% ( 10, 15 ] 1 1.250% 47.500% ( 110, 170 ] 1 1.250% 48.750% ( 170, 250 ] 2 2.500% 51.250% # ( 250, 380 ] 5 6.250% 57.500% # ( 380, 580 ] 3 3.750% 61.250% # ( 580, 870 ] 4 5.000% 66.250% # ( 870, 1300 ] 6 7.500% 73.750% ## ( 1300, 1900 ] 5 6.250% 80.000% # ( 1900, 2900 ] 9 11.250% 91.250% ## ( 2900, 4400 ] 4 5.000% 96.250% # ( 4400, 6600 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 2068.3429 StdDev: 1378.05 Min: 216 Median: 1690.0000 Max: 5153 Percentiles: P50: 1690.00 P75: 2953.57 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 580, 870 ] 2 5.714% 17.143% # ( 870, 1300 ] 5 14.286% 31.429% ### ( 1300, 1900 ] 10 28.571% 60.000% ###### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 7 20.000% 94.286% #### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.995 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.380 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-02:50:13 ... thread 0: (1000000,4000000) ops and (336950.2,338173.0) ops/second in (2.967798,11.828264) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.46 GB 25.2 2.1 0.0 2.1 5.8 3.8 0.0 1.6 115.1 321.4 18.62 17.38 62 0.300 2174K 2412 0.0 0.0 L1 10/10 1.16 GB 0.0 1.8 1.2 0.6 1.8 1.2 0.1 1.5 238.1 237.3 7.67 7.48 3 2.555 1853K 6351 0.0 0.0 L2 1/0 962.92 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 17/0 866.27 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 217.2 217.2 0.58 0.52 1 0.576 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1205/24 99.88 GB 0.0 4.1 1.4 2.8 7.9 5.1 0.4 2.1 154.0 293.9 27.39 25.89 67 0.409 4283K 8799 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.4 2.8 7.9 5.1 0.3 2.1 154.0 293.9 27.39 25.89 67 0.409 4283K 8799 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.4 2.8 4.1 1.3 0.0 0.0 252.7 252.2 16.69 16.28 13 1.284 4283K 8799 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 359.1 10.70 9.61 54 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.86 GB write, 667.46 MB/s write, 4.12 GB read, 349.67 MB/s read, 27.4 seconds Interval compaction: 7.86 GB write, 680.64 MB/s write, 4.12 GB read, 356.58 MB/s read, 27.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 985770 Average: 2.0803 StdDev: 12.63 Min: 0 Median: 1.4287 Max: 5404 Percentiles: P50: 1.43 P75: 1.82 P99: 5.23 P99.9: 9.55 P99.99: 13.36 ------------------------------------------------------ [ 0, 1 ] 219854 22.303% 22.303% #### ( 1, 2 ] 636938 64.613% 86.916% ############# ( 2, 3 ] 82468 8.366% 95.282% ## ( 3, 4 ] 27762 2.816% 98.098% # ( 4, 6 ] 14453 1.466% 99.564% ( 6, 10 ] 3733 0.379% 99.943% ( 10, 15 ] 692 0.070% 100.013% ( 15, 22 ] 65 0.007% 100.020% ( 22, 34 ] 16 0.002% 100.021% ( 34, 51 ] 7 0.001% 100.022% ( 51, 76 ] 8 0.001% 100.023% ( 76, 110 ] 3 0.000% 100.023% ( 110, 170 ] 26 0.003% 100.026% ( 170, 250 ] 33 0.003% 100.029% ( 250, 380 ] 29 0.003% 100.032% ( 380, 580 ] 10 0.001% 100.033% ( 580, 870 ] 12 0.001% 100.034% ( 870, 1300 ] 11 0.001% 100.036% ( 1300, 1900 ] 5 0.001% 100.036% ( 1900, 2900 ] 3 0.000% 100.036% ( 2900, 4400 ] 6 0.001% 100.037% ( 4400, 6600 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 190069 Average: 2.2270 StdDev: 14.35 Min: 1 Median: 1.4570 Max: 2794 Percentiles: P50: 1.46 P75: 1.83 P99: 5.42 P99.9: 10.64 P99.99: 557.62 ------------------------------------------------------ [ 0, 1 ] 37258 19.602% 19.602% #### ( 1, 2 ] 126427 66.516% 86.119% ############# ( 2, 3 ] 17089 8.991% 95.110% ## ( 3, 4 ] 5423 2.853% 97.963% # ( 4, 6 ] 2779 1.462% 99.425% ( 6, 10 ] 890 0.468% 99.893% ( 10, 15 ] 101 0.053% 99.946% ( 15, 22 ] 8 0.004% 99.951% ( 22, 34 ] 1 0.001% 99.951% ( 34, 51 ] 3 0.002% 99.953% ( 51, 76 ] 3 0.002% 99.954% ( 76, 110 ] 27 0.014% 99.968% ( 110, 170 ] 11 0.006% 99.974% ( 170, 250 ] 12 0.006% 99.981% ( 250, 380 ] 10 0.005% 99.986% ( 380, 580 ] 9 0.005% 99.991% ( 580, 870 ] 4 0.002% 99.993% ( 870, 1300 ] 6 0.003% 99.996% ( 1300, 1900 ] 6 0.003% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31746 Average: 2.3388 StdDev: 5.44 Min: 1 Median: 1.5799 Max: 858 Percentiles: P50: 1.58 P75: 1.95 P99: 6.44 P99.9: 12.47 P99.99: 50.01 ------------------------------------------------------ [ 0, 1 ] 3384 10.660% 10.660% ## ( 1, 2 ] 21537 67.842% 78.501% ############## ( 2, 3 ] 3752 11.819% 90.320% ## ( 3, 4 ] 1688 5.317% 95.637% # ( 4, 6 ] 1035 3.260% 98.897% # ( 6, 10 ] 298 0.939% 99.836% ( 10, 15 ] 41 0.129% 99.965% ( 15, 22 ] 3 0.009% 99.975% ( 22, 34 ] 2 0.006% 99.981% ( 34, 51 ] 3 0.009% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 876.6750 StdDev: 1261.94 Min: 2 Median: 210.0000 Max: 5143 Percentiles: P50: 210.00 P75: 1420.00 P99: 5143.00 P99.9: 5143.00 P99.99: 5143.00 ------------------------------------------------------ ( 1, 2 ] 12 15.000% 15.000% ### ( 2, 3 ] 16 20.000% 35.000% #### ( 3, 4 ] 4 5.000% 40.000% # ( 4, 6 ] 4 5.000% 45.000% # ( 6, 10 ] 1 1.250% 46.250% ( 10, 15 ] 1 1.250% 47.500% ( 110, 170 ] 1 1.250% 48.750% ( 170, 250 ] 2 2.500% 51.250% # ( 250, 380 ] 5 6.250% 57.500% # ( 380, 580 ] 3 3.750% 61.250% # ( 580, 870 ] 4 5.000% 66.250% # ( 870, 1300 ] 6 7.500% 73.750% ## ( 1300, 1900 ] 5 6.250% 80.000% # ( 1900, 2900 ] 9 11.250% 91.250% ## ( 2900, 4400 ] 4 5.000% 96.250% # ( 4400, 6600 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 2068.3429 StdDev: 1378.05 Min: 216 Median: 1690.0000 Max: 5153 Percentiles: P50: 1690.00 P75: 2953.57 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 580, 870 ] 2 5.714% 17.143% # ( 870, 1300 ] 5 14.286% 31.429% ### ( 1300, 1900 ] 10 28.571% 60.000% ###### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 7 20.000% 94.286% #### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.373 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-02:50:16 ... thread 0: (1000000,5000000) ops and (299134.8,329571.0) ops/second in (3.342974,15.171238) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.38 GB 119.6 3.2 0.0 3.2 7.9 4.7 0.0 1.7 128.2 315.5 25.55 23.94 80 0.319 3326K 3627 0.0 0.0 L1 10/10 1.16 GB 0.0 1.8 1.2 0.6 1.8 1.2 0.1 1.5 238.1 237.3 7.67 7.48 3 2.555 1853K 6351 0.0 0.0 L2 1/0 962.92 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 17/0 866.27 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 217.2 217.2 0.58 0.52 1 0.576 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1207/24 100.80 GB 0.0 5.2 1.4 3.9 9.9 6.0 0.4 2.1 155.9 295.1 34.32 32.44 85 0.404 5434K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 1.4 3.9 9.9 6.0 0.3 2.1 155.9 295.1 34.32 32.44 85 0.404 5434K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 1.4 3.9 5.2 1.3 0.0 0.0 255.4 254.9 20.96 20.46 17 1.233 5434K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 358.2 13.37 11.98 68 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.89 GB write, 657.48 MB/s write, 5.23 GB read, 347.40 MB/s read, 34.3 seconds Interval compaction: 9.89 GB write, 667.60 MB/s write, 5.23 GB read, 352.75 MB/s read, 34.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 13, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1361932 Average: 2.1250 StdDev: 12.45 Min: 0 Median: 1.4517 Max: 5404 Percentiles: P50: 1.45 P75: 1.83 P99: 5.28 P99.9: 9.46 P99.99: 13.01 ------------------------------------------------------ [ 0, 1 ] 277561 20.380% 20.380% #### ( 1, 2 ] 893122 65.578% 85.958% ############# ( 2, 3 ] 122528 8.997% 94.954% ## ( 3, 4 ] 41459 3.044% 97.998% # ( 4, 6 ] 21264 1.561% 99.560% ( 6, 10 ] 5362 0.394% 99.953% ( 10, 15 ] 831 0.061% 100.014% ( 15, 22 ] 80 0.006% 100.020% ( 22, 34 ] 20 0.001% 100.022% ( 34, 51 ] 9 0.001% 100.022% ( 51, 76 ] 14 0.001% 100.023% ( 76, 110 ] 50 0.004% 100.027% ( 110, 170 ] 66 0.005% 100.032% ( 170, 250 ] 50 0.004% 100.036% ( 250, 380 ] 44 0.003% 100.039% ( 380, 580 ] 19 0.001% 100.040% ( 580, 870 ] 21 0.002% 100.042% ( 870, 1300 ] 19 0.001% 100.043% ( 1300, 1900 ] 6 0.000% 100.044% ( 1900, 2900 ] 6 0.000% 100.044% ( 2900, 4400 ] 7 0.001% 100.044% ( 4400, 6600 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 261305 Average: 2.3920 StdDev: 15.87 Min: 1 Median: 1.4827 Max: 3668 Percentiles: P50: 1.48 P75: 1.86 P99: 5.89 P99.9: 81.81 P99.99: 602.92 ------------------------------------------------------ [ 0, 1 ] 46085 17.636% 17.636% #### ( 1, 2 ] 175190 67.044% 84.681% ############# ( 2, 3 ] 25450 9.740% 94.420% ## ( 3, 4 ] 7836 2.999% 97.419% # ( 4, 6 ] 4365 1.670% 99.090% ( 6, 10 ] 1948 0.745% 99.835% ( 10, 15 ] 135 0.052% 99.887% ( 15, 22 ] 11 0.004% 99.891% ( 22, 34 ] 1 0.000% 99.891% ( 34, 51 ] 3 0.001% 99.892% ( 51, 76 ] 6 0.002% 99.895% ( 76, 110 ] 86 0.033% 99.928% ( 110, 170 ] 61 0.023% 99.951% ( 170, 250 ] 39 0.015% 99.966% ( 250, 380 ] 34 0.013% 99.979% ( 380, 580 ] 29 0.011% 99.990% ( 580, 870 ] 11 0.004% 99.994% ( 870, 1300 ] 7 0.003% 99.997% ( 1300, 1900 ] 6 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31746 Average: 2.3388 StdDev: 5.44 Min: 1 Median: 1.5799 Max: 858 Percentiles: P50: 1.58 P75: 1.95 P99: 6.44 P99.9: 12.47 P99.99: 50.01 ------------------------------------------------------ [ 0, 1 ] 3384 10.660% 10.660% ## ( 1, 2 ] 21537 67.842% 78.501% ############## ( 2, 3 ] 3752 11.819% 90.320% ## ( 3, 4 ] 1688 5.317% 95.637% # ( 4, 6 ] 1035 3.260% 98.897% # ( 6, 10 ] 298 0.939% 99.836% ( 10, 15 ] 41 0.129% 99.965% ( 15, 22 ] 3 0.009% 99.975% ( 22, 34 ] 2 0.006% 99.981% ( 34, 51 ] 3 0.009% 99.991% ( 51, 76 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 876.6750 StdDev: 1261.94 Min: 2 Median: 210.0000 Max: 5143 Percentiles: P50: 210.00 P75: 1420.00 P99: 5143.00 P99.9: 5143.00 P99.99: 5143.00 ------------------------------------------------------ ( 1, 2 ] 12 15.000% 15.000% ### ( 2, 3 ] 16 20.000% 35.000% #### ( 3, 4 ] 4 5.000% 40.000% # ( 4, 6 ] 4 5.000% 45.000% # ( 6, 10 ] 1 1.250% 46.250% ( 10, 15 ] 1 1.250% 47.500% ( 110, 170 ] 1 1.250% 48.750% ( 170, 250 ] 2 2.500% 51.250% # ( 250, 380 ] 5 6.250% 57.500% # ( 380, 580 ] 3 3.750% 61.250% # ( 580, 870 ] 4 5.000% 66.250% # ( 870, 1300 ] 6 7.500% 73.750% ## ( 1300, 1900 ] 5 6.250% 80.000% # ( 1900, 2900 ] 9 11.250% 91.250% ## ( 2900, 4400 ] 4 5.000% 96.250% # ( 4400, 6600 ] 3 3.750% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 2068.3429 StdDev: 1378.05 Min: 216 Median: 1690.0000 Max: 5153 Percentiles: P50: 1690.00 P75: 2953.57 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 580, 870 ] 2 5.714% 17.143% # ( 870, 1300 ] 5 14.286% 31.429% ### ( 1300, 1900 ] 10 28.571% 60.000% ###### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 7 20.000% 94.286% #### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 15.4 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 319.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.039 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 294.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.666 H:M:S, 19.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-02:50:26 ... thread 0: (1000000,6000000) ops and (100217.6,238573.1) ops/second in (9.978287,25.149525) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 2.39 GB 6.3 5.2 0.0 5.2 10.9 5.7 0.0 1.9 147.7 307.2 36.26 33.99 101 0.359 5436K 9090 0.0 0.0 L1 18/18 2.08 GB 0.0 4.9 3.1 1.8 4.9 3.1 0.1 1.6 228.9 226.6 21.97 21.02 4 5.493 5106K 48K 0.0 0.0 L2 9/5 1.01 GB 5.2 0.1 0.1 0.1 0.1 0.1 1.2 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 17/10 866.27 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.1 1.0 217.2 217.2 0.58 0.52 1 0.576 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1213/41 101.74 GB 0.0 10.4 3.3 7.1 16.0 8.9 1.4 2.8 179.2 275.9 59.34 56.04 107 0.555 10M 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.4 3.3 7.1 16.0 8.9 1.3 2.8 179.2 275.9 59.34 56.04 107 0.555 10M 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.4 3.3 7.1 10.3 3.3 0.0 0.0 246.6 245.2 43.13 41.51 23 1.875 10M 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.4 16.22 14.53 84 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.4 total, 25.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.99 GB write, 644.91 MB/s write, 10.38 GB read, 418.91 MB/s read, 59.3 seconds Interval compaction: 15.99 GB write, 650.90 MB/s write, 10.38 GB read, 422.80 MB/s read, 59.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 13, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2219245 Average: 2.4092 StdDev: 15.43 Min: 0 Median: 1.4507 Max: 5404 Percentiles: P50: 1.45 P75: 1.83 P99: 5.66 P99.9: 103.45 P99.99: 180.64 ------------------------------------------------------ [ 0, 1 ] 448938 20.229% 20.229% #### ( 1, 2 ] 1465938 66.056% 86.285% ############# ( 2, 3 ] 190265 8.573% 94.858% ## ( 3, 4 ] 64375 2.901% 97.759% # ( 4, 6 ] 33275 1.499% 99.259% ( 6, 10 ] 11509 0.519% 99.777% ( 10, 15 ] 1231 0.055% 99.833% ( 15, 22 ] 143 0.006% 99.839% ( 22, 34 ] 28 0.001% 99.840% ( 34, 51 ] 12 0.001% 99.841% ( 51, 76 ] 66 0.003% 99.844% ( 76, 110 ] 1543 0.070% 99.913% ( 110, 170 ] 1643 0.074% 99.987% ( 170, 250 ] 429 0.019% 100.007% ( 250, 380 ] 286 0.013% 100.020% ( 380, 580 ] 204 0.009% 100.029% ( 580, 870 ] 108 0.005% 100.034% ( 870, 1300 ] 39 0.002% 100.035% ( 1300, 1900 ] 15 0.001% 100.036% ( 1900, 2900 ] 12 0.001% 100.037% ( 2900, 4400 ] 13 0.001% 100.037% ( 4400, 6600 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 476500 Average: 2.5693 StdDev: 17.61 Min: 0 Median: 1.4783 Max: 3905 Percentiles: P50: 1.48 P75: 1.86 P99: 6.88 P99.9: 144.17 P99.99: 673.80 ------------------------------------------------------ [ 0, 1 ] 87174 18.295% 18.295% #### ( 1, 2 ] 315855 66.286% 84.581% ############# ( 2, 3 ] 44733 9.388% 93.969% ## ( 3, 4 ] 14378 3.017% 96.986% # ( 4, 6 ] 8632 1.812% 98.798% ( 6, 10 ] 4372 0.918% 99.715% ( 10, 15 ] 272 0.057% 99.773% ( 15, 22 ] 34 0.007% 99.780% ( 22, 34 ] 2 0.000% 99.780% ( 34, 51 ] 6 0.001% 99.781% ( 51, 76 ] 42 0.009% 99.790% ( 76, 110 ] 327 0.069% 99.859% ( 110, 170 ] 345 0.072% 99.931% ( 170, 250 ] 101 0.021% 99.952% ( 250, 380 ] 87 0.018% 99.971% ( 380, 580 ] 82 0.017% 99.988% ( 580, 870 ] 32 0.007% 99.995% ( 870, 1300 ] 10 0.002% 99.997% ( 1300, 1900 ] 10 0.002% 99.999% ( 1900, 2900 ] 3 0.001% 99.999% ( 2900, 4400 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31769 Average: 2.5505 StdDev: 10.70 Min: 1 Median: 1.5804 Max: 858 Percentiles: P50: 1.58 P75: 1.95 P99: 6.74 P99.9: 20.21 P99.99: 639.67 ------------------------------------------------------ [ 0, 1 ] 3384 10.652% 10.652% ## ( 1, 2 ] 21537 67.793% 78.444% ############## ( 2, 3 ] 3752 11.810% 90.255% ## ( 3, 4 ] 1688 5.313% 95.568% # ( 4, 6 ] 1035 3.258% 98.826% # ( 6, 10 ] 298 0.938% 99.764% ( 10, 15 ] 41 0.129% 99.893% ( 15, 22 ] 3 0.009% 99.902% ( 22, 34 ] 2 0.006% 99.909% ( 34, 51 ] 3 0.009% 99.918% ( 51, 76 ] 1 0.003% 99.921% ( 76, 110 ] 2 0.006% 99.928% ( 110, 170 ] 5 0.016% 99.943% ( 170, 250 ] 4 0.013% 99.956% ( 250, 380 ] 6 0.019% 99.975% ( 380, 580 ] 4 0.013% 99.987% ( 580, 870 ] 4 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 18676 Average: 9.6403 StdDev: 109.61 Min: 1 Median: 1.6073 Max: 5143 Percentiles: P50: 1.61 P75: 2.03 P99: 158.80 P99.9: 1624.30 P99.99: 4497.09 ------------------------------------------------------ [ 0, 1 ] 2225 11.914% 11.914% ## ( 1, 2 ] 11712 62.712% 74.625% ############# ( 2, 3 ] 2730 14.618% 89.243% ### ( 3, 4 ] 843 4.514% 93.757% # ( 4, 6 ] 569 3.047% 96.803% # ( 6, 10 ] 294 1.574% 98.378% ( 10, 15 ] 56 0.300% 98.677% ( 15, 22 ] 2 0.011% 98.688% ( 34, 51 ] 1 0.005% 98.694% ( 76, 110 ] 6 0.032% 98.726% ( 110, 170 ] 63 0.337% 99.063% ( 170, 250 ] 45 0.241% 99.304% ( 250, 380 ] 41 0.220% 99.523% ( 380, 580 ] 29 0.155% 99.679% ( 580, 870 ] 23 0.123% 99.802% ( 870, 1300 ] 14 0.075% 99.877% ( 1300, 1900 ] 8 0.043% 99.920% ( 1900, 2900 ] 9 0.048% 99.968% ( 2900, 4400 ] 4 0.021% 99.989% ( 4400, 6600 ] 3 0.016% 100.005% ** Level 4 read latency histogram (micros): Count: 35 Average: 2068.3429 StdDev: 1378.05 Min: 216 Median: 1690.0000 Max: 5153 Percentiles: P50: 1690.00 P75: 2953.57 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 580, 870 ] 2 5.714% 17.143% # ( 870, 1300 ] 5 14.286% 31.429% ### ( 1300, 1900 ] 10 28.571% 60.000% ###### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 7 20.000% 94.286% #### ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 25.4 total, 10.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 232.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.034 H:M:S, 35.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 98.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.995 H:M:S, 70.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/06-02:50:32 ... thread 0: (1000000,7000000) ops and (161332.7,223300.5) ops/second in (6.198370,31.347895) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.32 GB 50.3 5.7 0.0 5.7 12.3 6.6 0.0 1.9 143.2 307.7 40.91 38.29 118 0.347 5947K 9584 0.0 0.0 L1 18/18 2.08 GB 0.0 4.9 3.1 1.8 4.9 3.1 0.1 1.6 228.9 226.6 21.97 21.02 4 5.493 5106K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.2 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 58/0 888.84 MB 0.9 2.1 1.1 1.0 2.1 1.1 0.1 1.9 209.4 209.1 10.38 9.31 7 1.482 2202K 2114 0.0 0.0 L4 126/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1276/34 102.66 GB 0.0 12.9 4.3 8.6 19.4 10.8 3.4 2.9 178.7 269.2 73.79 69.13 130 0.568 13M 60K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.9 4.3 8.6 19.4 10.8 3.3 2.9 178.7 269.2 73.79 69.13 130 0.568 13M 60K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.9 4.3 8.6 12.8 4.3 0.0 0.0 240.3 239.2 54.88 52.22 31 1.770 13M 60K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 356.3 18.92 16.91 99 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.6 total, 31.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.40 GB write, 628.96 MB/s write, 12.88 GB read, 417.47 MB/s read, 73.8 seconds Interval compaction: 19.40 GB write, 633.65 MB/s write, 12.88 GB read, 420.58 MB/s read, 73.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 14, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2662762 Average: 2.4484 StdDev: 15.23 Min: 0 Median: 1.4803 Max: 5404 Percentiles: P50: 1.48 P75: 1.86 P99: 5.83 P99.9: 97.42 P99.99: 187.73 ------------------------------------------------------ [ 0, 1 ] 489599 18.387% 18.387% #### ( 1, 2 ] 1752488 65.815% 84.202% ############# ( 2, 3 ] 261624 9.825% 94.027% ## ( 3, 4 ] 86874 3.263% 97.289% # ( 4, 6 ] 49827 1.871% 99.161% ( 6, 10 ] 16480 0.619% 99.780% ( 10, 15 ] 1915 0.072% 99.851% ( 15, 22 ] 196 0.007% 99.859% ( 22, 34 ] 29 0.001% 99.860% ( 34, 51 ] 12 0.000% 99.860% ( 51, 76 ] 69 0.003% 99.863% ( 76, 110 ] 1567 0.059% 99.922% ( 110, 170 ] 1705 0.064% 99.986% ( 170, 250 ] 504 0.019% 100.005% ( 250, 380 ] 358 0.013% 100.018% ( 380, 580 ] 262 0.010% 100.028% ( 580, 870 ] 132 0.005% 100.033% ( 870, 1300 ] 50 0.002% 100.035% ( 1300, 1900 ] 19 0.001% 100.036% ( 1900, 2900 ] 14 0.001% 100.036% ( 2900, 4400 ] 15 0.001% 100.037% ( 4400, 6600 ] 2 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 848693 Average: 2.7514 StdDev: 16.48 Min: 0 Median: 1.5740 Max: 3905 Percentiles: P50: 1.57 P75: 1.96 P99: 7.99 P99.9: 127.08 P99.99: 336.01 ------------------------------------------------------ [ 0, 1 ] 107409 12.656% 12.656% ### ( 1, 2 ] 552185 65.063% 77.719% ############# ( 2, 3 ] 112738 13.284% 91.003% ### ( 3, 4 ] 36474 4.298% 95.300% # ( 4, 6 ] 25683 3.026% 98.326% # ( 6, 10 ] 11520 1.357% 99.684% ( 10, 15 ] 992 0.117% 99.801% ( 15, 22 ] 124 0.015% 99.815% ( 22, 34 ] 7 0.001% 99.816% ( 34, 51 ] 8 0.001% 99.817% ( 51, 76 ] 55 0.006% 99.823% ( 76, 110 ] 474 0.056% 99.879% ( 110, 170 ] 616 0.073% 99.952% ( 170, 250 ] 210 0.025% 99.977% ( 250, 380 ] 171 0.020% 99.997% ( 380, 580 ] 146 0.017% 100.014% ( 580, 870 ] 56 0.007% 100.021% ( 870, 1300 ] 23 0.003% 100.023% ( 1300, 1900 ] 14 0.002% 100.025% ( 1900, 2900 ] 5 0.001% 100.026% ( 2900, 4400 ] 3 0.000% 100.026% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.9141 StdDev: 16.89 Min: 1 Median: 1.5834 Max: 1049 Percentiles: P50: 1.58 P75: 1.95 P99: 7.29 P99.9: 235.56 P99.99: 790.30 ------------------------------------------------------ [ 0, 1 ] 3385 10.583% 10.583% ## ( 1, 2 ] 21612 67.569% 78.152% ############## ( 2, 3 ] 3833 11.984% 90.136% ## ( 3, 4 ] 1699 5.312% 95.448% # ( 4, 6 ] 1039 3.248% 98.696% # ( 6, 10 ] 301 0.941% 99.637% ( 10, 15 ] 41 0.128% 99.766% ( 15, 22 ] 3 0.009% 99.775% ( 22, 34 ] 2 0.006% 99.781% ( 34, 51 ] 3 0.009% 99.791% ( 51, 76 ] 1 0.003% 99.794% ( 76, 110 ] 13 0.041% 99.834% ( 110, 170 ] 12 0.038% 99.872% ( 170, 250 ] 11 0.034% 99.906% ( 250, 380 ] 11 0.034% 99.941% ( 380, 580 ] 10 0.031% 99.972% ( 580, 870 ] 8 0.025% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 230220 Average: 3.5415 StdDev: 35.12 Min: 0 Median: 1.6658 Max: 5143 Percentiles: P50: 1.67 P75: 2.23 P99: 8.85 P99.9: 242.65 P99.99: 689.41 ------------------------------------------------------ [ 0, 1 ] 18361 7.975% 7.975% ## ( 1, 2 ] 145303 63.115% 71.090% ############# ( 2, 3 ] 39815 17.294% 88.385% ### ( 3, 4 ] 13342 5.795% 94.180% # ( 4, 6 ] 8387 3.643% 97.823% # ( 6, 10 ] 3802 1.651% 99.474% ( 10, 15 ] 475 0.206% 99.681% ( 15, 22 ] 50 0.022% 99.702% ( 22, 34 ] 2 0.001% 99.703% ( 34, 51 ] 2 0.001% 99.704% ( 51, 76 ] 3 0.001% 99.705% ( 76, 110 ] 82 0.036% 99.741% ( 110, 170 ] 245 0.106% 99.848% ( 170, 250 ] 133 0.058% 99.905% ( 250, 380 ] 116 0.050% 99.956% ( 380, 580 ] 62 0.027% 99.983% ( 580, 870 ] 45 0.020% 100.002% ( 870, 1300 ] 19 0.008% 100.010% ( 1300, 1900 ] 9 0.004% 100.014% ( 1900, 2900 ] 10 0.004% 100.019% ( 2900, 4400 ] 5 0.002% 100.021% ( 4400, 6600 ] 3 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 35 Average: 2068.3429 StdDev: 1378.05 Min: 216 Median: 1690.0000 Max: 5153 Percentiles: P50: 1690.00 P75: 2953.57 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ ( 170, 250 ] 2 5.714% 5.714% # ( 250, 380 ] 2 5.714% 11.429% # ( 580, 870 ] 2 5.714% 17.143% # ( 870, 1300 ] 5 14.286% 31.429% ### ( 1300, 1900 ] 10 28.571% 60.000% ###### ( 1900, 2900 ] 5 14.286% 74.286% ### ( 2900, 4400 ] 7 20.000% 94.286% #### ( 4400, 6600 ] 2 5.714% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 845.5500 StdDev: 1068.04 Min: 84 Median: 230.0000 Max: 4121 Percentiles: P50: 230.00 P75: 1128.00 P99: 4121.00 P99.9: 4121.00 P99.99: 4121.00 ------------------------------------------------------ ( 76, 110 ] 13 21.667% 21.667% #### ( 110, 170 ] 14 23.333% 45.000% ##### ( 170, 250 ] 4 6.667% 51.667% # ( 250, 380 ] 1 1.667% 53.333% ( 380, 580 ] 6 10.000% 63.333% ## ( 580, 870 ] 4 6.667% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 2 3.333% 81.667% # ( 1900, 2900 ] 6 10.000% 91.667% ## ( 2900, 4400 ] 5 8.333% 100.000% ## ** DB Stats ** Uptime(secs): 31.6 total, 6.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 218.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.498 H:M:S, 39.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 158.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.465 H:M:S, 55.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/06-02:50:49 ... thread 0: (1000000,8000000) ops and (60600.6,167191.3) ops/second in (16.501483,47.849378) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/3 1.96 GB 25.2 8.2 0.0 8.2 15.7 7.5 0.0 2.1 153.4 295.0 54.59 50.44 136 0.401 8505K 19K 0.0 0.0 L1 14/14 1.58 GB 0.0 9.3 5.5 3.9 9.2 5.3 0.1 1.7 225.9 223.1 42.25 39.77 5 8.451 9100K 48K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.1 0.1 0.1 0.1 0.1 3.9 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 19/4 1.25 GB 0.9 4.0 2.8 1.3 4.0 2.8 1.1 1.5 175.0 174.8 23.62 18.52 20 1.181 4157K 2252 0.0 0.0 L4 156/2 9.51 GB 1.0 0.3 0.2 0.1 0.3 0.2 3.0 1.3 161.4 161.3 1.90 1.40 2 0.948 310K 283 0.0 0.0 L5 1084/0 89.14 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/24 103.56 GB 0.0 22.0 8.5 13.4 29.4 15.9 11.5 3.9 183.0 244.8 122.90 110.64 164 0.749 22M 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.0 8.5 13.4 29.4 15.9 11.4 3.9 183.0 244.8 122.90 110.64 164 0.749 22M 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.0 8.5 13.4 21.8 8.4 0.0 0.0 223.5 222.1 100.59 91.17 52 1.935 22M 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 347.4 22.30 19.47 112 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.1 total, 47.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.38 GB write, 625.77 MB/s write, 21.96 GB read, 467.67 MB/s read, 122.9 seconds Interval compaction: 29.38 GB write, 628.82 MB/s write, 21.96 GB read, 469.95 MB/s read, 122.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 51, total-stops: 27, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3694894 Average: 2.8065 StdDev: 19.76 Min: 0 Median: 1.4927 Max: 5404 Percentiles: P50: 1.49 P75: 1.88 P99: 7.02 P99.9: 150.26 P99.99: 313.72 ------------------------------------------------------ [ 0, 1 ] 661739 17.910% 17.910% #### ( 1, 2 ] 2406436 65.129% 83.038% ############# ( 2, 3 ] 374666 10.140% 93.178% ## ( 3, 4 ] 127242 3.444% 96.622% # ( 4, 6 ] 80848 2.188% 98.810% ( 6, 10 ] 27565 0.746% 99.556% ( 10, 15 ] 3586 0.097% 99.653% ( 15, 22 ] 376 0.010% 99.663% ( 22, 34 ] 44 0.001% 99.665% ( 34, 51 ] 13 0.000% 99.665% ( 51, 76 ] 111 0.003% 99.668% ( 76, 110 ] 5116 0.138% 99.806% ( 110, 170 ] 5152 0.139% 99.946% ( 170, 250 ] 1208 0.033% 99.979% ( 250, 380 ] 862 0.023% 100.002% ( 380, 580 ] 636 0.017% 100.019% ( 580, 870 ] 291 0.008% 100.027% ( 870, 1300 ] 94 0.003% 100.030% ( 1300, 1900 ] 46 0.001% 100.031% ( 1900, 2900 ] 39 0.001% 100.032% ( 2900, 4400 ] 30 0.001% 100.033% ( 4400, 6600 ] 4 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 1772061 Average: 3.5253 StdDev: 42.21 Min: 0 Median: 1.6331 Max: 7620 Percentiles: P50: 1.63 P75: 2.20 P99: 8.43 P99.9: 88.72 P99.99: 139.72 ------------------------------------------------------ [ 0, 1 ] 214630 12.112% 12.112% ## ( 1, 2 ] 1060536 59.848% 71.959% ############ ( 2, 3 ] 266716 15.051% 87.011% ### ( 3, 4 ] 105637 5.961% 92.972% # ( 4, 6 ] 89727 5.063% 98.035% # ( 6, 10 ] 28128 1.587% 99.623% ( 10, 15 ] 3782 0.213% 99.836% ( 15, 22 ] 422 0.024% 99.860% ( 22, 34 ] 37 0.002% 99.862% ( 34, 51 ] 16 0.001% 99.863% ( 51, 76 ] 164 0.009% 99.872% ( 76, 110 ] 1323 0.075% 99.947% ( 110, 170 ] 1548 0.087% 100.034% ( 170, 250 ] 448 0.025% 100.059% ( 250, 380 ] 421 0.024% 100.083% ( 380, 580 ] 406 0.023% 100.106% ( 580, 870 ] 277 0.016% 100.122% ( 870, 1300 ] 175 0.010% 100.132% ( 1300, 1900 ] 107 0.006% 100.138% ( 1900, 2900 ] 76 0.004% 100.142% ( 2900, 4400 ] 111 0.006% 100.148% ( 4400, 6600 ] 18 0.001% 100.149% ( 6600, 9900 ] 1 0.000% 100.149% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.9141 StdDev: 16.89 Min: 1 Median: 1.5834 Max: 1049 Percentiles: P50: 1.58 P75: 1.95 P99: 7.29 P99.9: 235.56 P99.99: 790.30 ------------------------------------------------------ [ 0, 1 ] 3385 10.583% 10.583% ## ( 1, 2 ] 21612 67.569% 78.152% ############## ( 2, 3 ] 3833 11.984% 90.136% ## ( 3, 4 ] 1699 5.312% 95.448% # ( 4, 6 ] 1039 3.248% 98.696% # ( 6, 10 ] 301 0.941% 99.637% ( 10, 15 ] 41 0.128% 99.766% ( 15, 22 ] 3 0.009% 99.775% ( 22, 34 ] 2 0.006% 99.781% ( 34, 51 ] 3 0.009% 99.791% ( 51, 76 ] 1 0.003% 99.794% ( 76, 110 ] 13 0.041% 99.834% ( 110, 170 ] 12 0.038% 99.872% ( 170, 250 ] 11 0.034% 99.906% ( 250, 380 ] 11 0.034% 99.941% ( 380, 580 ] 10 0.031% 99.972% ( 580, 870 ] 8 0.025% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 411009 Average: 6.4679 StdDev: 77.47 Min: 0 Median: 1.7903 Max: 8015 Percentiles: P50: 1.79 P75: 2.64 P99: 9.32 P99.9: 474.45 P99.99: 719.58 ------------------------------------------------------ [ 0, 1 ] 19761 4.808% 4.808% # ( 1, 2 ] 235016 57.180% 61.988% ########### ( 2, 3 ] 84135 20.470% 82.459% #### ( 3, 4 ] 35190 8.562% 91.020% ## ( 4, 6 ] 27529 6.698% 97.718% # ( 6, 10 ] 6353 1.546% 99.264% ( 10, 15 ] 1163 0.283% 99.547% ( 15, 22 ] 120 0.029% 99.576% ( 22, 34 ] 14 0.003% 99.580% ( 34, 51 ] 3 0.001% 99.580% ( 51, 76 ] 5 0.001% 99.582% ( 76, 110 ] 95 0.023% 99.605% ( 110, 170 ] 299 0.073% 99.677% ( 170, 250 ] 310 0.075% 99.753% ( 250, 380 ] 426 0.104% 99.856% ( 380, 580 ] 379 0.092% 99.949% ( 580, 870 ] 353 0.086% 100.035% ( 870, 1300 ] 207 0.050% 100.085% ( 1300, 1900 ] 106 0.026% 100.111% ( 1900, 2900 ] 96 0.023% 100.134% ( 2900, 4400 ] 61 0.015% 100.149% ( 4400, 6600 ] 13 0.003% 100.152% ( 6600, 9900 ] 1 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 65 Average: 1237.6154 StdDev: 1444.78 Min: 1 Median: 725.0000 Max: 5153 Percentiles: P50: 725.00 P75: 1831.82 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ [ 0, 1 ] 6 9.231% 9.231% ## ( 1, 2 ] 11 16.923% 26.154% ### ( 4, 6 ] 2 3.077% 29.231% # ( 22, 34 ] 1 1.538% 30.769% ( 110, 170 ] 1 1.538% 32.308% ( 170, 250 ] 7 10.769% 43.077% ## ( 250, 380 ] 3 4.615% 47.692% # ( 580, 870 ] 3 4.615% 52.308% # ( 870, 1300 ] 5 7.692% 60.000% ## ( 1300, 1900 ] 11 16.923% 76.923% ### ( 1900, 2900 ] 5 7.692% 84.615% ## ( 2900, 4400 ] 8 12.308% 96.923% ## ( 4400, 6600 ] 2 3.077% 100.000% # ** Level 5 read latency histogram (micros): Count: 200 Average: 1093.1350 StdDev: 1304.05 Min: 84 Median: 513.3333 Max: 7094 Percentiles: P50: 513.33 P75: 1550.00 P99: 5500.00 P99.9: 7094.00 P99.99: 7094.00 ------------------------------------------------------ ( 76, 110 ] 18 9.000% 9.000% ## ( 110, 170 ] 29 14.500% 23.500% ### ( 170, 250 ] 15 7.500% 31.000% ## ( 250, 380 ] 24 12.000% 43.000% ## ( 380, 580 ] 21 10.500% 53.500% ## ( 580, 870 ] 22 11.000% 64.500% ## ( 870, 1300 ] 16 8.000% 72.500% ## ( 1300, 1900 ] 12 6.000% 78.500% # ( 1900, 2900 ] 22 11.000% 89.500% ## ( 2900, 4400 ] 18 9.000% 98.500% ## ( 4400, 6600 ] 2 1.000% 99.500% ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 48.1 total, 16.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 163.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.647 H:M:S, 53.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 59.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.148 H:M:S, 79.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/06-02:50:52 ... thread 0: (1000000,9000000) ops and (329805.6,176881.7) ops/second in (3.032089,50.881467) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/7 2.88 GB 88.1 8.7 0.0 8.7 17.2 8.5 0.0 2.0 150.5 296.4 59.43 54.95 151 0.394 9080K 20K 0.0 0.0 L1 14/14 1.58 GB 0.0 9.3 5.5 3.9 9.2 5.3 0.1 1.7 225.9 223.1 42.25 39.77 5 8.451 9100K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.9 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 16/0 943.54 MB 0.9 4.2 2.9 1.3 4.2 2.9 1.1 1.4 175.4 175.2 24.46 19.22 21 1.165 4317K 2308 0.0 0.0 L4 158/0 9.66 GB 1.0 0.7 0.6 0.1 0.7 0.6 3.1 1.1 176.3 176.2 4.02 3.20 6 0.670 720K 608 0.0 0.0 L5 1088/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/21 104.48 GB 0.0 23.1 9.0 14.0 31.4 17.4 11.9 3.7 180.7 246.1 130.71 117.65 184 0.710 23M 71K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.1 9.0 14.0 31.4 17.4 11.8 3.7 180.7 246.1 130.71 117.65 184 0.710 23M 71K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.1 9.0 14.0 22.9 8.9 0.0 0.0 223.4 222.0 105.71 95.79 59 1.792 23M 71K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 347.8 24.99 21.86 125 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.1 total, 50.9 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.41 GB write, 629.17 MB/s write, 23.06 GB read, 461.98 MB/s read, 130.7 seconds Interval compaction: 31.41 GB write, 632.06 MB/s write, 23.06 GB read, 464.10 MB/s read, 130.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 51, total-stops: 30, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4059631 Average: 2.7674 StdDev: 19.05 Min: 0 Median: 1.5010 Max: 5404 Percentiles: P50: 1.50 P75: 1.88 P99: 6.94 P99.9: 145.24 P99.99: 291.85 ------------------------------------------------------ [ 0, 1 ] 703617 17.332% 17.332% ### ( 1, 2 ] 2647140 65.206% 82.538% ############# ( 2, 3 ] 430239 10.598% 93.136% ## ( 3, 4 ] 140198 3.453% 96.590% # ( 4, 6 ] 90511 2.230% 98.819% ( 6, 10 ] 31131 0.767% 99.586% ( 10, 15 ] 3944 0.097% 99.683% ( 15, 22 ] 413 0.010% 99.694% ( 22, 34 ] 49 0.001% 99.695% ( 34, 51 ] 16 0.000% 99.695% ( 51, 76 ] 112 0.003% 99.698% ( 76, 110 ] 5154 0.127% 99.825% ( 110, 170 ] 5189 0.128% 99.953% ( 170, 250 ] 1230 0.030% 99.983% ( 250, 380 ] 876 0.022% 100.005% ( 380, 580 ] 646 0.016% 100.021% ( 580, 870 ] 301 0.007% 100.028% ( 870, 1300 ] 98 0.002% 100.030% ( 1300, 1900 ] 49 0.001% 100.032% ( 1900, 2900 ] 39 0.001% 100.033% ( 2900, 4400 ] 31 0.001% 100.033% ( 4400, 6600 ] 4 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 1778821 Average: 3.5229 StdDev: 42.13 Min: 0 Median: 1.6339 Max: 7620 Percentiles: P50: 1.63 P75: 2.21 P99: 8.43 P99.9: 88.57 P99.99: 139.73 ------------------------------------------------------ [ 0, 1 ] 214700 12.070% 12.070% ## ( 1, 2 ] 1064350 59.835% 71.904% ############ ( 2, 3 ] 268192 15.077% 86.981% ### ( 3, 4 ] 106285 5.975% 92.956% # ( 4, 6 ] 90298 5.076% 98.033% # ( 6, 10 ] 28294 1.591% 99.623% ( 10, 15 ] 3794 0.213% 99.837% ( 15, 22 ] 423 0.024% 99.860% ( 22, 34 ] 37 0.002% 99.862% ( 34, 51 ] 16 0.001% 99.863% ( 51, 76 ] 164 0.009% 99.872% ( 76, 110 ] 1323 0.074% 99.947% ( 110, 170 ] 1548 0.087% 100.034% ( 170, 250 ] 448 0.025% 100.059% ( 250, 380 ] 422 0.024% 100.083% ( 380, 580 ] 406 0.023% 100.106% ( 580, 870 ] 277 0.016% 100.121% ( 870, 1300 ] 175 0.010% 100.131% ( 1300, 1900 ] 107 0.006% 100.137% ( 1900, 2900 ] 76 0.004% 100.141% ( 2900, 4400 ] 111 0.006% 100.148% ( 4400, 6600 ] 18 0.001% 100.149% ( 6600, 9900 ] 1 0.000% 100.149% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.9141 StdDev: 16.89 Min: 1 Median: 1.5834 Max: 1049 Percentiles: P50: 1.58 P75: 1.95 P99: 7.29 P99.9: 235.56 P99.99: 790.30 ------------------------------------------------------ [ 0, 1 ] 3385 10.583% 10.583% ## ( 1, 2 ] 21612 67.569% 78.152% ############## ( 2, 3 ] 3833 11.984% 90.136% ## ( 3, 4 ] 1699 5.312% 95.448% # ( 4, 6 ] 1039 3.248% 98.696% # ( 6, 10 ] 301 0.941% 99.637% ( 10, 15 ] 41 0.128% 99.766% ( 15, 22 ] 3 0.009% 99.775% ( 22, 34 ] 2 0.006% 99.781% ( 34, 51 ] 3 0.009% 99.791% ( 51, 76 ] 1 0.003% 99.794% ( 76, 110 ] 13 0.041% 99.834% ( 110, 170 ] 12 0.038% 99.872% ( 170, 250 ] 11 0.034% 99.906% ( 250, 380 ] 11 0.034% 99.941% ( 380, 580 ] 10 0.031% 99.972% ( 580, 870 ] 8 0.025% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 456466 Average: 6.1247 StdDev: 73.64 Min: 0 Median: 1.7879 Max: 8015 Percentiles: P50: 1.79 P75: 2.62 P99: 9.16 P99.9: 445.23 P99.99: 699.03 ------------------------------------------------------ [ 0, 1 ] 20704 4.536% 4.536% # ( 1, 2 ] 263407 57.706% 62.241% ############ ( 2, 3 ] 93821 20.554% 82.795% #### ( 3, 4 ] 38295 8.389% 91.185% ## ( 4, 6 ] 30385 6.657% 97.841% # ( 6, 10 ] 6704 1.469% 99.310% ( 10, 15 ] 1232 0.270% 99.580% ( 15, 22 ] 130 0.028% 99.608% ( 22, 34 ] 16 0.004% 99.612% ( 34, 51 ] 3 0.001% 99.612% ( 51, 76 ] 5 0.001% 99.614% ( 76, 110 ] 104 0.023% 99.636% ( 110, 170 ] 319 0.070% 99.706% ( 170, 250 ] 320 0.070% 99.776% ( 250, 380 ] 437 0.096% 99.872% ( 380, 580 ] 391 0.086% 99.958% ( 580, 870 ] 359 0.079% 100.036% ( 870, 1300 ] 207 0.045% 100.082% ( 1300, 1900 ] 106 0.023% 100.105% ( 1900, 2900 ] 96 0.021% 100.126% ( 2900, 4400 ] 61 0.013% 100.139% ( 4400, 6600 ] 13 0.003% 100.142% ( 6600, 9900 ] 1 0.000% 100.142% ** Level 4 read latency histogram (micros): Count: 105 Average: 809.4952 StdDev: 1267.43 Min: 1 Median: 185.3846 Max: 5153 Percentiles: P50: 185.38 P75: 1282.08 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ [ 0, 1 ] 14 13.333% 13.333% ### ( 1, 2 ] 25 23.810% 37.143% ##### ( 2, 3 ] 2 1.905% 39.048% ( 4, 6 ] 2 1.905% 40.952% ( 6, 10 ] 1 0.952% 41.905% ( 22, 34 ] 1 0.952% 42.857% ( 51, 76 ] 1 0.952% 43.810% ( 76, 110 ] 1 0.952% 44.762% ( 110, 170 ] 3 2.857% 47.619% # ( 170, 250 ] 13 12.381% 60.000% ## ( 250, 380 ] 5 4.762% 64.762% # ( 380, 580 ] 1 0.952% 65.714% ( 580, 870 ] 4 3.810% 69.524% # ( 870, 1300 ] 6 5.714% 75.238% # ( 1300, 1900 ] 11 10.476% 85.714% ## ( 1900, 2900 ] 5 4.762% 90.476% # ( 2900, 4400 ] 8 7.619% 98.095% ## ( 4400, 6600 ] 2 1.905% 100.000% ** Level 5 read latency histogram (micros): Count: 220 Average: 1060.6682 StdDev: 1275.01 Min: 84 Median: 489.0909 Max: 7094 Percentiles: P50: 489.09 P75: 1471.43 P99: 5280.00 P99.9: 7094.00 P99.99: 7094.00 ------------------------------------------------------ ( 76, 110 ] 19 8.636% 8.636% ## ( 110, 170 ] 33 15.000% 23.636% ### ( 170, 250 ] 18 8.182% 31.818% ## ( 250, 380 ] 28 12.727% 44.545% ### ( 380, 580 ] 22 10.000% 54.545% ## ( 580, 870 ] 23 10.455% 65.000% ## ( 870, 1300 ] 18 8.182% 73.182% ## ( 1300, 1900 ] 14 6.364% 79.545% # ( 1900, 2900 ] 23 10.455% 90.000% ## ( 2900, 4400 ] 19 8.636% 98.636% ## ( 4400, 6600 ] 2 0.909% 99.545% ( 6600, 9900 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 51.1 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 173.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.033 H:M:S, 50.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.387 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/06-02:50:55 ... thread 0: (1000000,10000000) ops and (304259.0,184610.4) ops/second in (3.286674,54.168141) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 3.93 GB 195.1 9.9 0.0 9.9 19.4 9.5 0.0 2.0 151.3 296.7 67.01 62.12 169 0.397 10M 21K 0.0 0.0 L1 14/14 1.58 GB 0.0 9.3 5.5 3.9 9.2 5.3 0.1 1.7 225.9 223.1 42.25 39.77 5 8.451 9100K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.9 2.0 234.6 234.6 0.54 0.51 1 0.537 127K 36 0.0 0.0 L3 16/0 943.54 MB 0.9 4.2 2.9 1.3 4.2 2.9 1.1 1.4 175.4 175.2 24.46 19.22 21 1.165 4317K 2308 0.0 0.0 L4 158/0 9.66 GB 1.0 0.7 0.6 0.1 0.7 0.6 3.1 1.1 176.3 176.2 4.02 3.20 6 0.670 720K 608 0.0 0.0 L5 1088/0 89.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/21 105.53 GB 0.0 24.2 9.0 15.2 33.6 18.4 11.9 3.5 179.4 249.0 138.29 124.82 202 0.685 24M 73K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.2 9.0 15.2 33.6 18.4 11.8 3.5 179.4 249.0 138.29 124.82 202 0.685 24M 73K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.2 9.0 15.2 24.1 8.9 0.0 0.0 225.1 223.8 110.21 100.21 63 1.749 24M 73K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 347.8 28.08 24.62 139 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.4 total, 54.2 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.62 GB write, 632.82 MB/s write, 24.23 GB read, 456.07 MB/s read, 138.3 seconds Interval compaction: 33.62 GB write, 635.55 MB/s write, 24.23 GB read, 458.04 MB/s read, 138.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 51, total-stops: 35, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4393447 Average: 2.7374 StdDev: 18.74 Min: 0 Median: 1.5050 Max: 5404 Percentiles: P50: 1.50 P75: 1.89 P99: 6.76 P99.9: 141.14 P99.99: 276.50 ------------------------------------------------------ [ 0, 1 ] 745792 16.975% 16.975% ### ( 1, 2 ] 2873319 65.400% 82.375% ############# ( 2, 3 ] 473293 10.773% 93.148% ## ( 3, 4 ] 152782 3.477% 96.625% # ( 4, 6 ] 98066 2.232% 98.858% ( 6, 10 ] 33031 0.752% 99.609% ( 10, 15 ] 4281 0.097% 99.707% ( 15, 22 ] 429 0.010% 99.717% ( 22, 34 ] 51 0.001% 99.718% ( 34, 51 ] 18 0.000% 99.718% ( 51, 76 ] 114 0.003% 99.721% ( 76, 110 ] 5167 0.118% 99.838% ( 110, 170 ] 5226 0.119% 99.957% ( 170, 250 ] 1257 0.029% 99.986% ( 250, 380 ] 901 0.021% 100.006% ( 380, 580 ] 662 0.015% 100.021% ( 580, 870 ] 316 0.007% 100.029% ( 870, 1300 ] 104 0.002% 100.031% ( 1300, 1900 ] 51 0.001% 100.032% ( 1900, 2900 ] 43 0.001% 100.033% ( 2900, 4400 ] 31 0.001% 100.034% ( 4400, 6600 ] 5 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 1905928 Average: 3.4649 StdDev: 40.79 Min: 0 Median: 1.6301 Max: 7620 Percentiles: P50: 1.63 P75: 2.18 P99: 8.42 P99.9: 90.68 P99.99: 143.58 ------------------------------------------------------ [ 0, 1 ] 227063 11.914% 11.914% ## ( 1, 2 ] 1152039 60.445% 72.359% ############ ( 2, 3 ] 285235 14.966% 87.324% ### ( 3, 4 ] 110724 5.809% 93.134% # ( 4, 6 ] 93481 4.905% 98.038% # ( 6, 10 ] 30334 1.592% 99.630% ( 10, 15 ] 3873 0.203% 99.833% ( 15, 22 ] 430 0.023% 99.856% ( 22, 34 ] 37 0.002% 99.858% ( 34, 51 ] 16 0.001% 99.859% ( 51, 76 ] 178 0.009% 99.868% ( 76, 110 ] 1420 0.075% 99.942% ( 110, 170 ] 1623 0.085% 100.028% ( 170, 250 ] 484 0.025% 100.053% ( 250, 380 ] 440 0.023% 100.076% ( 380, 580 ] 423 0.022% 100.098% ( 580, 870 ] 283 0.015% 100.113% ( 870, 1300 ] 177 0.009% 100.122% ( 1300, 1900 ] 107 0.006% 100.128% ( 1900, 2900 ] 76 0.004% 100.132% ( 2900, 4400 ] 111 0.006% 100.138% ( 4400, 6600 ] 18 0.001% 100.139% ( 6600, 9900 ] 1 0.000% 100.139% ** Level 2 read latency histogram (micros): Count: 31985 Average: 2.9141 StdDev: 16.89 Min: 1 Median: 1.5834 Max: 1049 Percentiles: P50: 1.58 P75: 1.95 P99: 7.29 P99.9: 235.56 P99.99: 790.30 ------------------------------------------------------ [ 0, 1 ] 3385 10.583% 10.583% ## ( 1, 2 ] 21612 67.569% 78.152% ############## ( 2, 3 ] 3833 11.984% 90.136% ## ( 3, 4 ] 1699 5.312% 95.448% # ( 4, 6 ] 1039 3.248% 98.696% # ( 6, 10 ] 301 0.941% 99.637% ( 10, 15 ] 41 0.128% 99.766% ( 15, 22 ] 3 0.009% 99.775% ( 22, 34 ] 2 0.006% 99.781% ( 34, 51 ] 3 0.009% 99.791% ( 51, 76 ] 1 0.003% 99.794% ( 76, 110 ] 13 0.041% 99.834% ( 110, 170 ] 12 0.038% 99.872% ( 170, 250 ] 11 0.034% 99.906% ( 250, 380 ] 11 0.034% 99.941% ( 380, 580 ] 10 0.031% 99.972% ( 580, 870 ] 8 0.025% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 456466 Average: 6.1247 StdDev: 73.64 Min: 0 Median: 1.7879 Max: 8015 Percentiles: P50: 1.79 P75: 2.62 P99: 9.16 P99.9: 445.23 P99.99: 699.03 ------------------------------------------------------ [ 0, 1 ] 20704 4.536% 4.536% # ( 1, 2 ] 263407 57.706% 62.241% ############ ( 2, 3 ] 93821 20.554% 82.795% #### ( 3, 4 ] 38295 8.389% 91.185% ## ( 4, 6 ] 30385 6.657% 97.841% # ( 6, 10 ] 6704 1.469% 99.310% ( 10, 15 ] 1232 0.270% 99.580% ( 15, 22 ] 130 0.028% 99.608% ( 22, 34 ] 16 0.004% 99.612% ( 34, 51 ] 3 0.001% 99.612% ( 51, 76 ] 5 0.001% 99.614% ( 76, 110 ] 104 0.023% 99.636% ( 110, 170 ] 319 0.070% 99.706% ( 170, 250 ] 320 0.070% 99.776% ( 250, 380 ] 437 0.096% 99.872% ( 380, 580 ] 391 0.086% 99.958% ( 580, 870 ] 359 0.079% 100.036% ( 870, 1300 ] 207 0.045% 100.082% ( 1300, 1900 ] 106 0.023% 100.105% ( 1900, 2900 ] 96 0.021% 100.126% ( 2900, 4400 ] 61 0.013% 100.139% ( 4400, 6600 ] 13 0.003% 100.142% ( 6600, 9900 ] 1 0.000% 100.142% ** Level 4 read latency histogram (micros): Count: 105 Average: 809.4952 StdDev: 1267.43 Min: 1 Median: 185.3846 Max: 5153 Percentiles: P50: 185.38 P75: 1282.08 P99: 5153.00 P99.9: 5153.00 P99.99: 5153.00 ------------------------------------------------------ [ 0, 1 ] 14 13.333% 13.333% ### ( 1, 2 ] 25 23.810% 37.143% ##### ( 2, 3 ] 2 1.905% 39.048% ( 4, 6 ] 2 1.905% 40.952% ( 6, 10 ] 1 0.952% 41.905% ( 22, 34 ] 1 0.952% 42.857% ( 51, 76 ] 1 0.952% 43.810% ( 76, 110 ] 1 0.952% 44.762% ( 110, 170 ] 3 2.857% 47.619% # ( 170, 250 ] 13 12.381% 60.000% ## ( 250, 380 ] 5 4.762% 64.762% # ( 380, 580 ] 1 0.952% 65.714% ( 580, 870 ] 4 3.810% 69.524% # ( 870, 1300 ] 6 5.714% 75.238% # ( 1300, 1900 ] 11 10.476% 85.714% ## ( 1900, 2900 ] 5 4.762% 90.476% # ( 2900, 4400 ] 8 7.619% 98.095% ## ( 4400, 6600 ] 2 1.905% 100.000% ** Level 5 read latency histogram (micros): Count: 220 Average: 1060.6682 StdDev: 1275.01 Min: 84 Median: 489.0909 Max: 7094 Percentiles: P50: 489.09 P75: 1471.43 P99: 5280.00 P99.9: 7094.00 P99.99: 7094.00 ------------------------------------------------------ ( 76, 110 ] 19 8.636% 8.636% ## ( 110, 170 ] 33 15.000% 23.636% ### ( 170, 250 ] 18 8.182% 31.818% ## ( 250, 380 ] 28 12.727% 44.545% ### ( 380, 580 ] 22 10.000% 54.545% ## ( 580, 870 ] 23 10.455% 65.000% ## ( 870, 1300 ] 18 8.182% 73.182% ## ( 1300, 1900 ] 14 6.364% 79.545% # ( 1900, 2900 ] 23 10.455% 90.000% ## ( 2900, 4400 ] 19 8.636% 98.636% ## ( 4400, 6600 ] 2 0.909% 99.545% ( 6600, 9900 ] 1 0.455% 100.000% ** DB Stats ** Uptime(secs): 54.4 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 180.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.675 H:M:S, 49.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.641 H:M:S, 19.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.813 micros/op 172021 ops/sec 60.120 seconds 10341999 operations; 166.7 MB/s Microseconds per write: Count: 10341999 Average: 5.8132 StdDev: 292.34 Min: 0 Median: 1.7403 Max: 482291 Percentiles: P50: 1.74 P75: 2.77 P99: 9.64 P99.9: 1145.18 P99.99: 2586.87 ------------------------------------------------------ [ 0, 1 ] 1358930 13.140% 13.140% ### ( 1, 2 ] 5149681 49.794% 62.934% ########## ( 2, 3 ] 1629515 15.756% 78.690% ### ( 3, 4 ] 1421329 13.743% 92.433% ### ( 4, 6 ] 560009 5.415% 97.848% # ( 6, 10 ] 130873 1.265% 99.114% ( 10, 15 ] 46044 0.445% 99.559% ( 15, 22 ] 9791 0.095% 99.654% ( 22, 34 ] 2002 0.019% 99.673% ( 34, 51 ] 239 0.002% 99.675% ( 51, 76 ] 27 0.000% 99.676% ( 76, 110 ] 7016 0.068% 99.743% ( 110, 170 ] 2950 0.029% 99.772% ( 170, 250 ] 303 0.003% 99.775% ( 250, 380 ] 210 0.002% 99.777% ( 380, 580 ] 20 0.000% 99.777% ( 580, 870 ] 29 0.000% 99.777% ( 870, 1300 ] 19828 0.192% 99.969% ( 1300, 1900 ] 56 0.001% 99.970% ( 1900, 2900 ] 3076 0.030% 99.999% ( 2900, 4400 ] 35 0.000% 100.000% ( 4400, 6600 ] 7 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 183066 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10341999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10672942968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 471 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31507222 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30101713437 rocksdb.compact.write.bytes COUNT : 29929357632 rocksdb.flush.write.bytes COUNT : 10635199129 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 55 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 202 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10549450752 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4107264 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30196800278 rocksdb.non.last.level.read.count COUNT : 7295761 rocksdb.block.checksum.compute.count COUNT : 7294875 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.390289 P95 : 3.935243 P99 : 8.269506 P100 : 482289.000000 COUNT : 10341999 SUM : 55244800 rocksdb.compaction.times.micros P50 : 1022093.023256 P95 : 5125000.000000 P99 : 19400000.000000 P100 : 20281357.000000 COUNT : 65 SUM : 112336603 rocksdb.compaction.times.cpu_micros P50 : 968611.111111 P95 : 5125000.000000 P99 : 16800000.000000 P100 : 18746938.000000 COUNT : 65 SUM : 102300298 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 677.831325 P95 : 1133.375000 P99 : 1288.175000 P100 : 20162.000000 COUNT : 144 SUM : 114967 rocksdb.compaction.outfile.sync.micros P50 : 854.920000 P95 : 38194.444444 P99 : 108250.000000 P100 : 139008.000000 COUNT : 305 SUM : 1547854 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 91.771084 P95 : 342.625000 P99 : 1194.650000 P100 : 3344.000000 COUNT : 249 SUM : 38546 rocksdb.table.open.io.micros P50 : 1374.193548 P95 : 6748.500000 P99 : 12620.642857 P100 : 13633.000000 COUNT : 471 SUM : 955196 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.584524 P95 : 6.714013 P99 : 9.911387 P100 : 9258.000000 COUNT : 7293651 SUM : 37646524 rocksdb.read.block.get.micros P50 : 434.545455 P95 : 3397.058824 P99 : 5116.000000 P100 : 7246.000000 COUNT : 942 SUM : 776175 rocksdb.write.raw.block.micros P50 : 0.511232 P95 : 0.971341 P99 : 2.788666 P100 : 10856.000000 COUNT : 9824325 SUM : 17702743 rocksdb.numfiles.in.singlecompaction P50 : 3.264706 P95 : 5.933333 P99 : 21.160000 P100 : 26.000000 COUNT : 124 SUM : 477 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560724 P95 : 1137.029696 P99 : 2223.992185 P100 : 480351.000000 COUNT : 213802 SUM : 31530339 rocksdb.sst.read.micros P50 : 1.544304 P95 : 3.924857 P99 : 7.845271 P100 : 8015.000000 COUNT : 7296129 SUM : 22989863 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10341999 SUM : 10672942968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 207979.797980 P95 : 337578.947368 P99 : 376989.473684 P100 : 612050.000000 COUNT : 144 SUM : 29172010 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 302 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0