[2024-11-21 04:20:47.710764] Starting SPDK v25.01-pre git sha1 557f022f6 / DPDK 24.11.0-rc3 initialization... [2024-11-21 04:20:47.710908] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2188866 ] Set seed to 1732159247707230 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-21 04:20:47.878097] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc3 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-21 04:20:47.928690] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-21 04:20:47.952196] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-21 04:20:47.952236] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2188866' to capture a snapshot of events at runtime. [2024-11-21 04:20:47.952248] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-21 04:20:47.952257] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-21 04:20:47.952267] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2188866 for offline analysis/debug. [2024-11-21 04:20:47.952831] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 21 04:20:52 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/21-04:20:54 ... thread 0: (1000000,1000000) ops and (364482.8,364482.8) ops/second in (2.743614,2.743614) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 356.2 2.30 2.09 12 0.192 0 0 0.0 0.0 L2 3/2 251.76 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 12/0 993.32 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 99.7 315.6 3.79 3.54 14 0.271 383K 191 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 99.7 315.6 3.79 3.54 14 0.271 383K 191 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 356.2 2.30 2.09 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 409.39 MB/s write, 0.37 GB read, 129.29 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 436.00 MB/s write, 0.37 GB read, 137.69 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 100702 Average: 1.7996 StdDev: 10.46 Min: 0 Median: 1.1927 Max: 2535 Percentiles: P50: 1.19 P75: 1.64 P99: 3.82 P99.9: 9.73 P99.99: 291.81 ------------------------------------------------------ [ 0, 1 ] 39518 39.243% 39.243% ######## ( 1, 2 ] 56218 55.826% 95.069% ########### ( 2, 3 ] 2972 2.951% 98.020% # ( 3, 4 ] 1207 1.199% 99.218% ( 4, 6 ] 511 0.507% 99.726% ( 6, 10 ] 189 0.188% 99.914% ( 10, 15 ] 50 0.050% 99.963% ( 15, 22 ] 12 0.012% 99.975% ( 22, 34 ] 1 0.001% 99.976% ( 34, 51 ] 1 0.001% 99.977% ( 110, 170 ] 8 0.008% 99.985% ( 170, 250 ] 4 0.004% 99.989% ( 250, 380 ] 6 0.006% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 867.2000 StdDev: 854.42 Min: 80 Median: 230.0000 Max: 1924 Percentiles: P50: 230.00 P75: 1750.00 P99: 1924.00 P99.9: 1924.00 P99.99: 1924.00 ------------------------------------------------------ ( 76, 110 ] 1 20.000% 20.000% #### ( 170, 250 ] 2 40.000% 60.000% ######## ( 1300, 1900 ] 1 20.000% 80.000% #### ( 1900, 2900 ] 1 20.000% 100.000% #### ** Level 2 read latency histogram (micros): Count: 50547 Average: 1.8720 StdDev: 9.87 Min: 1 Median: 1.2507 Max: 1454 Percentiles: P50: 1.25 P75: 1.68 P99: 4.98 P99.9: 10.06 P99.99: 290.96 ------------------------------------------------------ [ 0, 1 ] 17967 35.545% 35.545% ####### ( 1, 2 ] 29149 57.667% 93.212% ############ ( 2, 3 ] 1855 3.670% 96.882% # ( 3, 4 ] 847 1.676% 98.558% ( 4, 6 ] 458 0.906% 99.464% ( 6, 10 ] 221 0.437% 99.901% ( 10, 15 ] 39 0.077% 99.978% ( 15, 22 ] 4 0.008% 99.986% ( 22, 34 ] 2 0.004% 99.990% ( 250, 380 ] 3 0.006% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ( 1300, 1900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 55 Average: 1594.8000 StdDev: 1201.37 Min: 157 Median: 1067.0833 Max: 4603 Percentiles: P50: 1067.08 P75: 2525.00 P99: 4603.00 P99.9: 4603.00 P99.99: 4603.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 1 1.818% 3.636% ( 250, 380 ] 2 3.636% 7.273% # ( 380, 580 ] 7 12.727% 20.000% ### ( 580, 870 ] 11 20.000% 40.000% #### ( 870, 1300 ] 12 21.818% 61.818% #### ( 1300, 1900 ] 1 1.818% 63.636% ( 1900, 2900 ] 10 18.182% 81.818% #### ( 2900, 4400 ] 8 14.545% 96.364% ### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1632.4500 StdDev: 1132.66 Min: 314 Median: 1214.0000 Max: 4142 Percentiles: P50: 1214.00 P75: 2233.33 P99: 4142.00 P99.9: 4142.00 P99.99: 4142.00 ------------------------------------------------------ ( 250, 380 ] 1 5.000% 5.000% # ( 380, 580 ] 1 5.000% 10.000% # ( 580, 870 ] 4 20.000% 30.000% #### ( 870, 1300 ] 5 25.000% 55.000% ##### ( 1300, 1900 ] 3 15.000% 70.000% ### ( 1900, 2900 ] 3 15.000% 85.000% ### ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 2.9 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 336.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.204 H:M:S, 7.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.204 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-04:20:57 ... thread 0: (1000000,2000000) ops and (326377.6,344379.3) ops/second in (3.063936,5.807550) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 76.8 324.0 7.39 6.79 28 0.264 575K 598 0.0 0.0 L1 1/0 3.78 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 238.3 237.9 1.59 1.53 1 1.586 383K 610 0.0 0.0 L2 2/1 54.35 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 18/8 1.00 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 231.3 231.3 1.08 1.01 1 1.078 253K 0 0.0 0.0 L4 173/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 151.7 151.7 1.48 1.11 1 1.479 227K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/17 97.92 GB 0.0 1.8 1.0 0.7 3.5 2.8 1.9 2.0 138.0 278.2 13.02 11.88 33 0.395 1824K 1399 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.0 0.7 3.5 2.8 1.8 2.0 138.0 278.2 13.02 11.88 33 0.395 1824K 1399 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.0 0.7 1.8 1.0 0.0 0.0 228.4 228.3 7.86 7.28 7 1.123 1824K 1399 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.3 5.16 4.60 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.54 GB write, 604.96 MB/s write, 1.75 GB read, 300.06 MB/s read, 13.0 seconds Interval compaction: 3.54 GB write, 623.54 MB/s write, 1.75 GB read, 309.28 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389255 Average: 2.2218 StdDev: 12.03 Min: 0 Median: 1.4904 Max: 4028 Percentiles: P50: 1.49 P75: 1.88 P99: 5.82 P99.9: 11.58 P99.99: 15.01 ------------------------------------------------------ [ 0, 1 ] 73354 18.845% 18.845% #### ( 1, 2 ] 247272 63.524% 82.369% ############# ( 2, 3 ] 39961 10.266% 92.635% ## ( 3, 4 ] 14996 3.852% 96.488% # ( 4, 6 ] 10776 2.768% 99.256% # ( 6, 10 ] 2346 0.603% 99.859% ( 10, 15 ] 512 0.132% 99.990% ( 15, 22 ] 61 0.016% 100.006% ( 22, 34 ] 5 0.001% 100.007% ( 34, 51 ] 2 0.001% 100.008% ( 51, 76 ] 6 0.002% 100.009% ( 110, 170 ] 12 0.003% 100.012% ( 170, 250 ] 10 0.003% 100.015% ( 250, 380 ] 12 0.003% 100.018% ( 380, 580 ] 5 0.001% 100.019% ( 580, 870 ] 4 0.001% 100.020% ( 870, 1300 ] 7 0.002% 100.022% ( 1300, 1900 ] 1 0.000% 100.022% ( 1900, 2900 ] 3 0.001% 100.023% ( 2900, 4400 ] 2 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 30 Average: 311.0333 StdDev: 583.07 Min: 1 Median: 1.8571 Max: 1924 Percentiles: P50: 1.86 P75: 271.67 P99: 1924.00 P99.9: 1924.00 P99.99: 1924.00 ------------------------------------------------------ [ 0, 1 ] 9 30.000% 30.000% ###### ( 1, 2 ] 7 23.333% 53.333% ##### ( 4, 6 ] 1 3.333% 56.667% # ( 76, 110 ] 1 3.333% 60.000% # ( 110, 170 ] 1 3.333% 63.333% # ( 170, 250 ] 3 10.000% 73.333% ## ( 250, 380 ] 3 10.000% 83.333% ## ( 380, 580 ] 1 3.333% 86.667% # ( 1300, 1900 ] 3 10.000% 96.667% ## ( 1900, 2900 ] 1 3.333% 100.000% # ** Level 2 read latency histogram (micros): Count: 95776 Average: 2.0223 StdDev: 7.20 Min: 1 Median: 1.3996 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.69 ------------------------------------------------------ [ 0, 1 ] 23914 24.969% 24.969% ##### ( 1, 2 ] 60001 62.647% 87.616% ############# ( 2, 3 ] 6939 7.245% 94.861% # ( 3, 4 ] 2746 2.867% 97.728% # ( 4, 6 ] 1615 1.686% 99.414% ( 6, 10 ] 449 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 168942 Average: 3.6076 StdDev: 40.42 Min: 1 Median: 1.7061 Max: 4603 Percentiles: P50: 1.71 P75: 2.35 P99: 8.80 P99.9: 179.48 P99.99: 612.17 ------------------------------------------------------ [ 0, 1 ] 10957 6.486% 6.486% # ( 1, 2 ] 104112 61.626% 68.112% ############ ( 2, 3 ] 33513 19.837% 87.949% #### ( 3, 4 ] 8799 5.208% 93.157% # ( 4, 6 ] 7956 4.709% 97.866% # ( 6, 10 ] 2738 1.621% 99.487% ( 10, 15 ] 377 0.223% 99.710% ( 15, 22 ] 75 0.044% 99.754% ( 22, 34 ] 19 0.011% 99.766% ( 34, 51 ] 6 0.004% 99.769% ( 51, 76 ] 2 0.001% 99.770% ( 76, 110 ] 67 0.040% 99.810% ( 110, 170 ] 144 0.085% 99.895% ( 170, 250 ] 68 0.040% 99.935% ( 250, 380 ] 44 0.026% 99.962% ( 380, 580 ] 45 0.027% 99.988% ( 580, 870 ] 28 0.017% 100.005% ( 870, 1300 ] 17 0.010% 100.015% ( 1300, 1900 ] 2 0.001% 100.016% ( 1900, 2900 ] 13 0.008% 100.024% ( 2900, 4400 ] 8 0.005% 100.028% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 305 Average: 115.2557 StdDev: 497.27 Min: 0 Median: 1.7277 Max: 4142 Percentiles: P50: 1.73 P75: 5.50 P99: 2883.33 P99.9: 4142.00 P99.99: 4142.00 ------------------------------------------------------ [ 0, 1 ] 79 25.902% 25.902% ##### ( 1, 2 ] 101 33.115% 59.016% ####### ( 2, 3 ] 32 10.492% 69.508% ## ( 3, 4 ] 7 2.295% 71.803% ( 4, 6 ] 13 4.262% 76.066% # ( 6, 10 ] 13 4.262% 80.328% # ( 10, 15 ] 20 6.557% 86.885% # ( 15, 22 ] 12 3.934% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 1 0.328% 92.131% ( 170, 250 ] 2 0.656% 92.787% ( 250, 380 ] 2 0.656% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 5 1.639% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 3 0.984% 98.033% ( 1900, 2900 ] 3 0.984% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 732.0000 StdDev: 939.59 Min: 84 Median: 140.0000 Max: 2990 Percentiles: P50: 140.00 P75: 1300.00 P99: 2990.00 P99.9: 2990.00 P99.99: 2990.00 ------------------------------------------------------ ( 76, 110 ] 8 40.000% 40.000% ######## ( 110, 170 ] 4 20.000% 60.000% #### ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 328.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.623 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.419 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/21-04:21:00 ... thread 0: (1000000,3000000) ops and (336370.0,341667.5) ops/second in (2.972917,8.780467) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 1.7 0.0 1.7 4.4 2.8 0.0 1.6 117.9 314.3 14.43 13.45 46 0.314 1727K 1861 0.0 0.0 L1 1/0 3.78 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 238.3 237.9 1.59 1.53 1 1.586 383K 610 0.0 0.0 L2 1/0 51.88 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 12/0 510.73 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 228.1 227.6 4.08 3.81 2 2.039 944K 1671 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.7 151.7 1.48 1.11 1 1.479 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/4 98.90 GB 0.0 3.5 1.0 2.5 6.3 3.8 3.0 2.3 156.6 279.3 23.06 21.35 52 0.444 3667K 4333 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 1.0 2.5 6.3 3.8 2.9 2.3 156.6 279.3 23.06 21.35 52 0.444 3667K 4333 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 1.0 2.5 3.5 1.0 0.0 0.0 237.9 237.6 15.18 14.31 12 1.265 3667K 4333 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.5 7.89 7.03 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.29 GB write, 718.93 MB/s write, 3.53 GB read, 403.04 MB/s read, 23.1 seconds Interval compaction: 6.29 GB write, 733.54 MB/s write, 3.53 GB read, 411.23 MB/s read, 23.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 632408 Average: 2.1384 StdDev: 11.43 Min: 0 Median: 1.4447 Max: 4028 Percentiles: P50: 1.44 P75: 1.84 P99: 5.68 P99.9: 11.49 P99.99: 17.46 ------------------------------------------------------ [ 0, 1 ] 138288 21.867% 21.867% #### ( 1, 2 ] 400049 63.258% 85.125% ############# ( 2, 3 ] 55743 8.814% 93.939% ## ( 3, 4 ] 20458 3.235% 97.174% # ( 4, 6 ] 13723 2.170% 99.344% ( 6, 10 ] 3287 0.520% 99.864% ( 10, 15 ] 769 0.122% 99.986% ( 15, 22 ] 82 0.013% 99.999% ( 22, 34 ] 10 0.002% 100.000% ( 34, 51 ] 9 0.001% 100.002% ( 51, 76 ] 7 0.001% 100.003% ( 110, 170 ] 19 0.003% 100.006% ( 170, 250 ] 17 0.003% 100.008% ( 250, 380 ] 17 0.003% 100.011% ( 380, 580 ] 9 0.001% 100.012% ( 580, 870 ] 10 0.002% 100.014% ( 870, 1300 ] 10 0.002% 100.016% ( 1300, 1900 ] 2 0.000% 100.016% ( 1900, 2900 ] 6 0.001% 100.017% ( 2900, 4400 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 28320 Average: 3.1040 StdDev: 28.56 Min: 1 Median: 1.5553 Max: 2622 Percentiles: P50: 1.56 P75: 1.92 P99: 8.45 P99.9: 186.49 P99.99: 1733.60 ------------------------------------------------------ [ 0, 1 ] 3300 11.653% 11.653% ## ( 1, 2 ] 19558 69.061% 80.713% ############## ( 2, 3 ] 3469 12.249% 92.963% ## ( 3, 4 ] 861 3.040% 96.003% # ( 4, 6 ] 576 2.034% 98.037% ( 6, 10 ] 446 1.575% 99.612% ( 10, 15 ] 21 0.074% 99.686% ( 15, 22 ] 1 0.004% 99.689% ( 22, 34 ] 1 0.004% 99.693% ( 51, 76 ] 1 0.004% 99.696% ( 76, 110 ] 2 0.007% 99.703% ( 110, 170 ] 53 0.187% 99.891% ( 170, 250 ] 13 0.046% 99.936% ( 250, 380 ] 7 0.025% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 95914 Average: 2.0229 StdDev: 7.20 Min: 1 Median: 1.4001 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.63 ------------------------------------------------------ [ 0, 1 ] 23918 24.937% 24.937% ##### ( 1, 2 ] 60088 62.648% 87.585% ############# ( 2, 3 ] 6973 7.270% 94.855% # ( 3, 4 ] 2753 2.870% 97.725% # ( 4, 6 ] 1620 1.689% 99.414% ( 6, 10 ] 450 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200944 Average: 3.5669 StdDev: 39.18 Min: 0 Median: 1.6808 Max: 4603 Percentiles: P50: 1.68 P75: 2.27 P99: 8.77 P99.9: 197.64 P99.99: 686.93 ------------------------------------------------------ [ 0, 1 ] 14495 7.213% 7.213% # ( 1, 2 ] 126297 62.852% 70.065% ############# ( 2, 3 ] 37197 18.511% 88.576% #### ( 3, 4 ] 9991 4.972% 93.548% # ( 4, 6 ] 8702 4.331% 97.879% # ( 6, 10 ] 3254 1.619% 99.498% ( 10, 15 ] 400 0.199% 99.697% ( 15, 22 ] 76 0.038% 99.735% ( 22, 34 ] 20 0.010% 99.745% ( 34, 51 ] 6 0.003% 99.748% ( 51, 76 ] 2 0.001% 99.749% ( 76, 110 ] 84 0.042% 99.791% ( 110, 170 ] 189 0.094% 99.885% ( 170, 250 ] 87 0.043% 99.928% ( 250, 380 ] 54 0.027% 99.955% ( 380, 580 ] 57 0.028% 99.984% ( 580, 870 ] 35 0.017% 100.001% ( 870, 1300 ] 19 0.009% 100.010% ( 1300, 1900 ] 5 0.002% 100.013% ( 1900, 2900 ] 13 0.006% 100.019% ( 2900, 4400 ] 9 0.004% 100.024% ( 4400, 6600 ] 2 0.001% 100.025% ** Level 4 read latency histogram (micros): Count: 305 Average: 115.2557 StdDev: 497.27 Min: 0 Median: 1.7277 Max: 4142 Percentiles: P50: 1.73 P75: 5.50 P99: 2883.33 P99.9: 4142.00 P99.99: 4142.00 ------------------------------------------------------ [ 0, 1 ] 79 25.902% 25.902% ##### ( 1, 2 ] 101 33.115% 59.016% ####### ( 2, 3 ] 32 10.492% 69.508% ## ( 3, 4 ] 7 2.295% 71.803% ( 4, 6 ] 13 4.262% 76.066% # ( 6, 10 ] 13 4.262% 80.328% # ( 10, 15 ] 20 6.557% 86.885% # ( 15, 22 ] 12 3.934% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 1 0.328% 92.131% ( 170, 250 ] 2 0.656% 92.787% ( 250, 380 ] 2 0.656% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 5 1.639% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 3 0.984% 98.033% ( 1900, 2900 ] 3 0.984% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 677.8667 StdDev: 828.69 Min: 84 Median: 223.3333 Max: 3043 Percentiles: P50: 223.33 P75: 977.50 P99: 3043.00 P99.9: 3043.00 P99.99: 3043.00 ------------------------------------------------------ ( 76, 110 ] 14 23.333% 23.333% ##### ( 110, 170 ] 14 23.333% 46.667% ##### ( 170, 250 ] 3 5.000% 51.667% # ( 250, 380 ] 4 6.667% 58.333% # ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 4 6.667% 80.000% # ( 1300, 1900 ] 6 10.000% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.014 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.391 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/21-04:21:03 ... thread 0: (1000000,4000000) ops and (342889.3,341972.1) ops/second in (2.916393,11.696860) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 3.13 GB 289.5 2.8 0.0 2.8 6.5 3.7 0.0 1.7 132.4 311.8 21.41 20.07 64 0.334 2878K 3092 0.0 0.0 L1 1/0 3.78 MB 0.4 0.4 0.4 0.0 0.4 0.4 0.2 1.0 238.3 237.9 1.59 1.53 1 1.586 383K 610 0.0 0.0 L2 1/0 51.88 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 12/0 510.73 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 228.1 227.6 4.08 3.81 2 2.039 944K 1671 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.7 151.7 1.48 1.11 1 1.479 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/4 99.88 GB 0.0 4.6 1.0 3.6 8.4 4.8 3.0 2.2 158.0 285.7 30.04 27.97 70 0.429 4818K 5564 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.0 3.6 8.4 4.8 2.9 2.2 158.0 285.7 30.04 27.97 70 0.429 4818K 5564 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.0 3.6 4.6 1.0 0.0 0.0 244.2 243.9 19.43 18.49 16 1.215 4818K 5564 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 362.3 10.61 9.48 54 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.9 total, 11.7 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.38 GB write, 722.62 MB/s write, 4.63 GB read, 399.55 MB/s read, 30.0 seconds Interval compaction: 8.38 GB write, 733.64 MB/s write, 4.63 GB read, 405.64 MB/s read, 30.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 891588 Average: 2.0867 StdDev: 11.22 Min: 0 Median: 1.4156 Max: 4028 Percentiles: P50: 1.42 P75: 1.81 P99: 5.55 P99.9: 11.33 P99.99: 17.41 ------------------------------------------------------ [ 0, 1 ] 213080 23.899% 23.899% ##### ( 1, 2 ] 559980 62.807% 86.706% ############# ( 2, 3 ] 71086 7.973% 94.679% ## ( 3, 4 ] 25933 2.909% 97.588% # ( 4, 6 ] 16253 1.823% 99.410% ( 6, 10 ] 4088 0.459% 99.869% ( 10, 15 ] 1041 0.117% 99.986% ( 15, 22 ] 113 0.013% 99.998% ( 22, 34 ] 11 0.001% 100.000% ( 34, 51 ] 12 0.001% 100.001% ( 51, 76 ] 10 0.001% 100.002% ( 110, 170 ] 23 0.003% 100.005% ( 170, 250 ] 26 0.003% 100.008% ( 250, 380 ] 26 0.003% 100.011% ( 380, 580 ] 11 0.001% 100.012% ( 580, 870 ] 14 0.002% 100.013% ( 870, 1300 ] 14 0.002% 100.015% ( 1300, 1900 ] 3 0.000% 100.015% ( 1900, 2900 ] 9 0.001% 100.016% ( 2900, 4400 ] 2 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 28320 Average: 3.1040 StdDev: 28.56 Min: 1 Median: 1.5553 Max: 2622 Percentiles: P50: 1.56 P75: 1.92 P99: 8.45 P99.9: 186.49 P99.99: 1733.60 ------------------------------------------------------ [ 0, 1 ] 3300 11.653% 11.653% ## ( 1, 2 ] 19558 69.061% 80.713% ############## ( 2, 3 ] 3469 12.249% 92.963% ## ( 3, 4 ] 861 3.040% 96.003% # ( 4, 6 ] 576 2.034% 98.037% ( 6, 10 ] 446 1.575% 99.612% ( 10, 15 ] 21 0.074% 99.686% ( 15, 22 ] 1 0.004% 99.689% ( 22, 34 ] 1 0.004% 99.693% ( 51, 76 ] 1 0.004% 99.696% ( 76, 110 ] 2 0.007% 99.703% ( 110, 170 ] 53 0.187% 99.891% ( 170, 250 ] 13 0.046% 99.936% ( 250, 380 ] 7 0.025% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 95914 Average: 2.0229 StdDev: 7.20 Min: 1 Median: 1.4001 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.63 ------------------------------------------------------ [ 0, 1 ] 23918 24.937% 24.937% ##### ( 1, 2 ] 60088 62.648% 87.585% ############# ( 2, 3 ] 6973 7.270% 94.855% # ( 3, 4 ] 2753 2.870% 97.725% # ( 4, 6 ] 1620 1.689% 99.414% ( 6, 10 ] 450 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200944 Average: 3.5669 StdDev: 39.18 Min: 0 Median: 1.6808 Max: 4603 Percentiles: P50: 1.68 P75: 2.27 P99: 8.77 P99.9: 197.64 P99.99: 686.93 ------------------------------------------------------ [ 0, 1 ] 14495 7.213% 7.213% # ( 1, 2 ] 126297 62.852% 70.065% ############# ( 2, 3 ] 37197 18.511% 88.576% #### ( 3, 4 ] 9991 4.972% 93.548% # ( 4, 6 ] 8702 4.331% 97.879% # ( 6, 10 ] 3254 1.619% 99.498% ( 10, 15 ] 400 0.199% 99.697% ( 15, 22 ] 76 0.038% 99.735% ( 22, 34 ] 20 0.010% 99.745% ( 34, 51 ] 6 0.003% 99.748% ( 51, 76 ] 2 0.001% 99.749% ( 76, 110 ] 84 0.042% 99.791% ( 110, 170 ] 189 0.094% 99.885% ( 170, 250 ] 87 0.043% 99.928% ( 250, 380 ] 54 0.027% 99.955% ( 380, 580 ] 57 0.028% 99.984% ( 580, 870 ] 35 0.017% 100.001% ( 870, 1300 ] 19 0.009% 100.010% ( 1300, 1900 ] 5 0.002% 100.013% ( 1900, 2900 ] 13 0.006% 100.019% ( 2900, 4400 ] 9 0.004% 100.024% ( 4400, 6600 ] 2 0.001% 100.025% ** Level 4 read latency histogram (micros): Count: 305 Average: 115.2557 StdDev: 497.27 Min: 0 Median: 1.7277 Max: 4142 Percentiles: P50: 1.73 P75: 5.50 P99: 2883.33 P99.9: 4142.00 P99.99: 4142.00 ------------------------------------------------------ [ 0, 1 ] 79 25.902% 25.902% ##### ( 1, 2 ] 101 33.115% 59.016% ####### ( 2, 3 ] 32 10.492% 69.508% ## ( 3, 4 ] 7 2.295% 71.803% ( 4, 6 ] 13 4.262% 76.066% # ( 6, 10 ] 13 4.262% 80.328% # ( 10, 15 ] 20 6.557% 86.885% # ( 15, 22 ] 12 3.934% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 1 0.328% 92.131% ( 170, 250 ] 2 0.656% 92.787% ( 250, 380 ] 2 0.656% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 5 1.639% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 3 0.984% 98.033% ( 1900, 2900 ] 3 0.984% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 677.8667 StdDev: 828.69 Min: 84 Median: 223.3333 Max: 3043 Percentiles: P50: 223.33 P75: 977.50 P99: 3043.00 P99.9: 3043.00 P99.99: 3043.00 ------------------------------------------------------ ( 76, 110 ] 14 23.333% 23.333% ##### ( 110, 170 ] 14 23.333% 46.667% ##### ( 170, 250 ] 3 5.000% 51.667% # ( 250, 380 ] 4 6.667% 58.333% # ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 4 6.667% 80.000% # ( 1300, 1900 ] 6 10.000% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 11.9 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 331.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.357 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.343 H:M:S, 11.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/21-04:21:07 ... thread 0: (1000000,5000000) ops and (284116.3,328589.7) ops/second in (3.519685,15.216545) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 4.06 GB 50.4 3.6 0.0 3.6 8.2 4.7 0.0 1.8 135.3 312.4 27.01 25.37 80 0.338 3709K 4007 0.0 0.0 L1 1/1 3.78 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 238.3 237.9 1.59 1.53 1 1.586 383K 610 0.0 0.0 L2 1/0 51.88 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 12/0 510.73 MB 0.5 0.9 0.2 0.7 0.9 0.2 0.4 3.7 228.1 227.6 4.08 3.81 2 2.039 944K 1671 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.7 151.7 1.48 1.11 1 1.479 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/16 100.81 GB 0.0 5.4 1.0 4.4 10.1 5.7 3.0 2.2 156.1 290.2 35.64 33.26 86 0.414 5649K 6479 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.0 4.4 10.1 5.7 2.9 2.2 156.1 290.2 35.64 33.26 86 0.414 5649K 6479 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.0 4.4 5.4 1.0 0.0 0.0 247.5 247.2 22.49 21.49 19 1.183 5649K 6479 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 363.9 13.16 11.77 67 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.10 GB write, 671.93 MB/s write, 5.43 GB read, 361.40 MB/s read, 35.6 seconds Interval compaction: 10.10 GB write, 679.80 MB/s write, 5.43 GB read, 365.64 MB/s read, 35.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 14, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1202858 Average: 2.0911 StdDev: 10.89 Min: 0 Median: 1.4068 Max: 4028 Percentiles: P50: 1.41 P75: 1.80 P99: 5.49 P99.9: 12.05 P99.99: 103.00 ------------------------------------------------------ [ 0, 1 ] 292856 24.347% 24.347% ##### ( 1, 2 ] 758537 63.061% 87.408% ############# ( 2, 3 ] 91795 7.631% 95.039% ## ( 3, 4 ] 33030 2.746% 97.785% # ( 4, 6 ] 19614 1.631% 99.416% ( 6, 10 ] 5268 0.438% 99.854% ( 10, 15 ] 1354 0.113% 99.966% ( 15, 22 ] 149 0.012% 99.979% ( 22, 34 ] 16 0.001% 99.980% ( 34, 51 ] 15 0.001% 99.981% ( 51, 76 ] 11 0.001% 99.982% ( 76, 110 ] 118 0.010% 99.992% ( 110, 170 ] 116 0.010% 100.002% ( 170, 250 ] 52 0.004% 100.006% ( 250, 380 ] 41 0.003% 100.009% ( 380, 580 ] 22 0.002% 100.011% ( 580, 870 ] 28 0.002% 100.014% ( 870, 1300 ] 17 0.001% 100.015% ( 1300, 1900 ] 4 0.000% 100.015% ( 1900, 2900 ] 9 0.001% 100.016% ( 2900, 4400 ] 3 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 28321 Average: 3.1089 StdDev: 28.57 Min: 1 Median: 1.5553 Max: 2622 Percentiles: P50: 1.56 P75: 1.92 P99: 8.46 P99.9: 186.49 P99.99: 1733.58 ------------------------------------------------------ [ 0, 1 ] 3300 11.652% 11.652% ## ( 1, 2 ] 19558 69.058% 80.710% ############## ( 2, 3 ] 3469 12.249% 92.959% ## ( 3, 4 ] 861 3.040% 95.999% # ( 4, 6 ] 576 2.034% 98.033% ( 6, 10 ] 446 1.575% 99.608% ( 10, 15 ] 21 0.074% 99.682% ( 15, 22 ] 1 0.004% 99.686% ( 22, 34 ] 1 0.004% 99.689% ( 51, 76 ] 1 0.004% 99.693% ( 76, 110 ] 2 0.007% 99.700% ( 110, 170 ] 54 0.191% 99.891% ( 170, 250 ] 13 0.046% 99.936% ( 250, 380 ] 7 0.025% 99.961% ( 380, 580 ] 4 0.014% 99.975% ( 580, 870 ] 2 0.007% 99.982% ( 1300, 1900 ] 3 0.011% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 95914 Average: 2.0229 StdDev: 7.20 Min: 1 Median: 1.4001 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.63 ------------------------------------------------------ [ 0, 1 ] 23918 24.937% 24.937% ##### ( 1, 2 ] 60088 62.648% 87.585% ############# ( 2, 3 ] 6973 7.270% 94.855% # ( 3, 4 ] 2753 2.870% 97.725% # ( 4, 6 ] 1620 1.689% 99.414% ( 6, 10 ] 450 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 200944 Average: 3.5669 StdDev: 39.18 Min: 0 Median: 1.6808 Max: 4603 Percentiles: P50: 1.68 P75: 2.27 P99: 8.77 P99.9: 197.64 P99.99: 686.93 ------------------------------------------------------ [ 0, 1 ] 14495 7.213% 7.213% # ( 1, 2 ] 126297 62.852% 70.065% ############# ( 2, 3 ] 37197 18.511% 88.576% #### ( 3, 4 ] 9991 4.972% 93.548% # ( 4, 6 ] 8702 4.331% 97.879% # ( 6, 10 ] 3254 1.619% 99.498% ( 10, 15 ] 400 0.199% 99.697% ( 15, 22 ] 76 0.038% 99.735% ( 22, 34 ] 20 0.010% 99.745% ( 34, 51 ] 6 0.003% 99.748% ( 51, 76 ] 2 0.001% 99.749% ( 76, 110 ] 84 0.042% 99.791% ( 110, 170 ] 189 0.094% 99.885% ( 170, 250 ] 87 0.043% 99.928% ( 250, 380 ] 54 0.027% 99.955% ( 380, 580 ] 57 0.028% 99.984% ( 580, 870 ] 35 0.017% 100.001% ( 870, 1300 ] 19 0.009% 100.010% ( 1300, 1900 ] 5 0.002% 100.013% ( 1900, 2900 ] 13 0.006% 100.019% ( 2900, 4400 ] 9 0.004% 100.024% ( 4400, 6600 ] 2 0.001% 100.025% ** Level 4 read latency histogram (micros): Count: 305 Average: 115.2557 StdDev: 497.27 Min: 0 Median: 1.7277 Max: 4142 Percentiles: P50: 1.73 P75: 5.50 P99: 2883.33 P99.9: 4142.00 P99.99: 4142.00 ------------------------------------------------------ [ 0, 1 ] 79 25.902% 25.902% ##### ( 1, 2 ] 101 33.115% 59.016% ####### ( 2, 3 ] 32 10.492% 69.508% ## ( 3, 4 ] 7 2.295% 71.803% ( 4, 6 ] 13 4.262% 76.066% # ( 6, 10 ] 13 4.262% 80.328% # ( 10, 15 ] 20 6.557% 86.885% # ( 15, 22 ] 12 3.934% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 1 0.328% 92.131% ( 170, 250 ] 2 0.656% 92.787% ( 250, 380 ] 2 0.656% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 5 1.639% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 3 0.984% 98.033% ( 1900, 2900 ] 3 0.984% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 677.8667 StdDev: 828.69 Min: 84 Median: 223.3333 Max: 3043 Percentiles: P50: 223.33 P75: 977.50 P99: 3043.00 P99.9: 3043.00 P99.99: 3043.00 ------------------------------------------------------ ( 76, 110 ] 14 23.333% 23.333% ##### ( 110, 170 ] 14 23.333% 46.667% ##### ( 170, 250 ] 3 5.000% 51.667% # ( 250, 380 ] 4 6.667% 58.333% # ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 4 6.667% 80.000% # ( 1300, 1900 ] 6 10.000% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 15.4 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 319.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.313 H:M:S, 15.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.956 H:M:S, 27.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/21-04:21:22 ... thread 0: (1000000,6000000) ops and (66396.7,198166.8) ops/second in (15.060983,30.277528) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 1.47 GB 18.9 5.2 0.0 5.2 10.8 5.7 0.0 1.9 146.1 305.9 36.22 33.92 100 0.362 5372K 7654 0.0 0.0 L1 9/9 1014.79 MB 0.0 3.9 3.9 0.0 3.9 3.9 0.2 1.0 224.3 220.8 17.97 16.91 2 8.986 4093K 63K 0.0 0.0 L2 21/14 2.57 GB 9.0 0.4 0.2 0.2 0.4 0.2 3.1 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 12/10 510.73 MB 0.2 0.9 0.2 0.7 0.9 0.2 0.4 3.7 228.1 227.6 4.08 3.81 2 2.039 944K 1671 0.0 0.0 L4 169/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.7 151.7 1.48 1.11 1 1.479 227K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/38 101.72 GB 0.0 10.6 4.6 6.0 16.2 10.2 5.5 2.9 177.3 270.7 61.24 57.20 107 0.572 11M 73K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.6 4.6 6.0 16.2 10.2 5.4 2.9 177.3 270.7 61.24 57.20 107 0.572 11M 73K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.6 4.6 6.0 10.5 4.5 0.0 0.0 239.9 238.3 45.25 42.92 24 1.885 11M 73K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 362.4 15.99 14.27 83 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.5 total, 30.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.19 GB write, 544.27 MB/s write, 10.60 GB read, 356.40 MB/s read, 61.2 seconds Interval compaction: 16.19 GB write, 547.48 MB/s write, 10.60 GB read, 358.50 MB/s read, 61.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 14, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2460278 Average: 2.4512 StdDev: 14.15 Min: 0 Median: 1.4046 Max: 4028 Percentiles: P50: 1.40 P75: 1.80 P99: 5.98 P99.9: 136.67 P99.99: 312.45 ------------------------------------------------------ [ 0, 1 ] 607330 24.685% 24.685% ##### ( 1, 2 ] 1539173 62.561% 87.246% ############# ( 2, 3 ] 182198 7.406% 94.652% # ( 3, 4 ] 64273 2.612% 97.264% # ( 4, 6 ] 43169 1.755% 99.019% ( 6, 10 ] 14347 0.583% 99.602% ( 10, 15 ] 2911 0.118% 99.720% ( 15, 22 ] 622 0.025% 99.746% ( 22, 34 ] 35 0.001% 99.747% ( 34, 51 ] 20 0.001% 99.748% ( 51, 76 ] 96 0.004% 99.752% ( 76, 110 ] 2521 0.102% 99.854% ( 110, 170 ] 2528 0.103% 99.957% ( 170, 250 ] 638 0.026% 99.983% ( 250, 380 ] 358 0.015% 99.998% ( 380, 580 ] 298 0.012% 100.010% ( 580, 870 ] 109 0.004% 100.014% ( 870, 1300 ] 38 0.002% 100.016% ( 1300, 1900 ] 8 0.000% 100.016% ( 1900, 2900 ] 16 0.001% 100.017% ( 2900, 4400 ] 9 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 131575 Average: 4.2942 StdDev: 34.41 Min: 1 Median: 1.8275 Max: 3996 Percentiles: P50: 1.83 P75: 2.71 P99: 9.50 P99.9: 124.51 P99.99: 161.51 ------------------------------------------------------ [ 0, 1 ] 5107 3.881% 3.881% # ( 1, 2 ] 73330 55.732% 59.614% ########### ( 2, 3 ] 28363 21.557% 81.170% #### ( 3, 4 ] 10511 7.989% 89.159% ## ( 4, 6 ] 10321 7.844% 97.003% ## ( 6, 10 ] 3006 2.285% 99.288% ( 10, 15 ] 604 0.459% 99.747% ( 15, 22 ] 100 0.076% 99.823% ( 22, 34 ] 9 0.007% 99.830% ( 34, 51 ] 1 0.001% 99.831% ( 51, 76 ] 1 0.001% 99.831% ( 76, 110 ] 47 0.036% 99.867% ( 110, 170 ] 192 0.146% 100.013% ( 170, 250 ] 104 0.079% 100.092% ( 250, 380 ] 71 0.054% 100.146% ( 380, 580 ] 62 0.047% 100.193% ( 580, 870 ] 45 0.034% 100.227% ( 870, 1300 ] 29 0.022% 100.249% ( 1300, 1900 ] 14 0.011% 100.260% ( 1900, 2900 ] 4 0.003% 100.263% ( 2900, 4400 ] 1 0.001% 100.264% ** Level 2 read latency histogram (micros): Count: 95914 Average: 2.0229 StdDev: 7.20 Min: 1 Median: 1.4001 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.63 ------------------------------------------------------ [ 0, 1 ] 23918 24.937% 24.937% ##### ( 1, 2 ] 60088 62.648% 87.585% ############# ( 2, 3 ] 6973 7.270% 94.855% # ( 3, 4 ] 2753 2.870% 97.725% # ( 4, 6 ] 1620 1.689% 99.414% ( 6, 10 ] 450 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 206222 Average: 4.3279 StdDev: 45.33 Min: 0 Median: 1.6898 Max: 4603 Percentiles: P50: 1.69 P75: 2.30 P99: 9.27 P99.9: 444.33 P99.99: 951.87 ------------------------------------------------------ [ 0, 1 ] 14592 7.076% 7.076% # ( 1, 2 ] 128324 62.226% 69.302% ############ ( 2, 3 ] 38569 18.703% 88.005% #### ( 3, 4 ] 10687 5.182% 93.187% # ( 4, 6 ] 9187 4.455% 97.642% # ( 6, 10 ] 3429 1.663% 99.305% ( 10, 15 ] 438 0.212% 99.517% ( 15, 22 ] 80 0.039% 99.556% ( 22, 34 ] 20 0.010% 99.566% ( 34, 51 ] 6 0.003% 99.568% ( 51, 76 ] 2 0.001% 99.569% ( 76, 110 ] 104 0.050% 99.620% ( 110, 170 ] 245 0.119% 99.739% ( 170, 250 ] 156 0.076% 99.814% ( 250, 380 ] 134 0.065% 99.879% ( 380, 580 ] 133 0.064% 99.944% ( 580, 870 ] 87 0.042% 99.986% ( 870, 1300 ] 44 0.021% 100.007% ( 1300, 1900 ] 7 0.003% 100.011% ( 1900, 2900 ] 15 0.007% 100.018% ( 2900, 4400 ] 11 0.005% 100.023% ( 4400, 6600 ] 2 0.001% 100.024% ** Level 4 read latency histogram (micros): Count: 305 Average: 115.2557 StdDev: 497.27 Min: 0 Median: 1.7277 Max: 4142 Percentiles: P50: 1.73 P75: 5.50 P99: 2883.33 P99.9: 4142.00 P99.99: 4142.00 ------------------------------------------------------ [ 0, 1 ] 79 25.902% 25.902% ##### ( 1, 2 ] 101 33.115% 59.016% ####### ( 2, 3 ] 32 10.492% 69.508% ## ( 3, 4 ] 7 2.295% 71.803% ( 4, 6 ] 13 4.262% 76.066% # ( 6, 10 ] 13 4.262% 80.328% # ( 10, 15 ] 20 6.557% 86.885% # ( 15, 22 ] 12 3.934% 90.820% # ( 22, 34 ] 3 0.984% 91.803% ( 110, 170 ] 1 0.328% 92.131% ( 170, 250 ] 2 0.656% 92.787% ( 250, 380 ] 2 0.656% 93.443% ( 380, 580 ] 1 0.328% 93.770% ( 580, 870 ] 5 1.639% 95.410% ( 870, 1300 ] 5 1.639% 97.049% ( 1300, 1900 ] 3 0.984% 98.033% ( 1900, 2900 ] 3 0.984% 99.016% ( 2900, 4400 ] 3 0.984% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 677.8667 StdDev: 828.69 Min: 84 Median: 223.3333 Max: 3043 Percentiles: P50: 223.33 P75: 977.50 P99: 3043.00 P99.9: 3043.00 P99.99: 3043.00 ------------------------------------------------------ ( 76, 110 ] 14 23.333% 23.333% ##### ( 110, 170 ] 14 23.333% 46.667% ##### ( 170, 250 ] 3 5.000% 51.667% # ( 250, 380 ] 4 6.667% 58.333% # ( 380, 580 ] 6 10.000% 68.333% ## ( 580, 870 ] 3 5.000% 73.333% # ( 870, 1300 ] 4 6.667% 80.000% # ( 1300, 1900 ] 6 10.000% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 30.5 total, 15.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 193.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.447 H:M:S, 47.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 65.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.134 H:M:S, 80.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/21-04:21:26 ... thread 0: (1000000,7000000) ops and (225079.5,201610.6) ops/second in (4.442874,34.720402) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.39 GB 75.5 5.7 0.0 5.7 12.3 6.6 0.0 1.9 137.7 295.9 42.55 38.76 113 0.377 5947K 8281 0.0 0.0 L1 9/9 1014.79 MB 0.0 3.9 3.9 0.0 3.9 3.9 0.2 1.0 224.3 220.8 17.97 16.91 2 8.986 4093K 63K 0.0 0.0 L2 6/5 772.68 MB 1.3 0.4 0.2 0.2 0.4 0.2 3.1 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 31/11 1.60 GB 1.0 3.1 2.1 1.0 3.1 2.0 0.4 1.5 198.0 197.5 15.93 14.00 7 2.276 3204K 8690 0.0 0.0 L4 177/5 9.97 GB 1.0 0.9 0.9 0.0 0.9 0.9 0.8 1.0 123.6 123.4 7.67 4.46 12 0.639 931K 474 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1292/39 102.64 GB 0.0 14.0 7.1 7.0 20.5 13.6 5.9 3.1 167.9 245.6 85.61 75.57 136 0.629 14M 81K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.0 7.1 7.0 20.5 13.6 5.8 3.1 167.9 245.6 85.61 75.57 136 0.629 14M 81K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.0 7.1 7.0 14.0 7.0 0.0 0.0 219.0 217.8 65.61 58.71 42 1.562 14M 81K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 337.0 20.00 16.85 94 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.9 total, 34.7 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.53 GB write, 602.51 MB/s write, 14.03 GB read, 411.75 MB/s read, 85.6 seconds Interval compaction: 20.53 GB write, 605.61 MB/s write, 14.03 GB read, 413.86 MB/s read, 85.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 31, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2885878 Average: 2.6272 StdDev: 23.95 Min: 0 Median: 1.4623 Max: 8104 Percentiles: P50: 1.46 P75: 1.87 P99: 6.79 P99.9: 126.60 P99.99: 271.25 ------------------------------------------------------ [ 0, 1 ] 620862 21.514% 21.514% #### ( 1, 2 ] 1778202 61.617% 83.131% ############ ( 2, 3 ] 271054 9.392% 92.524% ## ( 3, 4 ] 103547 3.588% 96.112% # ( 4, 6 ] 79112 2.741% 98.853% # ( 6, 10 ] 21539 0.746% 99.599% ( 10, 15 ] 4479 0.155% 99.755% ( 15, 22 ] 789 0.027% 99.782% ( 22, 34 ] 49 0.002% 99.784% ( 34, 51 ] 24 0.001% 99.784% ( 51, 76 ] 99 0.003% 99.788% ( 76, 110 ] 2528 0.088% 99.875% ( 110, 170 ] 2563 0.089% 99.964% ( 170, 250 ] 679 0.024% 99.988% ( 250, 380 ] 394 0.014% 100.001% ( 380, 580 ] 341 0.012% 100.013% ( 580, 870 ] 134 0.005% 100.018% ( 870, 1300 ] 58 0.002% 100.020% ( 1300, 1900 ] 28 0.001% 100.021% ( 1900, 2900 ] 41 0.001% 100.022% ( 2900, 4400 ] 37 0.001% 100.024% ( 4400, 6600 ] 11 0.000% 100.024% ( 6600, 9900 ] 5 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 664751 Average: 5.7685 StdDev: 90.19 Min: 1 Median: 1.9132 Max: 10363 Percentiles: P50: 1.91 P75: 2.85 P99: 9.46 P99.9: 103.43 P99.99: 235.84 ------------------------------------------------------ [ 0, 1 ] 11818 1.778% 1.778% ( 1, 2 ] 351034 52.807% 54.585% ########### ( 2, 3 ] 160182 24.097% 78.681% ##### ( 3, 4 ] 61616 9.269% 87.950% ## ( 4, 6 ] 59033 8.880% 96.831% ## ( 6, 10 ] 16690 2.511% 99.341% # ( 10, 15 ] 3133 0.471% 99.813% ( 15, 22 ] 413 0.062% 99.875% ( 22, 34 ] 29 0.004% 99.879% ( 34, 51 ] 8 0.001% 99.880% ( 51, 76 ] 6 0.001% 99.881% ( 76, 110 ] 154 0.023% 99.904% ( 110, 170 ] 357 0.054% 99.958% ( 170, 250 ] 257 0.039% 99.997% ( 250, 380 ] 268 0.040% 100.037% ( 380, 580 ] 334 0.050% 100.087% ( 580, 870 ] 234 0.035% 100.123% ( 870, 1300 ] 161 0.024% 100.147% ( 1300, 1900 ] 73 0.011% 100.158% ( 1900, 2900 ] 107 0.016% 100.174% ( 2900, 4400 ] 126 0.019% 100.193% ( 4400, 6600 ] 47 0.007% 100.200% ( 6600, 9900 ] 15 0.002% 100.202% ( 9900, 14000 ] 3 0.000% 100.203% ** Level 2 read latency histogram (micros): Count: 95914 Average: 2.0229 StdDev: 7.20 Min: 1 Median: 1.4001 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.63 ------------------------------------------------------ [ 0, 1 ] 23918 24.937% 24.937% ##### ( 1, 2 ] 60088 62.648% 87.585% ############# ( 2, 3 ] 6973 7.270% 94.855% # ( 3, 4 ] 2753 2.870% 97.725% # ( 4, 6 ] 1620 1.689% 99.414% ( 6, 10 ] 450 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 452805 Average: 6.8004 StdDev: 103.80 Min: 0 Median: 1.8647 Max: 10546 Percentiles: P50: 1.86 P75: 2.78 P99: 9.39 P99.9: 240.32 P99.99: 497.75 ------------------------------------------------------ [ 0, 1 ] 16659 3.679% 3.679% # ( 1, 2 ] 242571 53.571% 57.250% ########### ( 2, 3 ] 102657 22.671% 79.921% ##### ( 3, 4 ] 39579 8.741% 88.662% ## ( 4, 6 ] 39195 8.656% 97.318% ## ( 6, 10 ] 8997 1.987% 99.305% ( 10, 15 ] 1820 0.402% 99.707% ( 15, 22 ] 215 0.047% 99.754% ( 22, 34 ] 33 0.007% 99.762% ( 34, 51 ] 14 0.003% 99.765% ( 51, 76 ] 5 0.001% 99.766% ( 76, 110 ] 112 0.025% 99.791% ( 110, 170 ] 286 0.063% 99.854% ( 170, 250 ] 238 0.053% 99.906% ( 250, 380 ] 228 0.050% 99.957% ( 380, 580 ] 256 0.057% 100.013% ( 580, 870 ] 222 0.049% 100.062% ( 870, 1300 ] 152 0.034% 100.096% ( 1300, 1900 ] 85 0.019% 100.115% ( 1900, 2900 ] 111 0.025% 100.139% ( 2900, 4400 ] 148 0.033% 100.172% ( 4400, 6600 ] 39 0.009% 100.180% ( 6600, 9900 ] 8 0.002% 100.182% ( 9900, 14000 ] 2 0.000% 100.183% ** Level 4 read latency histogram (micros): Count: 13857 Average: 97.4207 StdDev: 462.49 Min: 0 Median: 2.0349 Max: 11471 Percentiles: P50: 2.03 P75: 3.35 P99: 2567.88 P99.9: 5273.03 P99.99: 8375.73 ------------------------------------------------------ [ 0, 1 ] 352 2.540% 2.540% # ( 1, 2 ] 6471 46.698% 49.239% ######### ( 2, 3 ] 3019 21.787% 71.025% #### ( 3, 4 ] 1558 11.243% 82.269% ## ( 4, 6 ] 923 6.661% 88.930% # ( 6, 10 ] 348 2.511% 91.441% # ( 10, 15 ] 90 0.649% 92.091% ( 15, 22 ] 19 0.137% 92.228% ( 22, 34 ] 4 0.029% 92.257% ( 51, 76 ] 1 0.007% 92.264% ( 76, 110 ] 5 0.036% 92.300% ( 110, 170 ] 24 0.173% 92.473% ( 170, 250 ] 61 0.440% 92.913% ( 250, 380 ] 99 0.714% 93.628% ( 380, 580 ] 173 1.248% 94.876% ( 580, 870 ] 209 1.508% 96.384% ( 870, 1300 ] 191 1.378% 97.763% ( 1300, 1900 ] 118 0.852% 98.614% ( 1900, 2900 ] 80 0.577% 99.192% ( 2900, 4400 ] 91 0.657% 99.848% ( 4400, 6600 ] 18 0.130% 99.978% ( 6600, 9900 ] 3 0.022% 100.000% ( 9900, 14000 ] 1 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 80 Average: 887.1625 StdDev: 1109.59 Min: 84 Median: 416.3636 Max: 5193 Percentiles: P50: 416.36 P75: 1228.33 P99: 5193.00 P99.9: 5193.00 P99.99: 5193.00 ------------------------------------------------------ ( 76, 110 ] 14 17.500% 17.500% #### ( 110, 170 ] 15 18.750% 36.250% #### ( 170, 250 ] 3 3.750% 40.000% # ( 250, 380 ] 6 7.500% 47.500% ## ( 380, 580 ] 11 13.750% 61.250% ### ( 580, 870 ] 6 7.500% 68.750% ## ( 870, 1300 ] 6 7.500% 76.250% ## ( 1300, 1900 ] 8 10.000% 86.250% ## ( 1900, 2900 ] 5 6.250% 92.500% # ( 2900, 4400 ] 4 5.000% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 34.9 total, 4.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 197.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.032 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 221.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.585 H:M:S, 35.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/21-04:21:30 ... thread 0: (1000000,8000000) ops and (243697.6,206058.9) ops/second in (4.103447,38.823849) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.38 GB 182.5 6.6 0.0 6.6 14.2 7.6 0.0 1.9 135.0 288.6 50.39 45.19 129 0.391 6907K 9378 0.0 0.0 L1 9/9 1014.79 MB 0.0 3.9 3.9 0.0 3.9 3.9 0.2 1.0 224.3 220.8 17.97 16.91 2 8.986 4093K 63K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.1 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 20/0 996.94 MB 1.0 4.2 2.8 1.4 4.2 2.8 0.4 1.5 182.2 181.8 23.85 19.46 11 2.168 4415K 11K 0.0 0.0 L4 180/0 9.69 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.1 128.3 128.0 19.12 11.51 35 0.546 2416K 2377 0.0 0.0 L5 1076/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/18 103.62 GB 0.0 17.6 9.2 8.4 25.1 16.7 7.6 3.3 159.6 227.5 112.83 94.51 179 0.630 18M 87K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.6 9.2 8.4 25.1 16.7 7.5 3.3 159.6 227.5 112.83 94.51 179 0.630 18M 87K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.6 9.2 8.4 17.5 9.1 0.0 0.0 202.2 201.2 89.06 74.99 72 1.237 18M 87K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 326.0 23.76 19.52 107 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.0 total, 38.8 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.07 GB write, 658.15 MB/s write, 17.59 GB read, 461.81 MB/s read, 112.8 seconds Interval compaction: 25.07 GB write, 661.17 MB/s write, 17.59 GB read, 463.93 MB/s read, 112.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 46, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 46, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3121931 Average: 2.7053 StdDev: 26.00 Min: 0 Median: 1.4773 Max: 8104 Percentiles: P50: 1.48 P75: 1.88 P99: 6.91 P99.9: 128.50 P99.99: 322.04 ------------------------------------------------------ [ 0, 1 ] 642253 20.572% 20.572% #### ( 1, 2 ] 1924884 61.657% 82.229% ############ ( 2, 3 ] 308048 9.867% 92.096% ## ( 3, 4 ] 118561 3.798% 95.894% # ( 4, 6 ] 91510 2.931% 98.825% # ( 6, 10 ] 24090 0.772% 99.597% ( 10, 15 ] 4978 0.159% 99.756% ( 15, 22 ] 864 0.028% 99.784% ( 22, 34 ] 57 0.002% 99.786% ( 34, 51 ] 26 0.001% 99.787% ( 51, 76 ] 102 0.003% 99.790% ( 76, 110 ] 2618 0.084% 99.874% ( 110, 170 ] 2653 0.085% 99.959% ( 170, 250 ] 726 0.023% 99.982% ( 250, 380 ] 449 0.014% 99.996% ( 380, 580 ] 405 0.013% 100.009% ( 580, 870 ] 194 0.006% 100.016% ( 870, 1300 ] 97 0.003% 100.019% ( 1300, 1900 ] 54 0.002% 100.020% ( 1900, 2900 ] 54 0.002% 100.022% ( 2900, 4400 ] 47 0.002% 100.024% ( 4400, 6600 ] 13 0.000% 100.024% ( 6600, 9900 ] 6 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 917054 Average: 5.8670 StdDev: 92.66 Min: 1 Median: 1.8799 Max: 10363 Percentiles: P50: 1.88 P75: 2.80 P99: 9.42 P99.9: 137.60 P99.99: 355.71 ------------------------------------------------------ [ 0, 1 ] 21582 2.353% 2.353% ( 1, 2 ] 496568 54.148% 56.502% ########### ( 2, 3 ] 211914 23.108% 79.610% ##### ( 3, 4 ] 81491 8.886% 88.496% ## ( 4, 6 ] 77043 8.401% 96.897% ## ( 6, 10 ] 22534 2.457% 99.354% ( 10, 15 ] 4040 0.441% 99.795% ( 15, 22 ] 495 0.054% 99.849% ( 22, 34 ] 33 0.004% 99.852% ( 34, 51 ] 15 0.002% 99.854% ( 51, 76 ] 8 0.001% 99.855% ( 76, 110 ] 212 0.023% 99.878% ( 110, 170 ] 439 0.048% 99.926% ( 170, 250 ] 311 0.034% 99.960% ( 250, 380 ] 341 0.037% 99.997% ( 380, 580 ] 412 0.045% 100.042% ( 580, 870 ] 314 0.034% 100.076% ( 870, 1300 ] 232 0.025% 100.101% ( 1300, 1900 ] 108 0.012% 100.113% ( 1900, 2900 ] 164 0.018% 100.131% ( 2900, 4400 ] 214 0.023% 100.154% ( 4400, 6600 ] 66 0.007% 100.162% ( 6600, 9900 ] 20 0.002% 100.164% ( 9900, 14000 ] 3 0.000% 100.164% ** Level 2 read latency histogram (micros): Count: 95914 Average: 2.0229 StdDev: 7.20 Min: 1 Median: 1.4001 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.63 ------------------------------------------------------ [ 0, 1 ] 23918 24.937% 24.937% ##### ( 1, 2 ] 60088 62.648% 87.585% ############# ( 2, 3 ] 6973 7.270% 94.855% # ( 3, 4 ] 2753 2.870% 97.725% # ( 4, 6 ] 1620 1.689% 99.414% ( 6, 10 ] 450 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 848044 Average: 6.5522 StdDev: 99.61 Min: 0 Median: 1.9216 Max: 10546 Percentiles: P50: 1.92 P75: 2.88 P99: 9.26 P99.9: 63.42 P99.99: 223.99 ------------------------------------------------------ [ 0, 1 ] 21131 2.492% 2.492% ( 1, 2 ] 437160 51.549% 54.041% ########## ( 2, 3 ] 201647 23.778% 77.819% ##### ( 3, 4 ] 82532 9.732% 87.551% ## ( 4, 6 ] 82827 9.767% 97.318% ## ( 6, 10 ] 17530 2.067% 99.385% ( 10, 15 ] 3822 0.451% 99.836% ( 15, 22 ] 469 0.055% 99.891% ( 22, 34 ] 52 0.006% 99.897% ( 34, 51 ] 19 0.002% 99.899% ( 51, 76 ] 14 0.002% 99.901% ( 76, 110 ] 150 0.018% 99.919% ( 110, 170 ] 370 0.044% 99.962% ( 170, 250 ] 350 0.041% 100.003% ( 250, 380 ] 344 0.041% 100.044% ( 380, 580 ] 402 0.047% 100.091% ( 580, 870 ] 363 0.043% 100.134% ( 870, 1300 ] 245 0.029% 100.163% ( 1300, 1900 ] 153 0.018% 100.181% ( 1900, 2900 ] 221 0.026% 100.207% ( 2900, 4400 ] 257 0.030% 100.237% ( 4400, 6600 ] 73 0.009% 100.246% ( 6600, 9900 ] 13 0.002% 100.248% ( 9900, 14000 ] 2 0.000% 100.248% ** Level 4 read latency histogram (micros): Count: 34314 Average: 71.0348 StdDev: 375.94 Min: 0 Median: 2.0120 Max: 11471 Percentiles: P50: 2.01 P75: 3.28 P99: 1830.08 P99.9: 4319.02 P99.99: 6001.64 ------------------------------------------------------ [ 0, 1 ] 797 2.323% 2.323% ( 1, 2 ] 16269 47.412% 49.735% ######### ( 2, 3 ] 7566 22.049% 71.784% #### ( 3, 4 ] 3949 11.508% 83.293% ## ( 4, 6 ] 2384 6.948% 90.240% # ( 6, 10 ] 863 2.515% 92.755% # ( 10, 15 ] 181 0.527% 93.283% ( 15, 22 ] 32 0.093% 93.376% ( 22, 34 ] 6 0.017% 93.393% ( 34, 51 ] 1 0.003% 93.396% ( 51, 76 ] 1 0.003% 93.399% ( 76, 110 ] 23 0.067% 93.466% ( 110, 170 ] 130 0.379% 93.845% ( 170, 250 ] 223 0.650% 94.495% ( 250, 380 ] 243 0.708% 95.203% ( 380, 580 ] 379 1.105% 96.308% ( 580, 870 ] 405 1.180% 97.488% ( 870, 1300 ] 351 1.023% 98.511% ( 1300, 1900 ] 190 0.554% 99.065% ( 1900, 2900 ] 141 0.411% 99.475% ( 2900, 4400 ] 154 0.449% 99.924% ( 4400, 6600 ] 31 0.090% 100.015% ( 6600, 9900 ] 3 0.009% 100.023% ( 9900, 14000 ] 1 0.003% 100.026% ** Level 5 read latency histogram (micros): Count: 180 Average: 1258.1722 StdDev: 1458.30 Min: 84 Median: 670.6250 Max: 9611 Percentiles: P50: 670.62 P75: 1864.71 P99: 6930.00 P99.9: 9603.00 P99.99: 9611.00 ------------------------------------------------------ ( 76, 110 ] 18 10.000% 10.000% ## ( 110, 170 ] 26 14.444% 24.444% ### ( 170, 250 ] 9 5.000% 29.444% # ( 250, 380 ] 11 6.111% 35.556% # ( 380, 580 ] 21 11.667% 47.222% ## ( 580, 870 ] 16 8.889% 56.111% ## ( 870, 1300 ] 18 10.000% 66.111% ## ( 1300, 1900 ] 17 9.444% 75.556% ## ( 1900, 2900 ] 19 10.556% 86.111% ## ( 2900, 4400 ] 18 10.000% 96.111% ## ( 4400, 6600 ] 5 2.778% 98.889% # ( 6600, 9900 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 39.0 total, 4.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 201.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.292 H:M:S, 44.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 239.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.260 H:M:S, 30.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/21-04:21:34 ... thread 0: (1000000,9000000) ops and (271864.1,211754.0) ops/second in (3.678309,42.502158) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/17 3.01 GB 0.0 7.5 0.0 7.5 16.0 8.5 0.0 1.9 136.0 289.8 56.49 50.91 146 0.387 7802K 10K 0.0 0.0 L1 31/31 2.26 GB 0.0 6.2 5.2 1.0 6.1 5.1 0.2 1.2 213.5 210.7 29.82 27.23 3 9.939 5433K 63K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.1 2.0 253.3 253.1 1.49 1.44 2 0.746 383K 191 0.0 0.0 L3 20/0 996.94 MB 1.0 4.2 2.8 1.4 4.2 2.8 0.4 1.5 182.2 181.8 23.85 19.46 11 2.168 4415K 11K 0.0 0.0 L4 180/0 9.69 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.1 128.3 128.0 19.12 11.51 35 0.546 2416K 2377 0.0 0.0 L5 1076/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/48 104.52 GB 0.0 20.7 10.5 10.2 29.1 18.9 7.6 3.4 162.3 228.0 130.77 110.55 197 0.664 20M 88K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.7 10.5 10.2 29.1 18.9 7.5 3.4 162.3 228.0 130.77 110.55 197 0.664 20M 88K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.7 10.5 10.2 20.6 10.4 0.0 0.0 203.6 202.5 104.27 88.60 76 1.372 20M 88K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 328.0 26.50 21.95 121 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.7 total, 42.5 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.11 GB write, 698.46 MB/s write, 20.73 GB read, 497.35 MB/s read, 130.8 seconds Interval compaction: 29.11 GB write, 701.39 MB/s write, 20.73 GB read, 499.44 MB/s read, 130.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 47, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3407600 Average: 2.6955 StdDev: 25.41 Min: 0 Median: 1.4787 Max: 8104 Percentiles: P50: 1.48 P75: 1.88 P99: 6.75 P99.9: 128.36 P99.99: 332.43 ------------------------------------------------------ [ 0, 1 ] 688639 20.209% 20.209% #### ( 1, 2 ] 2120791 62.237% 82.446% ############ ( 2, 3 ] 335135 9.835% 92.281% ## ( 3, 4 ] 127975 3.756% 96.037% # ( 4, 6 ] 96208 2.823% 98.860% # ( 6, 10 ] 25595 0.751% 99.611% ( 10, 15 ] 5298 0.155% 99.766% ( 15, 22 ] 879 0.026% 99.792% ( 22, 34 ] 60 0.002% 99.794% ( 34, 51 ] 28 0.001% 99.795% ( 51, 76 ] 102 0.003% 99.798% ( 76, 110 ] 2644 0.078% 99.875% ( 110, 170 ] 2740 0.080% 99.956% ( 170, 250 ] 826 0.024% 99.980% ( 250, 380 ] 535 0.016% 99.996% ( 380, 580 ] 463 0.014% 100.009% ( 580, 870 ] 240 0.007% 100.016% ( 870, 1300 ] 111 0.003% 100.020% ( 1300, 1900 ] 55 0.002% 100.021% ( 1900, 2900 ] 54 0.002% 100.023% ( 2900, 4400 ] 47 0.001% 100.024% ( 4400, 6600 ] 14 0.000% 100.025% ( 6600, 9900 ] 6 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 1047358 Average: 5.5168 StdDev: 87.04 Min: 0 Median: 1.8283 Max: 10363 Percentiles: P50: 1.83 P75: 2.71 P99: 9.37 P99.9: 149.23 P99.99: 375.48 ------------------------------------------------------ [ 0, 1 ] 37641 3.594% 3.594% # ( 1, 2 ] 586776 56.024% 59.618% ########### ( 2, 3 ] 226522 21.628% 81.246% #### ( 3, 4 ] 85517 8.165% 89.411% ## ( 4, 6 ] 79758 7.615% 97.026% ## ( 6, 10 ] 24529 2.342% 99.368% ( 10, 15 ] 4199 0.401% 99.769% ( 15, 22 ] 513 0.049% 99.818% ( 22, 34 ] 35 0.003% 99.822% ( 34, 51 ] 17 0.002% 99.823% ( 51, 76 ] 28 0.003% 99.826% ( 76, 110 ] 403 0.038% 99.864% ( 110, 170 ] 570 0.054% 99.919% ( 170, 250 ] 364 0.035% 99.954% ( 250, 380 ] 395 0.038% 99.991% ( 380, 580 ] 439 0.042% 100.033% ( 580, 870 ] 339 0.032% 100.066% ( 870, 1300 ] 240 0.023% 100.089% ( 1300, 1900 ] 110 0.011% 100.099% ( 1900, 2900 ] 164 0.016% 100.115% ( 2900, 4400 ] 215 0.021% 100.135% ( 4400, 6600 ] 66 0.006% 100.141% ( 6600, 9900 ] 20 0.002% 100.143% ( 9900, 14000 ] 3 0.000% 100.144% ** Level 2 read latency histogram (micros): Count: 95914 Average: 2.0229 StdDev: 7.20 Min: 1 Median: 1.4001 Max: 1454 Percentiles: P50: 1.40 P75: 1.80 P99: 5.51 P99.9: 10.86 P99.99: 23.63 ------------------------------------------------------ [ 0, 1 ] 23918 24.937% 24.937% ##### ( 1, 2 ] 60088 62.648% 87.585% ############# ( 2, 3 ] 6973 7.270% 94.855% # ( 3, 4 ] 2753 2.870% 97.725% # ( 4, 6 ] 1620 1.689% 99.414% ( 6, 10 ] 450 0.469% 99.883% ( 10, 15 ] 94 0.098% 99.981% ( 15, 22 ] 8 0.008% 99.990% ( 22, 34 ] 3 0.003% 99.993% ( 34, 51 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 848044 Average: 6.5522 StdDev: 99.61 Min: 0 Median: 1.9216 Max: 10546 Percentiles: P50: 1.92 P75: 2.88 P99: 9.26 P99.9: 63.42 P99.99: 223.99 ------------------------------------------------------ [ 0, 1 ] 21131 2.492% 2.492% ( 1, 2 ] 437160 51.549% 54.041% ########## ( 2, 3 ] 201647 23.778% 77.819% ##### ( 3, 4 ] 82532 9.732% 87.551% ## ( 4, 6 ] 82827 9.767% 97.318% ## ( 6, 10 ] 17530 2.067% 99.385% ( 10, 15 ] 3822 0.451% 99.836% ( 15, 22 ] 469 0.055% 99.891% ( 22, 34 ] 52 0.006% 99.897% ( 34, 51 ] 19 0.002% 99.899% ( 51, 76 ] 14 0.002% 99.901% ( 76, 110 ] 150 0.018% 99.919% ( 110, 170 ] 370 0.044% 99.962% ( 170, 250 ] 350 0.041% 100.003% ( 250, 380 ] 344 0.041% 100.044% ( 380, 580 ] 402 0.047% 100.091% ( 580, 870 ] 363 0.043% 100.134% ( 870, 1300 ] 245 0.029% 100.163% ( 1300, 1900 ] 153 0.018% 100.181% ( 1900, 2900 ] 221 0.026% 100.207% ( 2900, 4400 ] 257 0.030% 100.237% ( 4400, 6600 ] 73 0.009% 100.246% ( 6600, 9900 ] 13 0.002% 100.248% ( 9900, 14000 ] 2 0.000% 100.248% ** Level 4 read latency histogram (micros): Count: 34314 Average: 71.0348 StdDev: 375.94 Min: 0 Median: 2.0120 Max: 11471 Percentiles: P50: 2.01 P75: 3.28 P99: 1830.08 P99.9: 4319.02 P99.99: 6001.64 ------------------------------------------------------ [ 0, 1 ] 797 2.323% 2.323% ( 1, 2 ] 16269 47.412% 49.735% ######### ( 2, 3 ] 7566 22.049% 71.784% #### ( 3, 4 ] 3949 11.508% 83.293% ## ( 4, 6 ] 2384 6.948% 90.240% # ( 6, 10 ] 863 2.515% 92.755% # ( 10, 15 ] 181 0.527% 93.283% ( 15, 22 ] 32 0.093% 93.376% ( 22, 34 ] 6 0.017% 93.393% ( 34, 51 ] 1 0.003% 93.396% ( 51, 76 ] 1 0.003% 93.399% ( 76, 110 ] 23 0.067% 93.466% ( 110, 170 ] 130 0.379% 93.845% ( 170, 250 ] 223 0.650% 94.495% ( 250, 380 ] 243 0.708% 95.203% ( 380, 580 ] 379 1.105% 96.308% ( 580, 870 ] 405 1.180% 97.488% ( 870, 1300 ] 351 1.023% 98.511% ( 1300, 1900 ] 190 0.554% 99.065% ( 1900, 2900 ] 141 0.411% 99.475% ( 2900, 4400 ] 154 0.449% 99.924% ( 4400, 6600 ] 31 0.090% 100.015% ( 6600, 9900 ] 3 0.009% 100.023% ( 9900, 14000 ] 1 0.003% 100.026% ** Level 5 read latency histogram (micros): Count: 180 Average: 1258.1722 StdDev: 1458.30 Min: 84 Median: 670.6250 Max: 9611 Percentiles: P50: 670.62 P75: 1864.71 P99: 6930.00 P99.9: 9603.00 P99.99: 9611.00 ------------------------------------------------------ ( 76, 110 ] 18 10.000% 10.000% ## ( 110, 170 ] 26 14.444% 24.444% ### ( 170, 250 ] 9 5.000% 29.444% # ( 250, 380 ] 11 6.111% 35.556% # ( 380, 580 ] 21 11.667% 47.222% ## ( 580, 870 ] 16 8.889% 56.111% ## ( 870, 1300 ] 18 10.000% 66.111% ## ( 1300, 1900 ] 17 9.444% 75.556% ## ( 1900, 2900 ] 19 10.556% 86.111% ## ( 2900, 4400 ] 18 10.000% 96.111% ## ( 4400, 6600 ] 5 2.778% 98.889% # ( 6600, 9900 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 42.7 total, 3.7 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 207.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.321 H:M:S, 42.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 267.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.029 H:M:S, 28.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.348 micros/op 157530 ops/sec 60.128 seconds 9471999 operations; 152.6 MB/s Microseconds per write: Count: 9471999 Average: 6.3479 StdDev: 384.40 Min: 0 Median: 1.7308 Max: 490983 Percentiles: P50: 1.73 P75: 2.76 P99: 9.46 P99.9: 1203.34 P99.99: 2747.67 ------------------------------------------------------ [ 0, 1 ] 1320309 13.939% 13.939% ### ( 1, 2 ] 4673680 49.342% 63.281% ########## ( 2, 3 ] 1465841 15.476% 78.757% ### ( 3, 4 ] 1300949 13.735% 92.491% ### ( 4, 6 ] 518175 5.471% 97.962% # ( 6, 10 ] 113640 1.200% 99.162% ( 10, 15 ] 37186 0.393% 99.554% ( 15, 22 ] 8798 0.093% 99.647% ( 22, 34 ] 1837 0.019% 99.667% ( 34, 51 ] 283 0.003% 99.670% ( 51, 76 ] 41 0.000% 99.670% ( 76, 110 ] 6064 0.064% 99.734% ( 110, 170 ] 3048 0.032% 99.766% ( 170, 250 ] 305 0.003% 99.769% ( 250, 380 ] 174 0.002% 99.771% ( 380, 580 ] 37 0.000% 99.772% ( 580, 870 ] 34 0.000% 99.772% ( 870, 1300 ] 15642 0.165% 99.937% ( 1300, 1900 ] 33 0.000% 99.937% ( 1900, 2900 ] 5870 0.062% 99.999% ( 2900, 4400 ] 24 0.000% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 189913 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9471999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9775102968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 482 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34018586 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27415013348 rocksdb.compact.write.bytes COUNT : 27238590947 rocksdb.flush.write.bytes COUNT : 9776293734 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 263 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9697624064 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3914752 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27501361308 rocksdb.non.last.level.read.count COUNT : 6646439 rocksdb.block.checksum.compute.count COUNT : 6645519 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.375975 P95 : 3.931074 P99 : 8.058775 P100 : 490980.000000 COUNT : 9471999 SUM : 55722414 rocksdb.compaction.times.micros P50 : 909583.333333 P95 : 3754000.000000 P99 : 15680000.000000 P100 : 16384960.000000 COUNT : 79 SUM : 107319088 rocksdb.compaction.times.cpu_micros P50 : 888333.333333 P95 : 2935000.000000 P99 : 15381183.000000 P100 : 15381183.000000 COUNT : 79 SUM : 91597893 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 710.967742 P95 : 4766.666667 P99 : 29700.000000 P100 : 52136.000000 COUNT : 130 SUM : 217587 rocksdb.compaction.outfile.sync.micros P50 : 1053.466667 P95 : 17636.363636 P99 : 46600.000000 P100 : 92985.000000 COUNT : 340 SUM : 1305123 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 98.000000 P95 : 1732.000000 P99 : 4016.000000 P100 : 4471.000000 COUNT : 228 SUM : 74716 rocksdb.table.open.io.micros P50 : 1329.629630 P95 : 7408.500000 P99 : 12756.333333 P100 : 17024.000000 COUNT : 482 SUM : 968660 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.604570 P95 : 7.629115 P99 : 11.760780 P100 : 11477.000000 COUNT : 6644225 SUM : 40465140 rocksdb.read.block.get.micros P50 : 386.666667 P95 : 3284.782609 P99 : 5199.333333 P100 : 9777.000000 COUNT : 964 SUM : 783659 rocksdb.write.raw.block.micros P50 : 0.513125 P95 : 0.974938 P99 : 2.883963 P100 : 14872.000000 COUNT : 8965350 SUM : 17870000 rocksdb.numfiles.in.singlecompaction P50 : 3.083333 P95 : 5.850000 P99 : 21.580000 P100 : 44.000000 COUNT : 106 SUM : 400 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560982 P95 : 1188.620900 P99 : 2565.244027 P100 : 490794.000000 COUNT : 198967 SUM : 34036856 rocksdb.sst.read.micros P50 : 1.549335 P95 : 4.456295 P99 : 8.655260 P100 : 11471.000000 COUNT : 6646749 SUM : 26760522 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9471999 SUM : 9775102968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208481.012658 P95 : 463125.000000 P99 : 643519.000000 P100 : 643519.000000 COUNT : 130 SUM : 28322516 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 299 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0