[2024-11-20 02:40:48.924083] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-20 02:40:48.924350] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3726677 ] Set seed to 1732066848917400 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 02:40:49.018662] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 02:40:49.056280] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 02:40:49.056325] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3726677' to capture a snapshot of events at runtime. [2024-11-20 02:40:49.056336] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 02:40:49.056347] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 02:40:49.056355] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3726677 for offline analysis/debug. [2024-11-20 02:40:49.056434] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 02:40:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-02:40:56 ... thread 0: (1000000,1000000) ops and (352970.5,352970.5) ops/second in (2.833098,2.833098) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.00 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 349.2 2.35 2.12 12 0.195 0 0 0.0 0.0 L2 3/2 251.74 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 9/0 804.73 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 97.6 309.1 3.87 3.59 14 0.277 383K 204 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 97.6 309.1 3.87 3.59 14 0.277 383K 204 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 349.2 2.35 2.12 12 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 389.96 MB/s write, 0.37 GB read, 123.15 MB/s read, 3.9 seconds Interval compaction: 1.17 GB write, 422.10 MB/s write, 0.37 GB read, 133.30 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 102453 Average: 1.9162 StdDev: 18.57 Min: 0 Median: 1.2271 Max: 3341 Percentiles: P50: 1.23 P75: 1.67 P99: 3.98 P99.9: 9.99 P99.99: 307.03 ------------------------------------------------------ [ 0, 1 ] 38088 37.176% 37.176% ####### ( 1, 2 ] 57857 56.472% 93.648% ########### ( 2, 3 ] 4037 3.940% 97.588% # ( 3, 4 ] 1477 1.442% 99.030% ( 4, 6 ] 656 0.640% 99.670% ( 6, 10 ] 237 0.231% 99.901% ( 10, 15 ] 57 0.056% 99.957% ( 15, 22 ] 19 0.019% 99.976% ( 22, 34 ] 2 0.002% 99.978% ( 110, 170 ] 8 0.008% 99.985% ( 170, 250 ] 4 0.004% 99.989% ( 250, 380 ] 4 0.004% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 2 0.002% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 808.2000 StdDev: 613.88 Min: 238 Median: 480.0000 Max: 1564 Percentiles: P50: 480.00 P75: 1525.00 P99: 1564.00 P99.9: 1564.00 P99.99: 1564.00 ------------------------------------------------------ ( 170, 250 ] 1 20.000% 20.000% #### ( 250, 380 ] 1 20.000% 40.000% #### ( 380, 580 ] 1 20.000% 60.000% #### ( 1300, 1900 ] 2 40.000% 100.000% ######## ** Level 2 read latency histogram (micros): Count: 50295 Average: 1.8659 StdDev: 7.24 Min: 0 Median: 1.2580 Max: 1243 Percentiles: P50: 1.26 P75: 1.69 P99: 5.21 P99.9: 9.94 P99.99: 313.08 ------------------------------------------------------ [ 0, 1 ] 17677 35.147% 35.147% ####### ( 1, 2 ] 28962 57.584% 92.731% ############ ( 2, 3 ] 1894 3.766% 96.497% # ( 3, 4 ] 913 1.815% 98.312% ( 4, 6 ] 575 1.143% 99.455% ( 6, 10 ] 228 0.453% 99.909% ( 10, 15 ] 33 0.066% 99.974% ( 15, 22 ] 5 0.010% 99.984% ( 22, 34 ] 1 0.002% 99.986% ( 51, 76 ] 2 0.004% 99.990% ( 250, 380 ] 2 0.004% 99.994% ( 380, 580 ] 2 0.004% 99.998% ( 580, 870 ] 1 0.002% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 40 Average: 1535.7000 StdDev: 1238.65 Min: 61 Median: 1300.0000 Max: 5618 Percentiles: P50: 1300.00 P75: 2042.86 P99: 5618.00 P99.9: 5618.00 P99.99: 5618.00 ------------------------------------------------------ ( 51, 76 ] 1 2.500% 2.500% # ( 110, 170 ] 1 2.500% 5.000% # ( 170, 250 ] 2 5.000% 10.000% # ( 380, 580 ] 4 10.000% 20.000% ## ( 580, 870 ] 8 20.000% 40.000% #### ( 870, 1300 ] 4 10.000% 50.000% ## ( 1300, 1900 ] 9 22.500% 72.500% ##### ( 1900, 2900 ] 7 17.500% 90.000% #### ( 2900, 4400 ] 2 5.000% 95.000% # ( 4400, 6600 ] 2 5.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1623.2286 StdDev: 1266.49 Min: 338 Median: 1106.5000 Max: 4780 Percentiles: P50: 1106.50 P75: 2350.00 P99: 4780.00 P99.9: 4780.00 P99.99: 4780.00 ------------------------------------------------------ ( 250, 380 ] 2 5.714% 5.714% # ( 380, 580 ] 2 5.714% 11.429% # ( 580, 870 ] 8 22.857% 34.286% ##### ( 870, 1300 ] 10 28.571% 62.857% ###### ( 1300, 1900 ] 2 5.714% 68.571% # ( 1900, 2900 ] 5 14.286% 82.857% ### ( 2900, 4400 ] 4 11.429% 94.286% ## ( 4400, 6600 ] 2 5.714% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 320.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.232 H:M:S, 7.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 347.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.232 H:M:S, 8.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-02:40:59 ... thread 0: (1000000,2000000) ops and (326132.2,339021.0) ops/second in (3.066241,5.899339) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.17 GB 18.9 0.2 0.0 0.2 2.0 1.8 0.0 1.1 40.5 334.2 6.22 5.67 27 0.230 255K 234 0.0 0.0 L1 1/1 3.06 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 240.3 239.8 1.57 1.53 1 1.573 383K 616 0.0 0.0 L2 2/1 54.83 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 19/9 1.12 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 232.7 232.7 1.07 1.01 1 1.073 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 155.2 155.2 1.45 1.08 1 1.449 228K 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/22 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.2 1.8 125.2 279.4 11.84 10.76 32 0.370 1505K 1054 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.1 1.8 125.2 279.4 11.84 10.76 32 0.370 1505K 1054 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 224.5 224.4 6.60 6.05 6 1.100 1505K 1054 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.7 5.24 4.70 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 539.25 MB/s write, 1.45 GB read, 241.64 MB/s read, 11.8 seconds Interval compaction: 3.23 GB write, 560.60 MB/s write, 1.45 GB read, 251.21 MB/s read, 11.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 361228 Average: 2.2056 StdDev: 11.61 Min: 0 Median: 1.4974 Max: 3341 Percentiles: P50: 1.50 P75: 1.88 P99: 5.55 P99.9: 9.54 P99.99: 13.10 ------------------------------------------------------ [ 0, 1 ] 63961 17.707% 17.707% #### ( 1, 2 ] 234504 64.919% 82.625% ############# ( 2, 3 ] 38383 10.626% 93.251% ## ( 3, 4 ] 14354 3.974% 97.224% # ( 4, 6 ] 8264 2.288% 99.512% ( 6, 10 ] 1587 0.439% 99.952% ( 10, 15 ] 229 0.063% 100.015% ( 15, 22 ] 28 0.008% 100.023% ( 22, 34 ] 8 0.002% 100.025% ( 51, 76 ] 3 0.001% 100.026% ( 110, 170 ] 11 0.003% 100.029% ( 170, 250 ] 13 0.004% 100.032% ( 250, 380 ] 12 0.003% 100.036% ( 380, 580 ] 1 0.000% 100.036% ( 580, 870 ] 4 0.001% 100.037% ( 870, 1300 ] 6 0.002% 100.039% ( 1300, 1900 ] 2 0.001% 100.039% ( 1900, 2900 ] 3 0.001% 100.040% ( 2900, 4400 ] 2 0.001% 100.041% ** Level 1 read latency histogram (micros): Count: 31 Average: 319.0000 StdDev: 654.35 Min: 0 Median: 1.9500 Max: 3132 Percentiles: P50: 1.95 P75: 308.50 P99: 3132.00 P99.9: 3132.00 P99.99: 3132.00 ------------------------------------------------------ [ 0, 1 ] 6 19.355% 19.355% #### ( 1, 2 ] 10 32.258% 51.613% ###### ( 2, 3 ] 1 3.226% 54.839% # ( 4, 6 ] 1 3.226% 58.065% # ( 110, 170 ] 1 3.226% 61.290% # ( 170, 250 ] 2 6.452% 67.742% # ( 250, 380 ] 5 16.129% 83.871% ### ( 380, 580 ] 1 3.226% 87.097% # ( 870, 1300 ] 1 3.226% 90.323% # ( 1300, 1900 ] 2 6.452% 96.774% # ( 2900, 4400 ] 1 3.226% 100.000% # ** Level 2 read latency histogram (micros): Count: 95708 Average: 2.0569 StdDev: 5.31 Min: 0 Median: 1.4252 Max: 1243 Percentiles: P50: 1.43 P75: 1.82 P99: 5.61 P99.9: 10.28 P99.99: 41.30 ------------------------------------------------------ [ 0, 1 ] 22374 23.377% 23.377% ##### ( 1, 2 ] 59920 62.607% 85.984% ############# ( 2, 3 ] 7668 8.012% 93.996% ## ( 3, 4 ] 3136 3.277% 97.273% # ( 4, 6 ] 2053 2.145% 99.418% ( 6, 10 ] 457 0.477% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 185179 Average: 3.1813 StdDev: 31.88 Min: 1 Median: 1.6237 Max: 5618 Percentiles: P50: 1.62 P75: 2.07 P99: 8.34 P99.9: 149.21 P99.99: 368.92 ------------------------------------------------------ [ 0, 1 ] 19293 10.419% 10.419% ## ( 1, 2 ] 117510 63.458% 73.876% ############# ( 2, 3 ] 30467 16.453% 90.329% ### ( 3, 4 ] 8334 4.501% 94.829% # ( 4, 6 ] 6250 3.375% 98.204% # ( 6, 10 ] 2522 1.362% 99.566% ( 10, 15 ] 301 0.163% 99.729% ( 15, 22 ] 80 0.043% 99.772% ( 22, 34 ] 15 0.008% 99.780% ( 34, 51 ] 3 0.002% 99.782% ( 51, 76 ] 2 0.001% 99.783% ( 76, 110 ] 109 0.059% 99.842% ( 110, 170 ] 165 0.089% 99.931% ( 170, 250 ] 61 0.033% 99.964% ( 250, 380 ] 53 0.029% 99.992% ( 380, 580 ] 30 0.016% 100.009% ( 580, 870 ] 27 0.015% 100.023% ( 870, 1300 ] 7 0.004% 100.027% ( 1300, 1900 ] 10 0.005% 100.032% ( 1900, 2900 ] 7 0.004% 100.036% ( 2900, 4400 ] 2 0.001% 100.037% ( 4400, 6600 ] 2 0.001% 100.038% ** Level 4 read latency histogram (micros): Count: 325 Average: 180.2615 StdDev: 651.79 Min: 0 Median: 1.7177 Max: 4780 Percentiles: P50: 1.72 P75: 10.31 P99: 3931.25 P99.9: 4780.00 P99.99: 4780.00 ------------------------------------------------------ [ 0, 1 ] 57 17.538% 17.538% #### ( 1, 2 ] 147 45.231% 62.769% ######### ( 2, 3 ] 22 6.769% 69.538% # ( 3, 4 ] 3 0.923% 70.462% ( 4, 6 ] 3 0.923% 71.385% ( 6, 10 ] 9 2.769% 74.154% # ( 10, 15 ] 44 13.538% 87.692% ### ( 15, 22 ] 3 0.923% 88.615% ( 110, 170 ] 1 0.308% 88.923% ( 250, 380 ] 2 0.615% 89.538% ( 380, 580 ] 3 0.923% 90.462% ( 580, 870 ] 8 2.462% 92.923% ( 870, 1300 ] 10 3.077% 96.000% # ( 1300, 1900 ] 2 0.615% 96.615% ( 1900, 2900 ] 5 1.538% 98.154% ( 2900, 4400 ] 4 1.231% 99.385% ( 4400, 6600 ] 2 0.615% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.627 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-02:41:02 ... thread 0: (1000000,3000000) ops and (315983.0,330977.3) ops/second in (3.164727,9.064066) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.41 GB 0.0 1.0 0.0 1.0 3.8 2.7 0.0 1.4 88.0 315.6 12.17 11.22 43 0.283 1087K 1167 0.0 0.0 L1 3/3 210.50 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 234.2 233.6 4.59 4.45 2 2.293 1090K 2655 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 22/0 912.28 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 232.0 231.5 8.36 7.84 6 1.393 1969K 4070 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 155.2 155.2 1.45 1.08 1 1.449 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/14 98.84 GB 0.0 4.6 2.2 2.4 7.3 4.9 3.4 2.7 166.8 265.2 28.09 26.07 54 0.520 4758K 8096 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 2.2 2.4 7.3 4.9 3.3 2.7 166.8 265.2 28.09 26.07 54 0.520 4758K 8096 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 2.2 2.4 4.6 2.2 0.0 0.0 233.2 232.7 20.10 18.95 15 1.340 4758K 8096 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 347.0 7.99 7.12 39 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.28 GB write, 801.08 MB/s write, 4.58 GB read, 503.92 MB/s read, 28.1 seconds Interval compaction: 7.28 GB write, 821.73 MB/s write, 4.58 GB read, 516.90 MB/s read, 28.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 665561 Average: 2.3181 StdDev: 11.42 Min: 0 Median: 1.5622 Max: 3341 Percentiles: P50: 1.56 P75: 1.95 P99: 5.71 P99.9: 9.55 P99.99: 12.11 ------------------------------------------------------ [ 0, 1 ] 89172 13.398% 13.398% ### ( 1, 2 ] 433349 65.110% 78.508% ############# ( 2, 3 ] 85369 12.827% 91.335% ### ( 3, 4 ] 32980 4.955% 96.290% # ( 4, 6 ] 21151 3.178% 99.468% # ( 6, 10 ] 3242 0.487% 99.955% ( 10, 15 ] 554 0.083% 100.038% ( 15, 22 ] 63 0.009% 100.048% ( 22, 34 ] 14 0.002% 100.050% ( 34, 51 ] 3 0.000% 100.050% ( 51, 76 ] 4 0.001% 100.051% ( 110, 170 ] 13 0.002% 100.053% ( 170, 250 ] 23 0.003% 100.056% ( 250, 380 ] 19 0.003% 100.059% ( 380, 580 ] 3 0.000% 100.060% ( 580, 870 ] 9 0.001% 100.061% ( 870, 1300 ] 9 0.001% 100.063% ( 1300, 1900 ] 3 0.000% 100.063% ( 1900, 2900 ] 6 0.001% 100.064% ( 2900, 4400 ] 3 0.000% 100.064% ** Level 1 read latency histogram (micros): Count: 246062 Average: 2.7117 StdDev: 14.67 Min: 0 Median: 1.7116 Max: 3759 Percentiles: P50: 1.71 P75: 2.40 P99: 6.84 P99.9: 9.93 P99.99: 12.22 ------------------------------------------------------ [ 0, 1 ] 14095 5.728% 5.728% # ( 1, 2 ] 153085 62.214% 67.942% ############ ( 2, 3 ] 43796 17.799% 85.741% #### ( 3, 4 ] 17259 7.014% 92.755% # ( 4, 6 ] 14760 5.998% 98.754% # ( 6, 10 ] 2874 1.168% 99.922% ( 10, 15 ] 379 0.154% 100.076% ( 15, 22 ] 85 0.035% 100.110% ( 22, 34 ] 7 0.003% 100.113% ( 51, 76 ] 5 0.002% 100.115% ( 76, 110 ] 10 0.004% 100.119% ( 110, 170 ] 48 0.020% 100.139% ( 170, 250 ] 12 0.005% 100.143% ( 250, 380 ] 24 0.010% 100.153% ( 380, 580 ] 9 0.004% 100.157% ( 580, 870 ] 4 0.002% 100.158% ( 870, 1300 ] 3 0.001% 100.160% ( 1300, 1900 ] 2 0.001% 100.161% ( 1900, 2900 ] 2 0.001% 100.161% ( 2900, 4400 ] 2 0.001% 100.162% ** Level 2 read latency histogram (micros): Count: 95906 Average: 2.0585 StdDev: 5.30 Min: 0 Median: 1.4263 Max: 1243 Percentiles: P50: 1.43 P75: 1.83 P99: 5.61 P99.9: 10.27 P99.99: 40.96 ------------------------------------------------------ [ 0, 1 ] 22375 23.330% 23.330% ##### ( 1, 2 ] 60003 62.564% 85.895% ############# ( 2, 3 ] 7756 8.087% 93.982% ## ( 3, 4 ] 3146 3.280% 97.262% # ( 4, 6 ] 2068 2.156% 99.418% ( 6, 10 ] 458 0.478% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239534 Average: 3.2727 StdDev: 29.71 Min: 0 Median: 1.6413 Max: 5618 Percentiles: P50: 1.64 P75: 2.14 P99: 8.56 P99.9: 184.08 P99.99: 505.58 ------------------------------------------------------ [ 0, 1 ] 22603 9.436% 9.436% ## ( 1, 2 ] 151512 63.253% 72.689% ############# ( 2, 3 ] 39605 16.534% 89.223% ### ( 3, 4 ] 12310 5.139% 94.362% # ( 4, 6 ] 8877 3.706% 98.068% # ( 6, 10 ] 3487 1.456% 99.524% ( 10, 15 ] 396 0.165% 99.689% ( 15, 22 ] 95 0.040% 99.729% ( 22, 34 ] 21 0.009% 99.738% ( 34, 51 ] 5 0.002% 99.740% ( 51, 76 ] 4 0.002% 99.742% ( 76, 110 ] 155 0.065% 99.806% ( 110, 170 ] 203 0.085% 99.891% ( 170, 250 ] 122 0.051% 99.942% ( 250, 380 ] 78 0.033% 99.975% ( 380, 580 ] 59 0.025% 99.999% ( 580, 870 ] 42 0.018% 100.017% ( 870, 1300 ] 9 0.004% 100.020% ( 1300, 1900 ] 11 0.005% 100.025% ( 1900, 2900 ] 7 0.003% 100.028% ( 2900, 4400 ] 2 0.001% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 325 Average: 180.2615 StdDev: 651.79 Min: 0 Median: 1.7177 Max: 4780 Percentiles: P50: 1.72 P75: 10.31 P99: 3931.25 P99.9: 4780.00 P99.99: 4780.00 ------------------------------------------------------ [ 0, 1 ] 57 17.538% 17.538% #### ( 1, 2 ] 147 45.231% 62.769% ######### ( 2, 3 ] 22 6.769% 69.538% # ( 3, 4 ] 3 0.923% 70.462% ( 4, 6 ] 3 0.923% 71.385% ( 6, 10 ] 9 2.769% 74.154% # ( 10, 15 ] 44 13.538% 87.692% ### ( 15, 22 ] 3 0.923% 88.615% ( 110, 170 ] 1 0.308% 88.923% ( 250, 380 ] 2 0.615% 89.538% ( 380, 580 ] 3 0.923% 90.462% ( 580, 870 ] 8 2.462% 92.923% ( 870, 1300 ] 10 3.077% 96.000% # ( 1300, 1900 ] 2 0.615% 96.615% ( 1900, 2900 ] 5 1.538% 98.154% ( 2900, 4400 ] 4 1.231% 99.385% ( 4400, 6600 ] 2 0.615% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 699.7333 StdDev: 891.11 Min: 80 Median: 170.0000 Max: 4182 Percentiles: P50: 170.00 P75: 1128.00 P99: 3950.00 P99.9: 4182.00 P99.99: 4182.00 ------------------------------------------------------ ( 76, 110 ] 17 28.333% 28.333% ###### ( 110, 170 ] 13 21.667% 50.000% #### ( 170, 250 ] 2 3.333% 53.333% # ( 250, 380 ] 5 8.333% 61.667% ## ( 380, 580 ] 2 3.333% 65.000% # ( 580, 870 ] 3 5.000% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 7 11.667% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 317.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.097 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 310.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.470 H:M:S, 14.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-02:41:05 ... thread 0: (1000000,4000000) ops and (321787.6,328631.0) ops/second in (3.107640,12.171706) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.40 GB 94.4 1.8 0.0 1.8 5.5 3.7 0.0 1.5 103.9 311.5 18.20 16.86 60 0.303 1918K 2061 0.0 0.0 L1 3/3 210.50 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 234.2 233.6 4.59 4.45 2 2.293 1090K 2655 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 22/0 912.28 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 232.0 231.5 8.36 7.84 6 1.393 1969K 4070 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 155.2 155.2 1.45 1.08 1 1.449 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/14 99.82 GB 0.0 5.4 2.2 3.2 9.1 5.9 3.4 2.5 161.4 271.9 34.11 31.71 71 0.480 5590K 8990 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.2 3.2 9.1 5.9 3.3 2.5 161.4 271.9 34.11 31.71 71 0.480 5590K 8990 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.2 3.2 5.4 2.2 0.0 0.0 237.1 236.7 23.22 22.01 18 1.290 5590K 8990 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 346.9 10.90 9.70 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.06 GB write, 747.61 MB/s write, 5.38 GB read, 443.71 MB/s read, 34.1 seconds Interval compaction: 9.06 GB write, 761.96 MB/s write, 5.38 GB read, 452.23 MB/s read, 34.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1074352 Average: 2.2840 StdDev: 11.01 Min: 0 Median: 1.5436 Max: 3341 Percentiles: P50: 1.54 P75: 1.92 P99: 5.66 P99.9: 9.61 P99.99: 12.53 ------------------------------------------------------ [ 0, 1 ] 148155 13.790% 13.790% ### ( 1, 2 ] 715669 66.614% 80.404% ############# ( 2, 3 ] 129334 12.038% 92.443% ## ( 3, 4 ] 46883 4.364% 96.806% # ( 4, 6 ] 28473 2.650% 99.457% # ( 6, 10 ] 5279 0.491% 99.948% ( 10, 15 ] 897 0.083% 100.031% ( 15, 22 ] 87 0.008% 100.040% ( 22, 34 ] 17 0.002% 100.041% ( 34, 51 ] 6 0.001% 100.042% ( 51, 76 ] 23 0.002% 100.044% ( 76, 110 ] 55 0.005% 100.049% ( 110, 170 ] 47 0.004% 100.053% ( 170, 250 ] 39 0.004% 100.057% ( 250, 380 ] 32 0.003% 100.060% ( 380, 580 ] 7 0.001% 100.061% ( 580, 870 ] 16 0.001% 100.062% ( 870, 1300 ] 14 0.001% 100.063% ( 1300, 1900 ] 6 0.001% 100.064% ( 1900, 2900 ] 7 0.001% 100.065% ( 2900, 4400 ] 5 0.000% 100.065% ** Level 1 read latency histogram (micros): Count: 253193 Average: 2.7412 StdDev: 14.80 Min: 0 Median: 1.7071 Max: 3759 Percentiles: P50: 1.71 P75: 2.38 P99: 6.94 P99.9: 10.08 P99.99: 13.06 ------------------------------------------------------ [ 0, 1 ] 14885 5.879% 5.879% # ( 1, 2 ] 157988 62.398% 68.277% ############ ( 2, 3 ] 44708 17.658% 85.935% #### ( 3, 4 ] 17500 6.912% 92.847% # ( 4, 6 ] 14878 5.876% 98.723% # ( 6, 10 ] 2975 1.175% 99.898% ( 10, 15 ] 382 0.151% 100.049% ( 15, 22 ] 85 0.034% 100.082% ( 22, 34 ] 7 0.003% 100.085% ( 51, 76 ] 5 0.002% 100.087% ( 76, 110 ] 10 0.004% 100.091% ( 110, 170 ] 92 0.036% 100.127% ( 170, 250 ] 24 0.009% 100.137% ( 250, 380 ] 29 0.011% 100.148% ( 380, 580 ] 10 0.004% 100.152% ( 580, 870 ] 5 0.002% 100.154% ( 870, 1300 ] 3 0.001% 100.155% ( 1300, 1900 ] 2 0.001% 100.156% ( 1900, 2900 ] 2 0.001% 100.157% ( 2900, 4400 ] 2 0.001% 100.158% ** Level 2 read latency histogram (micros): Count: 95906 Average: 2.0585 StdDev: 5.30 Min: 0 Median: 1.4263 Max: 1243 Percentiles: P50: 1.43 P75: 1.83 P99: 5.61 P99.9: 10.27 P99.99: 40.96 ------------------------------------------------------ [ 0, 1 ] 22375 23.330% 23.330% ##### ( 1, 2 ] 60003 62.564% 85.895% ############# ( 2, 3 ] 7756 8.087% 93.982% ## ( 3, 4 ] 3146 3.280% 97.262% # ( 4, 6 ] 2068 2.156% 99.418% ( 6, 10 ] 458 0.478% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239534 Average: 3.2727 StdDev: 29.71 Min: 0 Median: 1.6413 Max: 5618 Percentiles: P50: 1.64 P75: 2.14 P99: 8.56 P99.9: 184.08 P99.99: 505.58 ------------------------------------------------------ [ 0, 1 ] 22603 9.436% 9.436% ## ( 1, 2 ] 151512 63.253% 72.689% ############# ( 2, 3 ] 39605 16.534% 89.223% ### ( 3, 4 ] 12310 5.139% 94.362% # ( 4, 6 ] 8877 3.706% 98.068% # ( 6, 10 ] 3487 1.456% 99.524% ( 10, 15 ] 396 0.165% 99.689% ( 15, 22 ] 95 0.040% 99.729% ( 22, 34 ] 21 0.009% 99.738% ( 34, 51 ] 5 0.002% 99.740% ( 51, 76 ] 4 0.002% 99.742% ( 76, 110 ] 155 0.065% 99.806% ( 110, 170 ] 203 0.085% 99.891% ( 170, 250 ] 122 0.051% 99.942% ( 250, 380 ] 78 0.033% 99.975% ( 380, 580 ] 59 0.025% 99.999% ( 580, 870 ] 42 0.018% 100.017% ( 870, 1300 ] 9 0.004% 100.020% ( 1300, 1900 ] 11 0.005% 100.025% ( 1900, 2900 ] 7 0.003% 100.028% ( 2900, 4400 ] 2 0.001% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 325 Average: 180.2615 StdDev: 651.79 Min: 0 Median: 1.7177 Max: 4780 Percentiles: P50: 1.72 P75: 10.31 P99: 3931.25 P99.9: 4780.00 P99.99: 4780.00 ------------------------------------------------------ [ 0, 1 ] 57 17.538% 17.538% #### ( 1, 2 ] 147 45.231% 62.769% ######### ( 2, 3 ] 22 6.769% 69.538% # ( 3, 4 ] 3 0.923% 70.462% ( 4, 6 ] 3 0.923% 71.385% ( 6, 10 ] 9 2.769% 74.154% # ( 10, 15 ] 44 13.538% 87.692% ### ( 15, 22 ] 3 0.923% 88.615% ( 110, 170 ] 1 0.308% 88.923% ( 250, 380 ] 2 0.615% 89.538% ( 380, 580 ] 3 0.923% 90.462% ( 580, 870 ] 8 2.462% 92.923% ( 870, 1300 ] 10 3.077% 96.000% # ( 1300, 1900 ] 2 0.615% 96.615% ( 1900, 2900 ] 5 1.538% 98.154% ( 2900, 4400 ] 4 1.231% 99.385% ( 4400, 6600 ] 2 0.615% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 699.7333 StdDev: 891.11 Min: 80 Median: 170.0000 Max: 4182 Percentiles: P50: 170.00 P75: 1128.00 P99: 3950.00 P99.9: 4182.00 P99.99: 4182.00 ------------------------------------------------------ ( 76, 110 ] 17 28.333% 28.333% ###### ( 110, 170 ] 13 21.667% 50.000% #### ( 170, 250 ] 2 3.333% 53.333% # ( 250, 380 ] 5 8.333% 61.667% ## ( 380, 580 ] 2 3.333% 65.000% # ( 580, 870 ] 3 5.000% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 7 11.667% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 317.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.498 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.401 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-02:41:08 ... thread 0: (1000000,5000000) ops and (312726.7,325322.0) ops/second in (3.197680,15.369386) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.21 GB 201.4 3.0 0.0 3.0 7.6 4.7 0.0 1.6 119.4 308.2 25.33 23.60 79 0.321 3070K 3286 0.0 0.0 L1 13/0 1.36 GB 139.8 2.4 2.2 0.2 2.4 2.2 0.2 1.1 232.3 231.2 10.68 10.31 3 3.559 2518K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 22/0 912.28 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 232.0 231.5 8.36 7.84 6 1.393 1969K 4070 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 155.2 155.2 1.45 1.08 1 1.449 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/4 100.79 GB 0.0 7.9 3.4 4.5 12.5 8.0 3.4 2.7 169.9 270.7 47.34 44.30 91 0.520 8169K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 3.4 4.5 12.5 8.0 3.3 2.7 169.9 270.7 47.34 44.30 91 0.520 8169K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 3.4 4.5 7.8 3.4 0.0 0.0 239.4 238.8 33.61 32.09 23 1.461 8169K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 348.7 13.73 12.22 68 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.51 GB write, 821.15 MB/s write, 7.86 GB read, 515.58 MB/s read, 47.3 seconds Interval compaction: 12.51 GB write, 833.64 MB/s write, 7.86 GB read, 523.42 MB/s read, 47.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 16, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1427788 Average: 2.2745 StdDev: 11.10 Min: 0 Median: 1.5294 Max: 3341 Percentiles: P50: 1.53 P75: 1.90 P99: 5.64 P99.9: 9.72 P99.99: 13.19 ------------------------------------------------------ [ 0, 1 ] 209247 14.655% 14.655% ### ( 1, 2 ] 953310 66.768% 81.424% ############# ( 2, 3 ] 163763 11.470% 92.893% ## ( 3, 4 ] 58726 4.113% 97.006% # ( 4, 6 ] 34653 2.427% 99.433% ( 6, 10 ] 7153 0.501% 99.934% ( 10, 15 ] 1242 0.087% 100.021% ( 15, 22 ] 105 0.007% 100.029% ( 22, 34 ] 21 0.001% 100.030% ( 34, 51 ] 8 0.001% 100.031% ( 51, 76 ] 24 0.002% 100.032% ( 76, 110 ] 82 0.006% 100.038% ( 110, 170 ] 103 0.007% 100.045% ( 170, 250 ] 75 0.005% 100.051% ( 250, 380 ] 55 0.004% 100.055% ( 380, 580 ] 23 0.002% 100.056% ( 580, 870 ] 23 0.002% 100.058% ( 870, 1300 ] 19 0.001% 100.059% ( 1300, 1900 ] 10 0.001% 100.060% ( 1900, 2900 ] 10 0.001% 100.061% ( 2900, 4400 ] 5 0.000% 100.061% ** Level 1 read latency histogram (micros): Count: 299573 Average: 2.8300 StdDev: 17.89 Min: 0 Median: 1.6866 Max: 3759 Percentiles: P50: 1.69 P75: 2.30 P99: 7.25 P99.9: 11.95 P99.99: 15.40 ------------------------------------------------------ [ 0, 1 ] 19379 6.469% 6.469% # ( 1, 2 ] 189932 63.401% 69.870% ############# ( 2, 3 ] 50936 17.003% 86.873% ### ( 3, 4 ] 19192 6.406% 93.279% # ( 4, 6 ] 15985 5.336% 98.615% # ( 6, 10 ] 3680 1.228% 99.843% ( 10, 15 ] 434 0.145% 99.988% ( 15, 22 ] 88 0.029% 100.018% ( 22, 34 ] 7 0.002% 100.020% ( 51, 76 ] 10 0.003% 100.023% ( 76, 110 ] 55 0.018% 100.042% ( 110, 170 ] 122 0.041% 100.082% ( 170, 250 ] 49 0.016% 100.099% ( 250, 380 ] 45 0.015% 100.114% ( 380, 580 ] 25 0.008% 100.122% ( 580, 870 ] 12 0.004% 100.126% ( 870, 1300 ] 9 0.003% 100.129% ( 1300, 1900 ] 6 0.002% 100.131% ( 1900, 2900 ] 4 0.001% 100.133% ( 2900, 4400 ] 2 0.001% 100.133% ** Level 2 read latency histogram (micros): Count: 95906 Average: 2.0585 StdDev: 5.30 Min: 0 Median: 1.4263 Max: 1243 Percentiles: P50: 1.43 P75: 1.83 P99: 5.61 P99.9: 10.27 P99.99: 40.96 ------------------------------------------------------ [ 0, 1 ] 22375 23.330% 23.330% ##### ( 1, 2 ] 60003 62.564% 85.895% ############# ( 2, 3 ] 7756 8.087% 93.982% ## ( 3, 4 ] 3146 3.280% 97.262% # ( 4, 6 ] 2068 2.156% 99.418% ( 6, 10 ] 458 0.478% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239534 Average: 3.2727 StdDev: 29.71 Min: 0 Median: 1.6413 Max: 5618 Percentiles: P50: 1.64 P75: 2.14 P99: 8.56 P99.9: 184.08 P99.99: 505.58 ------------------------------------------------------ [ 0, 1 ] 22603 9.436% 9.436% ## ( 1, 2 ] 151512 63.253% 72.689% ############# ( 2, 3 ] 39605 16.534% 89.223% ### ( 3, 4 ] 12310 5.139% 94.362% # ( 4, 6 ] 8877 3.706% 98.068% # ( 6, 10 ] 3487 1.456% 99.524% ( 10, 15 ] 396 0.165% 99.689% ( 15, 22 ] 95 0.040% 99.729% ( 22, 34 ] 21 0.009% 99.738% ( 34, 51 ] 5 0.002% 99.740% ( 51, 76 ] 4 0.002% 99.742% ( 76, 110 ] 155 0.065% 99.806% ( 110, 170 ] 203 0.085% 99.891% ( 170, 250 ] 122 0.051% 99.942% ( 250, 380 ] 78 0.033% 99.975% ( 380, 580 ] 59 0.025% 99.999% ( 580, 870 ] 42 0.018% 100.017% ( 870, 1300 ] 9 0.004% 100.020% ( 1300, 1900 ] 11 0.005% 100.025% ( 1900, 2900 ] 7 0.003% 100.028% ( 2900, 4400 ] 2 0.001% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 325 Average: 180.2615 StdDev: 651.79 Min: 0 Median: 1.7177 Max: 4780 Percentiles: P50: 1.72 P75: 10.31 P99: 3931.25 P99.9: 4780.00 P99.99: 4780.00 ------------------------------------------------------ [ 0, 1 ] 57 17.538% 17.538% #### ( 1, 2 ] 147 45.231% 62.769% ######### ( 2, 3 ] 22 6.769% 69.538% # ( 3, 4 ] 3 0.923% 70.462% ( 4, 6 ] 3 0.923% 71.385% ( 6, 10 ] 9 2.769% 74.154% # ( 10, 15 ] 44 13.538% 87.692% ### ( 15, 22 ] 3 0.923% 88.615% ( 110, 170 ] 1 0.308% 88.923% ( 250, 380 ] 2 0.615% 89.538% ( 380, 580 ] 3 0.923% 90.462% ( 580, 870 ] 8 2.462% 92.923% ( 870, 1300 ] 10 3.077% 96.000% # ( 1300, 1900 ] 2 0.615% 96.615% ( 1900, 2900 ] 5 1.538% 98.154% ( 2900, 4400 ] 4 1.231% 99.385% ( 4400, 6600 ] 2 0.615% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 699.7333 StdDev: 891.11 Min: 80 Median: 170.0000 Max: 4182 Percentiles: P50: 170.00 P75: 1128.00 P99: 3950.00 P99.9: 4182.00 P99.99: 4182.00 ------------------------------------------------------ ( 76, 110 ] 17 28.333% 28.333% ###### ( 110, 170 ] 13 21.667% 50.000% #### ( 170, 250 ] 2 3.333% 53.333% # ( 250, 380 ] 5 8.333% 61.667% ## ( 380, 580 ] 2 3.333% 65.000% # ( 580, 870 ] 3 5.000% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 7 11.667% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 315.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.995 H:M:S, 12.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.497 H:M:S, 15.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-02:41:11 ... thread 0: (1000000,6000000) ops and (331093.5,326269.9) ops/second in (3.020295,18.389681) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.20 GB 56.7 3.7 0.0 3.7 9.3 5.7 0.0 1.7 122.0 308.9 30.99 28.89 96 0.323 3837K 4016 0.0 0.0 L1 13/13 1.36 GB 0.0 2.4 2.2 0.2 2.4 2.2 0.2 1.1 232.3 231.2 10.68 10.31 3 3.559 2518K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 22/0 912.28 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 232.0 231.5 8.36 7.84 6 1.393 1969K 4070 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 155.2 155.2 1.45 1.08 1 1.449 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/25 101.78 GB 0.0 8.6 3.4 5.2 14.2 9.0 3.4 2.5 166.1 275.1 53.00 49.59 108 0.491 8937K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 3.4 5.2 14.2 9.0 3.3 2.5 166.1 275.1 53.00 49.59 108 0.491 8937K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 3.4 5.2 8.6 3.4 0.0 0.0 241.7 241.1 36.42 34.83 26 1.401 8937K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 349.6 16.58 14.76 82 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.6 total, 18.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.24 GB write, 782.66 MB/s write, 8.60 GB read, 472.56 MB/s read, 53.0 seconds Interval compaction: 14.24 GB write, 792.60 MB/s write, 8.60 GB read, 478.57 MB/s read, 53.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 20, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1661772 Average: 2.2502 StdDev: 11.61 Min: 0 Median: 1.5089 Max: 3534 Percentiles: P50: 1.51 P75: 1.89 P99: 5.60 P99.9: 9.78 P99.99: 13.82 ------------------------------------------------------ [ 0, 1 ] 270466 16.276% 16.276% ### ( 1, 2 ] 1101317 66.274% 82.549% ############# ( 2, 3 ] 180146 10.841% 93.390% ## ( 3, 4 ] 63524 3.823% 97.213% # ( 4, 6 ] 37186 2.238% 99.450% ( 6, 10 ] 7903 0.476% 99.926% ( 10, 15 ] 1392 0.084% 100.010% ( 15, 22 ] 120 0.007% 100.017% ( 22, 34 ] 24 0.001% 100.018% ( 34, 51 ] 9 0.001% 100.019% ( 51, 76 ] 26 0.002% 100.021% ( 76, 110 ] 152 0.009% 100.030% ( 110, 170 ] 155 0.009% 100.039% ( 170, 250 ] 91 0.005% 100.044% ( 250, 380 ] 71 0.004% 100.049% ( 380, 580 ] 28 0.002% 100.050% ( 580, 870 ] 29 0.002% 100.052% ( 870, 1300 ] 25 0.002% 100.054% ( 1300, 1900 ] 10 0.001% 100.054% ( 1900, 2900 ] 11 0.001% 100.055% ( 2900, 4400 ] 7 0.000% 100.055% ** Level 1 read latency histogram (micros): Count: 327937 Average: 2.7964 StdDev: 17.26 Min: 0 Median: 1.6677 Max: 3759 Percentiles: P50: 1.67 P75: 2.24 P99: 7.34 P99.9: 12.63 P99.99: 20.43 ------------------------------------------------------ [ 0, 1 ] 24928 7.601% 7.601% ## ( 1, 2 ] 208240 63.500% 71.101% ############# ( 2, 3 ] 53823 16.413% 87.514% ### ( 3, 4 ] 19816 6.043% 93.557% # ( 4, 6 ] 16481 5.026% 98.582% # ( 6, 10 ] 4074 1.242% 99.825% ( 10, 15 ] 470 0.143% 99.968% ( 15, 22 ] 93 0.028% 99.996% ( 22, 34 ] 7 0.002% 99.998% ( 34, 51 ] 1 0.000% 99.999% ( 51, 76 ] 10 0.003% 100.002% ( 76, 110 ] 73 0.022% 100.024% ( 110, 170 ] 156 0.048% 100.072% ( 170, 250 ] 58 0.018% 100.089% ( 250, 380 ] 45 0.014% 100.103% ( 380, 580 ] 28 0.009% 100.112% ( 580, 870 ] 12 0.004% 100.115% ( 870, 1300 ] 9 0.003% 100.118% ( 1300, 1900 ] 6 0.002% 100.120% ( 1900, 2900 ] 4 0.001% 100.121% ( 2900, 4400 ] 2 0.001% 100.122% ** Level 2 read latency histogram (micros): Count: 95906 Average: 2.0585 StdDev: 5.30 Min: 0 Median: 1.4263 Max: 1243 Percentiles: P50: 1.43 P75: 1.83 P99: 5.61 P99.9: 10.27 P99.99: 40.96 ------------------------------------------------------ [ 0, 1 ] 22375 23.330% 23.330% ##### ( 1, 2 ] 60003 62.564% 85.895% ############# ( 2, 3 ] 7756 8.087% 93.982% ## ( 3, 4 ] 3146 3.280% 97.262% # ( 4, 6 ] 2068 2.156% 99.418% ( 6, 10 ] 458 0.478% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239534 Average: 3.2727 StdDev: 29.71 Min: 0 Median: 1.6413 Max: 5618 Percentiles: P50: 1.64 P75: 2.14 P99: 8.56 P99.9: 184.08 P99.99: 505.58 ------------------------------------------------------ [ 0, 1 ] 22603 9.436% 9.436% ## ( 1, 2 ] 151512 63.253% 72.689% ############# ( 2, 3 ] 39605 16.534% 89.223% ### ( 3, 4 ] 12310 5.139% 94.362% # ( 4, 6 ] 8877 3.706% 98.068% # ( 6, 10 ] 3487 1.456% 99.524% ( 10, 15 ] 396 0.165% 99.689% ( 15, 22 ] 95 0.040% 99.729% ( 22, 34 ] 21 0.009% 99.738% ( 34, 51 ] 5 0.002% 99.740% ( 51, 76 ] 4 0.002% 99.742% ( 76, 110 ] 155 0.065% 99.806% ( 110, 170 ] 203 0.085% 99.891% ( 170, 250 ] 122 0.051% 99.942% ( 250, 380 ] 78 0.033% 99.975% ( 380, 580 ] 59 0.025% 99.999% ( 580, 870 ] 42 0.018% 100.017% ( 870, 1300 ] 9 0.004% 100.020% ( 1300, 1900 ] 11 0.005% 100.025% ( 1900, 2900 ] 7 0.003% 100.028% ( 2900, 4400 ] 2 0.001% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 325 Average: 180.2615 StdDev: 651.79 Min: 0 Median: 1.7177 Max: 4780 Percentiles: P50: 1.72 P75: 10.31 P99: 3931.25 P99.9: 4780.00 P99.99: 4780.00 ------------------------------------------------------ [ 0, 1 ] 57 17.538% 17.538% #### ( 1, 2 ] 147 45.231% 62.769% ######### ( 2, 3 ] 22 6.769% 69.538% # ( 3, 4 ] 3 0.923% 70.462% ( 4, 6 ] 3 0.923% 71.385% ( 6, 10 ] 9 2.769% 74.154% # ( 10, 15 ] 44 13.538% 87.692% ### ( 15, 22 ] 3 0.923% 88.615% ( 110, 170 ] 1 0.308% 88.923% ( 250, 380 ] 2 0.615% 89.538% ( 380, 580 ] 3 0.923% 90.462% ( 580, 870 ] 8 2.462% 92.923% ( 870, 1300 ] 10 3.077% 96.000% # ( 1300, 1900 ] 2 0.615% 96.615% ( 1900, 2900 ] 5 1.538% 98.154% ( 2900, 4400 ] 4 1.231% 99.385% ( 4400, 6600 ] 2 0.615% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 699.7333 StdDev: 891.11 Min: 80 Median: 170.0000 Max: 4182 Percentiles: P50: 170.00 P75: 1128.00 P99: 3950.00 P99.9: 4182.00 P99.99: 4182.00 ------------------------------------------------------ ( 76, 110 ] 17 28.333% 28.333% ###### ( 110, 170 ] 13 21.667% 50.000% #### ( 170, 250 ] 2 3.333% 53.333% # ( 250, 380 ] 5 8.333% 61.667% ## ( 380, 580 ] 2 3.333% 65.000% # ( 580, 870 ] 3 5.000% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 7 11.667% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 18.6 total, 3.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 317.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.372 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.377 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-02:41:21 ... thread 0: (1000000,7000000) ops and (107454.5,252744.6) ops/second in (9.306262,27.695943) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 4.11 GB 125.2 5.7 0.0 5.7 12.3 6.6 0.0 1.9 141.1 303.3 41.50 38.87 114 0.364 5947K 11K 0.0 0.0 L1 13/13 1.36 GB 0.0 2.4 2.2 0.2 2.4 2.2 0.2 1.1 232.3 231.2 10.68 10.31 3 3.559 2518K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 22/0 912.28 MB 0.9 1.9 0.8 1.1 1.9 0.8 0.4 2.5 232.0 231.5 8.36 7.84 6 1.393 1969K 4070 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 155.2 155.2 1.45 1.08 1 1.449 228K 0 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/29 102.69 GB 0.0 10.6 3.4 7.2 17.2 9.9 3.4 2.6 171.3 277.0 63.51 59.58 126 0.504 11M 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.6 3.4 7.2 17.2 9.9 3.3 2.6 171.3 277.0 63.51 59.58 126 0.504 11M 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.6 3.4 7.2 10.6 3.4 0.0 0.0 246.1 245.4 44.21 42.39 30 1.474 11M 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.3 19.30 17.19 96 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.9 total, 27.7 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.18 GB write, 629.85 MB/s write, 10.62 GB read, 389.50 MB/s read, 63.5 seconds Interval compaction: 17.18 GB write, 635.16 MB/s write, 10.62 GB read, 392.79 MB/s read, 63.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 21, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2557084 Average: 2.3926 StdDev: 13.18 Min: 0 Median: 1.4971 Max: 4101 Percentiles: P50: 1.50 P75: 1.87 P99: 5.70 P99.9: 32.81 P99.99: 146.61 ------------------------------------------------------ [ 0, 1 ] 428947 16.775% 16.775% ### ( 1, 2 ] 1708991 66.834% 83.608% ############# ( 2, 3 ] 262525 10.267% 93.875% ## ( 3, 4 ] 87835 3.435% 97.310% # ( 4, 6 ] 50844 1.988% 99.298% ( 6, 10 ] 13301 0.520% 99.819% ( 10, 15 ] 1881 0.074% 99.892% ( 15, 22 ] 178 0.007% 99.899% ( 22, 34 ] 31 0.001% 99.900% ( 34, 51 ] 10 0.000% 99.901% ( 51, 76 ] 74 0.003% 99.904% ( 76, 110 ] 1487 0.058% 99.962% ( 110, 170 ] 1192 0.047% 100.008% ( 170, 250 ] 361 0.014% 100.022% ( 250, 380 ] 248 0.010% 100.032% ( 380, 580 ] 186 0.007% 100.039% ( 580, 870 ] 91 0.004% 100.043% ( 870, 1300 ] 41 0.002% 100.045% ( 1300, 1900 ] 17 0.001% 100.045% ( 1900, 2900 ] 13 0.001% 100.046% ( 2900, 4400 ] 11 0.000% 100.046% ** Level 1 read latency histogram (micros): Count: 485328 Average: 2.7794 StdDev: 16.75 Min: 0 Median: 1.6138 Max: 3759 Percentiles: P50: 1.61 P75: 2.00 P99: 7.62 P99.9: 82.10 P99.99: 145.73 ------------------------------------------------------ [ 0, 1 ] 49582 10.216% 10.216% ## ( 1, 2 ] 314552 64.812% 75.028% ############# ( 2, 3 ] 69805 14.383% 89.411% ### ( 3, 4 ] 24267 5.000% 94.412% # ( 4, 6 ] 19833 4.087% 98.498% # ( 6, 10 ] 6026 1.242% 99.740% ( 10, 15 ] 595 0.123% 99.862% ( 15, 22 ] 117 0.024% 99.886% ( 22, 34 ] 9 0.002% 99.888% ( 34, 51 ] 2 0.000% 99.889% ( 51, 76 ] 15 0.003% 99.892% ( 76, 110 ] 221 0.046% 99.937% ( 110, 170 ] 429 0.088% 100.026% ( 170, 250 ] 102 0.021% 100.047% ( 250, 380 ] 70 0.014% 100.061% ( 380, 580 ] 54 0.011% 100.072% ( 580, 870 ] 23 0.005% 100.077% ( 870, 1300 ] 10 0.002% 100.079% ( 1300, 1900 ] 7 0.001% 100.081% ( 1900, 2900 ] 6 0.001% 100.082% ( 2900, 4400 ] 2 0.000% 100.082% ** Level 2 read latency histogram (micros): Count: 95906 Average: 2.0585 StdDev: 5.30 Min: 0 Median: 1.4263 Max: 1243 Percentiles: P50: 1.43 P75: 1.83 P99: 5.61 P99.9: 10.27 P99.99: 40.96 ------------------------------------------------------ [ 0, 1 ] 22375 23.330% 23.330% ##### ( 1, 2 ] 60003 62.564% 85.895% ############# ( 2, 3 ] 7756 8.087% 93.982% ## ( 3, 4 ] 3146 3.280% 97.262% # ( 4, 6 ] 2068 2.156% 99.418% ( 6, 10 ] 458 0.478% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 239534 Average: 3.2727 StdDev: 29.71 Min: 0 Median: 1.6413 Max: 5618 Percentiles: P50: 1.64 P75: 2.14 P99: 8.56 P99.9: 184.08 P99.99: 505.58 ------------------------------------------------------ [ 0, 1 ] 22603 9.436% 9.436% ## ( 1, 2 ] 151512 63.253% 72.689% ############# ( 2, 3 ] 39605 16.534% 89.223% ### ( 3, 4 ] 12310 5.139% 94.362% # ( 4, 6 ] 8877 3.706% 98.068% # ( 6, 10 ] 3487 1.456% 99.524% ( 10, 15 ] 396 0.165% 99.689% ( 15, 22 ] 95 0.040% 99.729% ( 22, 34 ] 21 0.009% 99.738% ( 34, 51 ] 5 0.002% 99.740% ( 51, 76 ] 4 0.002% 99.742% ( 76, 110 ] 155 0.065% 99.806% ( 110, 170 ] 203 0.085% 99.891% ( 170, 250 ] 122 0.051% 99.942% ( 250, 380 ] 78 0.033% 99.975% ( 380, 580 ] 59 0.025% 99.999% ( 580, 870 ] 42 0.018% 100.017% ( 870, 1300 ] 9 0.004% 100.020% ( 1300, 1900 ] 11 0.005% 100.025% ( 1900, 2900 ] 7 0.003% 100.028% ( 2900, 4400 ] 2 0.001% 100.029% ( 4400, 6600 ] 2 0.001% 100.030% ** Level 4 read latency histogram (micros): Count: 325 Average: 180.2615 StdDev: 651.79 Min: 0 Median: 1.7177 Max: 4780 Percentiles: P50: 1.72 P75: 10.31 P99: 3931.25 P99.9: 4780.00 P99.99: 4780.00 ------------------------------------------------------ [ 0, 1 ] 57 17.538% 17.538% #### ( 1, 2 ] 147 45.231% 62.769% ######### ( 2, 3 ] 22 6.769% 69.538% # ( 3, 4 ] 3 0.923% 70.462% ( 4, 6 ] 3 0.923% 71.385% ( 6, 10 ] 9 2.769% 74.154% # ( 10, 15 ] 44 13.538% 87.692% ### ( 15, 22 ] 3 0.923% 88.615% ( 110, 170 ] 1 0.308% 88.923% ( 250, 380 ] 2 0.615% 89.538% ( 380, 580 ] 3 0.923% 90.462% ( 580, 870 ] 8 2.462% 92.923% ( 870, 1300 ] 10 3.077% 96.000% # ( 1300, 1900 ] 2 0.615% 96.615% ( 1900, 2900 ] 5 1.538% 98.154% ( 2900, 4400 ] 4 1.231% 99.385% ( 4400, 6600 ] 2 0.615% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 699.7333 StdDev: 891.11 Min: 80 Median: 170.0000 Max: 4182 Percentiles: P50: 170.00 P75: 1128.00 P99: 3950.00 P99.9: 4182.00 P99.99: 4182.00 ------------------------------------------------------ ( 76, 110 ] 17 28.333% 28.333% ###### ( 110, 170 ] 13 21.667% 50.000% #### ( 170, 250 ] 2 3.333% 53.333% # ( 250, 380 ] 5 8.333% 61.667% ## ( 380, 580 ] 2 3.333% 65.000% # ( 580, 870 ] 3 5.000% 70.000% # ( 870, 1300 ] 5 8.333% 78.333% ## ( 1300, 1900 ] 7 11.667% 90.000% ## ( 1900, 2900 ] 4 6.667% 96.667% # ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 27.9 total, 9.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 246.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.707 H:M:S, 31.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 105.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.335 H:M:S, 68.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-02:41:34 ... thread 0: (1000000,8000000) ops and (72603.2,192913.1) ops/second in (13.773502,41.469445) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/6 2.45 GB 6.3 7.4 0.0 7.4 14.9 7.6 0.0 2.0 145.9 295.1 51.81 47.75 132 0.392 7673K 14K 0.0 0.0 L1 18/18 1.73 GB 0.0 6.4 4.9 1.6 6.3 4.8 0.2 1.3 220.3 217.4 29.89 28.08 4 7.473 6685K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.2 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 21/0 946.59 MB 0.9 4.8 3.0 1.8 4.7 2.9 0.4 1.6 152.2 151.3 32.00 21.59 17 1.882 4946K 29K 0.0 0.0 L4 180/0 9.70 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.0 146.7 146.3 17.10 11.52 30 0.570 2503K 3490 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/24 103.57 GB 0.0 21.4 10.4 11.0 28.8 17.8 7.6 3.8 165.5 223.0 132.32 110.42 185 0.715 22M 131K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.4 10.4 11.0 28.8 17.8 7.5 3.8 165.5 223.0 132.32 110.42 185 0.715 22M 131K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.4 10.4 11.0 21.3 10.2 0.0 0.0 200.4 199.2 109.27 90.54 75 1.457 22M 131K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 336.1 23.05 19.87 110 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.7 total, 41.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.82 GB write, 707.64 MB/s write, 21.38 GB read, 525.05 MB/s read, 132.3 seconds Interval compaction: 28.82 GB write, 711.62 MB/s write, 21.38 GB read, 528.01 MB/s read, 132.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 30, pending-compaction-bytes-stops: 0, total-delays: 45, total-stops: 31, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3473873 Average: 2.7441 StdDev: 27.41 Min: 0 Median: 1.5114 Max: 19704 Percentiles: P50: 1.51 P75: 1.89 P99: 6.30 P99.9: 127.30 P99.99: 226.15 ------------------------------------------------------ [ 0, 1 ] 572461 16.479% 16.479% ### ( 1, 2 ] 2276972 65.546% 82.025% ############# ( 2, 3 ] 372408 10.720% 92.745% ## ( 3, 4 ] 127293 3.664% 96.409% # ( 4, 6 ] 88064 2.535% 98.944% # ( 6, 10 ] 25531 0.735% 99.679% ( 10, 15 ] 2887 0.083% 99.762% ( 15, 22 ] 331 0.010% 99.772% ( 22, 34 ] 45 0.001% 99.773% ( 34, 51 ] 55 0.002% 99.775% ( 51, 76 ] 141 0.004% 99.779% ( 76, 110 ] 3216 0.093% 99.871% ( 110, 170 ] 3462 0.100% 99.971% ( 170, 250 ] 944 0.027% 99.998% ( 250, 380 ] 613 0.018% 100.016% ( 380, 580 ] 467 0.013% 100.029% ( 580, 870 ] 218 0.006% 100.036% ( 870, 1300 ] 74 0.002% 100.038% ( 1300, 1900 ] 32 0.001% 100.039% ( 1900, 2900 ] 38 0.001% 100.040% ( 2900, 4400 ] 57 0.002% 100.041% ( 4400, 6600 ] 11 0.000% 100.042% ( 6600, 9900 ] 7 0.000% 100.042% ( 14000, 22000 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 1224563 Average: 5.5329 StdDev: 93.88 Min: 0 Median: 1.7602 Max: 23431 Percentiles: P50: 1.76 P75: 2.63 P99: 8.85 P99.9: 101.12 P99.99: 219.76 ------------------------------------------------------ [ 0, 1 ] 89789 7.332% 7.332% # ( 1, 2 ] 687335 56.129% 63.461% ########### ( 2, 3 ] 222880 18.201% 81.662% #### ( 3, 4 ] 97864 7.992% 89.654% ## ( 4, 6 ] 97204 7.938% 97.592% ## ( 6, 10 ] 24204 1.977% 99.568% ( 10, 15 ] 3070 0.251% 99.819% ( 15, 22 ] 462 0.038% 99.857% ( 22, 34 ] 44 0.004% 99.860% ( 34, 51 ] 23 0.002% 99.862% ( 51, 76 ] 66 0.005% 99.868% ( 76, 110 ] 538 0.044% 99.911% ( 110, 170 ] 765 0.062% 99.974% ( 170, 250 ] 316 0.026% 100.000% ( 250, 380 ] 383 0.031% 100.031% ( 380, 580 ] 419 0.034% 100.065% ( 580, 870 ] 440 0.036% 100.101% ( 870, 1300 ] 302 0.025% 100.126% ( 1300, 1900 ] 162 0.013% 100.139% ( 1900, 2900 ] 176 0.014% 100.153% ( 2900, 4400 ] 291 0.024% 100.177% ( 4400, 6600 ] 67 0.005% 100.183% ( 6600, 9900 ] 31 0.003% 100.185% ( 9900, 14000 ] 4 0.000% 100.186% ( 14000, 22000 ] 2 0.000% 100.186% ( 22000, 33000 ] 1 0.000% 100.186% ** Level 2 read latency histogram (micros): Count: 95906 Average: 2.0585 StdDev: 5.30 Min: 0 Median: 1.4263 Max: 1243 Percentiles: P50: 1.43 P75: 1.83 P99: 5.61 P99.9: 10.27 P99.99: 40.96 ------------------------------------------------------ [ 0, 1 ] 22375 23.330% 23.330% ##### ( 1, 2 ] 60003 62.564% 85.895% ############# ( 2, 3 ] 7756 8.087% 93.982% ## ( 3, 4 ] 3146 3.280% 97.262% # ( 4, 6 ] 2068 2.156% 99.418% ( 6, 10 ] 458 0.478% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 954433 Average: 4.0021 StdDev: 48.93 Min: 0 Median: 1.9167 Max: 7965 Percentiles: P50: 1.92 P75: 2.91 P99: 8.05 P99.9: 12.09 P99.99: 14.25 ------------------------------------------------------ [ 0, 1 ] 29366 3.077% 3.077% # ( 1, 2 ] 488565 51.189% 54.266% ########## ( 2, 3 ] 216370 22.670% 76.936% ##### ( 3, 4 ] 103293 10.822% 87.758% ## ( 4, 6 ] 99106 10.384% 98.142% ## ( 6, 10 ] 15947 1.671% 99.813% ( 10, 15 ] 1987 0.208% 100.021% ( 15, 22 ] 294 0.031% 100.052% ( 22, 34 ] 43 0.005% 100.056% ( 34, 51 ] 13 0.001% 100.058% ( 51, 76 ] 39 0.004% 100.062% ( 76, 110 ] 168 0.018% 100.079% ( 110, 170 ] 261 0.027% 100.107% ( 170, 250 ] 271 0.028% 100.135% ( 250, 380 ] 264 0.028% 100.163% ( 380, 580 ] 247 0.026% 100.189% ( 580, 870 ] 198 0.021% 100.209% ( 870, 1300 ] 99 0.010% 100.220% ( 1300, 1900 ] 56 0.006% 100.226% ( 1900, 2900 ] 42 0.004% 100.230% ( 2900, 4400 ] 71 0.007% 100.238% ( 4400, 6600 ] 8 0.001% 100.238% ( 6600, 9900 ] 8 0.001% 100.239% ** Level 4 read latency histogram (micros): Count: 29121 Average: 76.9295 StdDev: 398.11 Min: 0 Median: 2.0438 Max: 11117 Percentiles: P50: 2.04 P75: 3.29 P99: 1795.13 P99.9: 4537.79 P99.99: 6459.78 ------------------------------------------------------ [ 0, 1 ] 581 1.995% 1.995% ( 1, 2 ] 13693 47.021% 49.016% ######### ( 2, 3 ] 6546 22.479% 71.495% #### ( 3, 4 ] 3541 12.160% 83.654% ## ( 4, 6 ] 2038 6.998% 90.653% # ( 6, 10 ] 618 2.122% 92.775% ( 10, 15 ] 105 0.361% 93.136% ( 15, 22 ] 12 0.041% 93.177% ( 22, 34 ] 7 0.024% 93.201% ( 34, 51 ] 2 0.007% 93.208% ( 51, 76 ] 24 0.082% 93.290% ( 76, 110 ] 14 0.048% 93.338% ( 110, 170 ] 36 0.124% 93.462% ( 170, 250 ] 103 0.354% 93.815% ( 250, 380 ] 185 0.635% 94.451% ( 380, 580 ] 353 1.212% 95.663% ( 580, 870 ] 457 1.569% 97.232% ( 870, 1300 ] 358 1.229% 98.462% ( 1300, 1900 ] 190 0.652% 99.114% ( 1900, 2900 ] 127 0.436% 99.550% ( 2900, 4400 ] 100 0.343% 99.894% ( 4400, 6600 ] 30 0.103% 99.997% ( 6600, 9900 ] 11 0.038% 100.034% ( 9900, 14000 ] 1 0.003% 100.038% ** Level 5 read latency histogram (micros): Count: 180 Average: 1210.6389 StdDev: 1318.43 Min: 80 Median: 657.3333 Max: 5371 Percentiles: P50: 657.33 P75: 1758.82 P99: 5371.00 P99.9: 5371.00 P99.99: 5371.00 ------------------------------------------------------ ( 76, 110 ] 20 11.111% 11.111% ## ( 110, 170 ] 21 11.667% 22.778% ## ( 170, 250 ] 11 6.111% 28.889% # ( 250, 380 ] 15 8.333% 37.222% ## ( 380, 580 ] 19 10.556% 47.778% ## ( 580, 870 ] 15 8.333% 56.111% ## ( 870, 1300 ] 21 11.667% 67.778% ## ( 1300, 1900 ] 17 9.444% 77.222% ## ( 1900, 2900 ] 15 8.333% 85.556% ## ( 2900, 4400 ] 19 10.556% 96.111% ## ( 4400, 6600 ] 7 3.889% 100.000% # ** DB Stats ** Uptime(secs): 41.7 total, 13.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 188.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.161 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 71.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.454 H:M:S, 75.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-02:41:37 ... thread 0: (1000000,9000000) ops and (321995.4,201906.5) ops/second in (3.105634,44.575079) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 3.43 GB 107.0 8.2 0.0 8.2 16.7 8.5 0.0 2.0 144.9 296.1 57.82 53.38 149 0.388 8505K 15K 0.0 0.0 L1 18/18 1.73 GB 0.0 6.4 4.9 1.6 6.3 4.8 0.2 1.3 220.3 217.4 29.89 28.08 4 7.473 6685K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.2 2.0 247.7 247.6 1.53 1.47 2 0.763 383K 204 0.0 0.0 L3 21/0 946.59 MB 0.9 4.8 3.0 1.8 4.7 2.9 0.4 1.6 152.2 151.3 32.00 21.59 17 1.882 4946K 29K 0.0 0.0 L4 180/0 9.70 GB 1.0 2.4 2.3 0.1 2.4 2.3 0.8 1.0 146.7 146.3 17.10 11.52 30 0.570 2503K 3490 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/24 104.56 GB 0.0 22.2 10.4 11.8 30.6 18.8 7.6 3.6 164.2 226.5 138.33 116.05 202 0.685 23M 132K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.2 10.4 11.8 30.6 18.8 7.5 3.6 164.2 226.5 138.33 116.05 202 0.685 23M 132K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.2 10.4 11.8 22.1 10.2 0.0 0.0 202.1 200.9 112.38 93.58 78 1.441 23M 132K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 337.4 25.96 22.46 124 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.8 total, 44.6 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.60 GB write, 699.34 MB/s write, 22.18 GB read, 506.94 MB/s read, 138.3 seconds Interval compaction: 30.60 GB write, 703.01 MB/s write, 22.18 GB read, 509.59 MB/s read, 138.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 30, pending-compaction-bytes-stops: 0, total-delays: 45, total-stops: 34, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3825353 Average: 2.6991 StdDev: 26.26 Min: 0 Median: 1.5142 Max: 19704 Percentiles: P50: 1.51 P75: 1.89 P99: 6.22 P99.9: 118.55 P99.99: 209.49 ------------------------------------------------------ [ 0, 1 ] 618897 16.179% 16.179% ### ( 1, 2 ] 2515948 65.770% 81.949% ############# ( 2, 3 ] 415165 10.853% 92.802% ## ( 3, 4 ] 139889 3.657% 96.459% # ( 4, 6 ] 95608 2.499% 98.958% ( 6, 10 ] 28509 0.745% 99.704% ( 10, 15 ] 3196 0.084% 99.787% ( 15, 22 ] 360 0.009% 99.797% ( 22, 34 ] 51 0.001% 99.798% ( 34, 51 ] 55 0.001% 99.799% ( 51, 76 ] 141 0.004% 99.803% ( 76, 110 ] 3216 0.084% 99.887% ( 110, 170 ] 3466 0.091% 99.978% ( 170, 250 ] 953 0.025% 100.003% ( 250, 380 ] 621 0.016% 100.019% ( 380, 580 ] 468 0.012% 100.031% ( 580, 870 ] 224 0.006% 100.037% ( 870, 1300 ] 81 0.002% 100.039% ( 1300, 1900 ] 33 0.001% 100.040% ( 1900, 2900 ] 40 0.001% 100.041% ( 2900, 4400 ] 57 0.001% 100.042% ( 4400, 6600 ] 11 0.000% 100.043% ( 6600, 9900 ] 7 0.000% 100.043% ( 14000, 22000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 1273713 Average: 5.4231 StdDev: 92.09 Min: 0 Median: 1.7501 Max: 23431 Percentiles: P50: 1.75 P75: 2.60 P99: 8.83 P99.9: 103.56 P99.99: 226.27 ------------------------------------------------------ [ 0, 1 ] 95593 7.505% 7.505% ## ( 1, 2 ] 721619 56.655% 64.160% ########### ( 2, 3 ] 228684 17.954% 82.114% #### ( 3, 4 ] 99288 7.795% 89.909% ## ( 4, 6 ] 98148 7.706% 97.615% ## ( 6, 10 ] 24926 1.957% 99.572% ( 10, 15 ] 3108 0.244% 99.816% ( 15, 22 ] 464 0.036% 99.852% ( 22, 34 ] 44 0.003% 99.856% ( 34, 51 ] 23 0.002% 99.857% ( 51, 76 ] 73 0.006% 99.863% ( 76, 110 ] 579 0.045% 99.909% ( 110, 170 ] 801 0.063% 99.972% ( 170, 250 ] 335 0.026% 99.998% ( 250, 380 ] 399 0.031% 100.029% ( 380, 580 ] 422 0.033% 100.062% ( 580, 870 ] 446 0.035% 100.097% ( 870, 1300 ] 302 0.024% 100.121% ( 1300, 1900 ] 162 0.013% 100.134% ( 1900, 2900 ] 176 0.014% 100.148% ( 2900, 4400 ] 291 0.023% 100.170% ( 4400, 6600 ] 67 0.005% 100.176% ( 6600, 9900 ] 31 0.002% 100.178% ( 9900, 14000 ] 4 0.000% 100.178% ( 14000, 22000 ] 2 0.000% 100.179% ( 22000, 33000 ] 1 0.000% 100.179% ** Level 2 read latency histogram (micros): Count: 95906 Average: 2.0585 StdDev: 5.30 Min: 0 Median: 1.4263 Max: 1243 Percentiles: P50: 1.43 P75: 1.83 P99: 5.61 P99.9: 10.27 P99.99: 40.96 ------------------------------------------------------ [ 0, 1 ] 22375 23.330% 23.330% ##### ( 1, 2 ] 60003 62.564% 85.895% ############# ( 2, 3 ] 7756 8.087% 93.982% ## ( 3, 4 ] 3146 3.280% 97.262% # ( 4, 6 ] 2068 2.156% 99.418% ( 6, 10 ] 458 0.478% 99.896% ( 10, 15 ] 77 0.080% 99.976% ( 15, 22 ] 11 0.011% 99.987% ( 22, 34 ] 2 0.002% 99.990% ( 34, 51 ] 1 0.001% 99.991% ( 51, 76 ] 3 0.003% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 2 0.002% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 870, 1300 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 954433 Average: 4.0021 StdDev: 48.93 Min: 0 Median: 1.9167 Max: 7965 Percentiles: P50: 1.92 P75: 2.91 P99: 8.05 P99.9: 12.09 P99.99: 14.25 ------------------------------------------------------ [ 0, 1 ] 29366 3.077% 3.077% # ( 1, 2 ] 488565 51.189% 54.266% ########## ( 2, 3 ] 216370 22.670% 76.936% ##### ( 3, 4 ] 103293 10.822% 87.758% ## ( 4, 6 ] 99106 10.384% 98.142% ## ( 6, 10 ] 15947 1.671% 99.813% ( 10, 15 ] 1987 0.208% 100.021% ( 15, 22 ] 294 0.031% 100.052% ( 22, 34 ] 43 0.005% 100.056% ( 34, 51 ] 13 0.001% 100.058% ( 51, 76 ] 39 0.004% 100.062% ( 76, 110 ] 168 0.018% 100.079% ( 110, 170 ] 261 0.027% 100.107% ( 170, 250 ] 271 0.028% 100.135% ( 250, 380 ] 264 0.028% 100.163% ( 380, 580 ] 247 0.026% 100.189% ( 580, 870 ] 198 0.021% 100.209% ( 870, 1300 ] 99 0.010% 100.220% ( 1300, 1900 ] 56 0.006% 100.226% ( 1900, 2900 ] 42 0.004% 100.230% ( 2900, 4400 ] 71 0.007% 100.238% ( 4400, 6600 ] 8 0.001% 100.238% ( 6600, 9900 ] 8 0.001% 100.239% ** Level 4 read latency histogram (micros): Count: 29121 Average: 76.9295 StdDev: 398.11 Min: 0 Median: 2.0438 Max: 11117 Percentiles: P50: 2.04 P75: 3.29 P99: 1795.13 P99.9: 4537.79 P99.99: 6459.78 ------------------------------------------------------ [ 0, 1 ] 581 1.995% 1.995% ( 1, 2 ] 13693 47.021% 49.016% ######### ( 2, 3 ] 6546 22.479% 71.495% #### ( 3, 4 ] 3541 12.160% 83.654% ## ( 4, 6 ] 2038 6.998% 90.653% # ( 6, 10 ] 618 2.122% 92.775% ( 10, 15 ] 105 0.361% 93.136% ( 15, 22 ] 12 0.041% 93.177% ( 22, 34 ] 7 0.024% 93.201% ( 34, 51 ] 2 0.007% 93.208% ( 51, 76 ] 24 0.082% 93.290% ( 76, 110 ] 14 0.048% 93.338% ( 110, 170 ] 36 0.124% 93.462% ( 170, 250 ] 103 0.354% 93.815% ( 250, 380 ] 185 0.635% 94.451% ( 380, 580 ] 353 1.212% 95.663% ( 580, 870 ] 457 1.569% 97.232% ( 870, 1300 ] 358 1.229% 98.462% ( 1300, 1900 ] 190 0.652% 99.114% ( 1900, 2900 ] 127 0.436% 99.550% ( 2900, 4400 ] 100 0.343% 99.894% ( 4400, 6600 ] 30 0.103% 99.997% ( 6600, 9900 ] 11 0.038% 100.034% ( 9900, 14000 ] 1 0.003% 100.038% ** Level 5 read latency histogram (micros): Count: 180 Average: 1210.6389 StdDev: 1318.43 Min: 80 Median: 657.3333 Max: 5371 Percentiles: P50: 657.33 P75: 1758.82 P99: 5371.00 P99.9: 5371.00 P99.99: 5371.00 ------------------------------------------------------ ( 76, 110 ] 20 11.111% 11.111% ## ( 110, 170 ] 21 11.667% 22.778% ## ( 170, 250 ] 11 6.111% 28.889% # ( 250, 380 ] 15 8.333% 37.222% ## ( 380, 580 ] 19 10.556% 47.778% ## ( 580, 870 ] 15 8.333% 56.111% ## ( 870, 1300 ] 21 11.667% 67.778% ## ( 1300, 1900 ] 17 9.444% 77.222% ## ( 1900, 2900 ] 15 8.333% 85.556% ## ( 2900, 4400 ] 19 10.556% 96.111% ## ( 4400, 6600 ] 7 3.889% 100.000% # ** DB Stats ** Uptime(secs): 44.8 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 197.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.585 H:M:S, 43.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.424 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.041 micros/op 165519 ops/sec 60.313 seconds 9982999 operations; 160.4 MB/s Microseconds per write: Count: 9982999 Average: 6.0413 StdDev: 333.22 Min: 1 Median: 1.7670 Max: 613343 Percentiles: P50: 1.77 P75: 2.82 P99: 9.93 P99.9: 1146.05 P99.99: 2641.99 ------------------------------------------------------ [ 0, 1 ] 1166504 11.685% 11.685% ## ( 1, 2 ] 4987132 49.956% 61.641% ########## ( 2, 3 ] 1629893 16.327% 77.968% ### ( 3, 4 ] 1385272 13.876% 91.844% ### ( 4, 6 ] 570114 5.711% 97.555% # ( 6, 10 ] 146890 1.471% 99.026% ( 10, 15 ] 50377 0.505% 99.531% ( 15, 22 ] 11589 0.116% 99.647% ( 22, 34 ] 1864 0.019% 99.666% ( 34, 51 ] 226 0.002% 99.668% ( 51, 76 ] 31 0.000% 99.668% ( 76, 110 ] 6846 0.069% 99.737% ( 110, 170 ] 2826 0.028% 99.765% ( 170, 250 ] 255 0.003% 99.768% ( 250, 380 ] 215 0.002% 99.770% ( 380, 580 ] 44 0.000% 99.770% ( 580, 870 ] 33 0.000% 99.771% ( 870, 1300 ] 20102 0.201% 99.972% ( 1300, 1900 ] 162 0.002% 99.974% ( 1900, 2900 ] 2191 0.022% 99.996% ( 2900, 4400 ] 287 0.003% 99.999% ( 4400, 6600 ] 94 0.001% 99.999% ( 6600, 9900 ] 23 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 7 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 232065 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9982999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10302454968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 616 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31997355 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 38148796516 rocksdb.compact.write.bytes COUNT : 37902582829 rocksdb.flush.write.bytes COUNT : 10238818519 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 47 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 326 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10156316672 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3996672 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 38240328159 rocksdb.non.last.level.read.count COUNT : 9242268 rocksdb.block.checksum.compute.count COUNT : 9241083 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.437613 P95 : 3.984615 P99 : 8.754654 P100 : 613342.000000 COUNT : 9982999 SUM : 55563146 rocksdb.compaction.times.micros P50 : 1007631.578947 P95 : 4336666.666667 P99 : 17240000.000000 P100 : 19215013.000000 COUNT : 119 SUM : 185702207 rocksdb.compaction.times.cpu_micros P50 : 873421.052632 P95 : 3967500.000000 P99 : 17240000.000000 P100 : 17773344.000000 COUNT : 119 SUM : 148614418 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 692.777778 P95 : 1243.178571 P99 : 11191.500000 P100 : 11918.000000 COUNT : 137 SUM : 119086 rocksdb.compaction.outfile.sync.micros P50 : 1249.680851 P95 : 145793.103448 P99 : 226600.000000 P100 : 276927.000000 COUNT : 434 SUM : 11077181 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.945946 P95 : 1774.000000 P99 : 3945.000000 P100 : 5218.000000 COUNT : 282 SUM : 107258 rocksdb.table.open.io.micros P50 : 1590.526316 P95 : 6541.333333 P99 : 12380.500000 P100 : 18182.000000 COUNT : 616 SUM : 1285396 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.757294 P95 : 8.267938 P99 : 11.430512 P100 : 23436.000000 COUNT : 9239544 SUM : 62826906 rocksdb.read.block.get.micros P50 : 489.243697 P95 : 3260.000000 P99 : 4939.733333 P100 : 6846.000000 COUNT : 1232 SUM : 1059019 rocksdb.write.raw.block.micros P50 : 0.514036 P95 : 0.976669 P99 : 2.834433 P100 : 52847.000000 COUNT : 11662523 SUM : 23185953 rocksdb.numfiles.in.singlecompaction P50 : 2.535714 P95 : 5.250000 P99 : 17.100000 P100 : 25.000000 COUNT : 170 SUM : 571 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556615 P95 : 1116.894500 P99 : 2046.739231 P100 : 613165.000000 COUNT : 225419 SUM : 32020321 rocksdb.sst.read.micros P50 : 1.673751 P95 : 5.008806 P99 : 8.754787 P100 : 23431.000000 COUNT : 9242839 SUM : 43259950 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9982999 SUM : 10302454968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213883.495146 P95 : 365852.941176 P99 : 661350.000000 P100 : 815546.000000 COUNT : 137 SUM : 29657584 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 408 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0