[2024-07-12 21:37:42.059704] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-12 21:37:42.059807] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2322801 ] Set seed to 1720813062057371 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 21:37:42.162769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 21:37:42.383225] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 21:37:42.383281] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2322801' to capture a snapshot of events at runtime. [2024-07-12 21:37:42.383290] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2322801 for offline analysis/debug. [2024-07-12 21:37:42.383313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 21:37:51 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/12-21:37:54 ... thread 0: (1000000,1000000) ops and (338217.9,338217.9) ops/second in (2.956674,2.956674) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.98 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.1 2.52 2.26 12 0.210 0 0 0.0 0.0 L1 3/0 249.51 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.1 243.9 1.03 1.00 1 1.032 255K 258 0.0 0.0 L2 3/2 191.08 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 11/0 867.45 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1179/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 102.1 304.6 4.35 4.02 15 0.290 451K 359 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 102.1 304.6 4.35 4.02 15 0.290 451K 359 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 242.4 242.2 1.84 1.76 3 0.612 451K 359 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.1 2.52 2.26 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.30 GB write, 420.77 MB/s write, 0.43 GB read, 141.11 MB/s read, 4.4 seconds Interval compaction: 1.30 GB write, 448.42 MB/s write, 0.43 GB read, 150.38 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 156467 Average: 2.1033 StdDev: 19.90 Min: 1 Median: 1.3931 Max: 4439 Percentiles: P50: 1.39 P75: 1.78 P99: 5.38 P99.9: 9.88 P99.99: 20.95 ------------------------------------------------------ [ 0, 1 ] 38261 24.453% 24.453% ##### ( 1, 2 ] 101682 64.986% 89.439% ############# ( 2, 3 ] 9433 6.029% 95.468% # ( 3, 4 ] 3789 2.422% 97.890% ( 4, 6 ] 2518 1.609% 99.499% ( 6, 10 ] 647 0.414% 99.912% ( 10, 15 ] 112 0.072% 99.984% ( 15, 22 ] 11 0.007% 99.991% ( 22, 34 ] 2 0.001% 99.992% ( 34, 51 ] 2 0.001% 99.994% ( 110, 170 ] 6 0.004% 99.997% ( 170, 250 ] 3 0.002% 99.999% ( 250, 380 ] 5 0.003% 100.003% ( 380, 580 ] 2 0.001% 100.004% ( 580, 870 ] 1 0.001% 100.004% ( 1300, 1900 ] 2 0.001% 100.006% ( 1900, 2900 ] 1 0.001% 100.006% ( 2900, 4400 ] 3 0.002% 100.008% ( 4400, 6600 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 587 Average: 19.0733 StdDev: 150.28 Min: 1 Median: 2.2021 Max: 2358 Percentiles: P50: 2.20 P75: 3.37 P99: 598.85 P99.9: 2358.00 P99.99: 2358.00 ------------------------------------------------------ [ 0, 1 ] 34 5.792% 5.792% # ( 1, 2 ] 231 39.353% 45.145% ######## ( 2, 3 ] 141 24.020% 69.165% ##### ( 3, 4 ] 93 15.843% 85.009% ### ( 4, 6 ] 44 7.496% 92.504% # ( 6, 10 ] 24 4.089% 96.593% # ( 10, 15 ] 7 1.193% 97.785% ( 22, 34 ] 1 0.170% 97.956% ( 34, 51 ] 1 0.170% 98.126% ( 110, 170 ] 1 0.170% 98.296% ( 170, 250 ] 1 0.170% 98.467% ( 250, 380 ] 1 0.170% 98.637% ( 380, 580 ] 2 0.341% 98.978% ( 580, 870 ] 2 0.341% 99.319% ( 870, 1300 ] 2 0.341% 99.659% ( 1900, 2900 ] 2 0.341% 100.000% ** Level 2 read latency histogram (micros): Count: 41196 Average: 2.5173 StdDev: 37.73 Min: 1 Median: 1.5127 Max: 6605 Percentiles: P50: 1.51 P75: 1.89 P99: 5.91 P99.9: 12.27 P99.99: 572.03 ------------------------------------------------------ [ 0, 1 ] 6548 15.895% 15.895% ### ( 1, 2 ] 27406 66.526% 82.421% ############# ( 2, 3 ] 3765 9.139% 91.560% ## ( 3, 4 ] 1873 4.547% 96.106% # ( 4, 6 ] 1252 3.039% 99.146% # ( 6, 10 ] 290 0.704% 99.849% ( 10, 15 ] 48 0.117% 99.966% ( 15, 22 ] 4 0.010% 99.976% ( 22, 34 ] 1 0.002% 99.978% ( 51, 76 ] 1 0.002% 99.981% ( 170, 250 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 870, 1300 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ( 6600, 9900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 3557.4444 StdDev: 2529.15 Min: 197 Median: 2816.6667 Max: 9267 Percentiles: P50: 2816.67 P75: 6050.00 P99: 9267.00 P99.9: 9267.00 P99.99: 9267.00 ------------------------------------------------------ ( 170, 250 ] 1 2.222% 2.222% ( 380, 580 ] 1 2.222% 4.444% ( 580, 870 ] 6 13.333% 17.778% ### ( 870, 1300 ] 3 6.667% 24.444% # ( 1300, 1900 ] 6 13.333% 37.778% ### ( 1900, 2900 ] 6 13.333% 51.111% ### ( 2900, 4400 ] 4 8.889% 60.000% ## ( 4400, 6600 ] 9 20.000% 80.000% #### ( 6600, 9900 ] 9 20.000% 100.000% #### ** Level 4 read latency histogram (micros): Count: 25 Average: 2632.1600 StdDev: 2725.94 Min: 85 Median: 1400.0000 Max: 10022 Percentiles: P50: 1400.00 P75: 4730.00 P99: 10022.00 P99.9: 10022.00 P99.99: 10022.00 ------------------------------------------------------ ( 76, 110 ] 2 8.000% 8.000% ## ( 250, 380 ] 3 12.000% 20.000% ## ( 380, 580 ] 2 8.000% 28.000% ## ( 580, 870 ] 3 12.000% 40.000% ## ( 870, 1300 ] 2 8.000% 48.000% ## ( 1300, 1900 ] 3 12.000% 60.000% ## ( 1900, 2900 ] 1 4.000% 64.000% # ( 2900, 4400 ] 2 8.000% 72.000% ## ( 4400, 6600 ] 5 20.000% 92.000% #### ( 6600, 9900 ] 1 4.000% 96.000% # ( 9900, 14000 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 312.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.449 H:M:S, 14.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.449 H:M:S, 15.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-21:37:57 ... thread 0: (1000000,2000000) ops and (335864.7,337037.2) ops/second in (2.977389,5.934063) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 88.1 0.7 0.0 0.7 2.5 1.8 0.0 1.4 94.7 323.4 7.98 7.38 28 0.285 767K 744 0.0 0.0 L1 3/3 249.51 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 244.1 243.9 1.03 1.00 1 1.032 255K 258 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 18/0 886.22 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 231.4 231.4 0.81 0.75 1 0.809 190K 0 0.0 0.0 L4 173/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 132.7 132.7 1.27 0.90 1 1.270 171K 0 0.0 0.0 L5 1040/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/7 97.92 GB 0.0 1.5 0.7 0.8 3.3 2.5 0.4 1.9 130.8 284.3 11.90 10.79 33 0.361 1580K 1103 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.7 0.8 3.3 2.5 0.4 1.9 130.8 284.3 11.90 10.79 33 0.361 1580K 1103 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.7 0.8 1.5 0.7 0.0 0.0 231.1 231.0 6.73 6.19 8 0.842 1580K 1103 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.8 5.16 4.60 25 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 551.79 MB/s write, 1.52 GB read, 253.94 MB/s read, 11.9 seconds Interval compaction: 3.30 GB write, 569.87 MB/s write, 1.52 GB read, 262.26 MB/s read, 11.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 409125 Average: 2.1722 StdDev: 14.97 Min: 0 Median: 1.4720 Max: 4439 Percentiles: P50: 1.47 P75: 1.84 P99: 5.51 P99.9: 9.93 P99.99: 14.44 ------------------------------------------------------ [ 0, 1 ] 74052 18.100% 18.100% #### ( 1, 2 ] 276494 67.582% 85.682% ############## ( 2, 3 ] 36637 8.955% 94.637% ## ( 3, 4 ] 11868 2.901% 97.538% # ( 4, 6 ] 7925 1.937% 99.475% ( 6, 10 ] 1771 0.433% 99.908% ( 10, 15 ] 380 0.093% 100.000% ( 15, 22 ] 23 0.006% 100.006% ( 22, 34 ] 4 0.001% 100.007% ( 34, 51 ] 3 0.001% 100.008% ( 51, 76 ] 1 0.000% 100.008% ( 110, 170 ] 10 0.002% 100.011% ( 170, 250 ] 11 0.003% 100.013% ( 250, 380 ] 9 0.002% 100.015% ( 380, 580 ] 9 0.002% 100.018% ( 580, 870 ] 6 0.001% 100.019% ( 870, 1300 ] 1 0.000% 100.019% ( 1300, 1900 ] 4 0.001% 100.020% ( 1900, 2900 ] 1 0.000% 100.021% ( 2900, 4400 ] 5 0.001% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 53200 Average: 2.3091 StdDev: 15.91 Min: 1 Median: 1.5195 Max: 2358 Percentiles: P50: 1.52 P75: 1.88 P99: 5.53 P99.9: 10.74 P99.99: 678.60 ------------------------------------------------------ [ 0, 1 ] 7527 14.148% 14.148% ### ( 1, 2 ] 36713 69.009% 83.158% ############## ( 2, 3 ] 5773 10.852% 94.009% ## ( 3, 4 ] 1747 3.284% 97.293% # ( 4, 6 ] 1184 2.226% 99.519% ( 6, 10 ] 196 0.368% 99.887% ( 10, 15 ] 46 0.086% 99.974% ( 15, 22 ] 1 0.002% 99.976% ( 22, 34 ] 1 0.002% 99.977% ( 34, 51 ] 1 0.002% 99.979% ( 110, 170 ] 1 0.002% 99.981% ( 170, 250 ] 1 0.002% 99.983% ( 250, 380 ] 1 0.002% 99.985% ( 380, 580 ] 2 0.004% 99.989% ( 580, 870 ] 2 0.004% 99.992% ( 870, 1300 ] 2 0.004% 99.996% ( 1900, 2900 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.4723 StdDev: 34.97 Min: 1 Median: 1.5205 Max: 6605 Percentiles: P50: 1.52 P75: 1.89 P99: 5.87 P99.9: 12.06 P99.99: 526.85 ------------------------------------------------------ [ 0, 1 ] 7260 15.134% 15.134% ### ( 1, 2 ] 32134 66.985% 82.119% ############# ( 2, 3 ] 4711 9.820% 91.939% ## ( 3, 4 ] 2092 4.361% 96.300% # ( 4, 6 ] 1386 2.889% 99.189% # ( 6, 10 ] 320 0.667% 99.856% ( 10, 15 ] 51 0.106% 99.962% ( 15, 22 ] 7 0.015% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 170, 250 ] 2 0.004% 99.985% ( 380, 580 ] 3 0.006% 99.992% ( 580, 870 ] 1 0.002% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42862 Average: 6.4100 StdDev: 141.45 Min: 1 Median: 1.7935 Max: 9267 Percentiles: P50: 1.79 P75: 2.54 P99: 8.26 P99.9: 635.00 P99.99: 8328.39 ------------------------------------------------------ [ 0, 1 ] 1709 3.987% 3.987% # ( 1, 2 ] 24855 57.988% 61.976% ############ ( 2, 3 ] 10331 24.103% 86.079% ##### ( 3, 4 ] 2564 5.982% 92.061% # ( 4, 6 ] 2648 6.178% 98.239% # ( 6, 10 ] 578 1.349% 99.587% ( 10, 15 ] 109 0.254% 99.841% ( 15, 22 ] 16 0.037% 99.879% ( 22, 34 ] 3 0.007% 99.886% ( 34, 51 ] 1 0.002% 99.888% ( 110, 170 ] 1 0.002% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 380, 580 ] 2 0.005% 99.897% ( 580, 870 ] 6 0.014% 99.911% ( 870, 1300 ] 4 0.009% 99.921% ( 1300, 1900 ] 6 0.014% 99.935% ( 1900, 2900 ] 6 0.014% 99.949% ( 2900, 4400 ] 4 0.009% 99.958% ( 4400, 6600 ] 9 0.021% 99.979% ( 6600, 9900 ] 9 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 221.3742 StdDev: 1054.75 Min: 0 Median: 1.8899 Max: 10022 Percentiles: P50: 1.89 P75: 6.34 P99: 6116.00 P99.9: 10022.00 P99.99: 10022.00 ------------------------------------------------------ [ 0, 1 ] 58 18.710% 18.710% #### ( 1, 2 ] 109 35.161% 53.871% ####### ( 2, 3 ] 40 12.903% 66.774% ### ( 3, 4 ] 11 3.548% 70.323% # ( 4, 6 ] 12 3.871% 74.194% # ( 6, 10 ] 29 9.355% 83.548% ## ( 10, 15 ] 18 5.806% 89.355% # ( 15, 22 ] 3 0.968% 90.323% ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 2 0.645% 91.290% ( 110, 170 ] 1 0.323% 91.613% ( 170, 250 ] 1 0.323% 91.935% ( 250, 380 ] 3 0.968% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 5 1.613% 95.161% ( 870, 1300 ] 2 0.645% 95.806% ( 1300, 1900 ] 3 0.968% 96.774% ( 1900, 2900 ] 1 0.323% 97.097% ( 2900, 4400 ] 2 0.645% 97.742% ( 4400, 6600 ] 5 1.613% 99.355% ( 6600, 9900 ] 1 0.323% 99.677% ( 9900, 14000 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.856 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.407 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/12-21:38:00 ... thread 0: (1000000,3000000) ops and (343126.9,339042.9) ops/second in (2.914374,8.848437) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.84 GB 157.3 1.6 0.0 1.6 4.4 2.8 0.0 1.6 116.4 317.7 14.07 13.11 45 0.313 1663K 1759 0.0 0.0 L1 3/0 235.84 MB 23.6 1.0 0.7 0.2 1.0 0.7 0.2 1.3 234.9 234.3 4.28 4.17 2 2.140 1020K 2441 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 14/0 771.36 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.6 1.0 231.4 231.4 0.81 0.75 1 0.809 190K 0 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 132.7 132.7 1.27 0.90 1 1.270 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/4 98.90 GB 0.0 3.1 1.2 1.9 5.9 4.0 2.7 2.1 150.3 283.6 21.24 19.70 51 0.416 3240K 4301 0.0 0.0 Int 0/0 0.00 KB 0.0 3.1 1.2 1.9 5.9 4.0 2.7 2.1 150.3 283.6 21.24 19.70 51 0.416 3240K 4301 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.1 1.2 1.9 3.1 1.2 0.0 0.0 240.3 240.0 13.28 12.60 12 1.107 3240K 4301 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.4 7.95 7.10 39 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.88 GB write, 665.85 MB/s write, 3.12 GB read, 352.91 MB/s read, 21.2 seconds Interval compaction: 5.88 GB write, 680.48 MB/s write, 3.12 GB read, 360.66 MB/s read, 21.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 672537 Average: 2.1307 StdDev: 13.58 Min: 0 Median: 1.4567 Max: 4439 Percentiles: P50: 1.46 P75: 1.82 P99: 5.39 P99.9: 9.96 P99.99: 14.83 ------------------------------------------------------ [ 0, 1 ] 127005 18.884% 18.884% #### ( 1, 2 ] 458199 68.130% 87.014% ############## ( 2, 3 ] 55150 8.200% 95.215% ## ( 3, 4 ] 17592 2.616% 97.830% # ( 4, 6 ] 11325 1.684% 99.514% ( 6, 10 ] 2623 0.390% 99.904% ( 10, 15 ] 597 0.089% 99.993% ( 15, 22 ] 51 0.008% 100.001% ( 22, 34 ] 9 0.001% 100.002% ( 34, 51 ] 6 0.001% 100.003% ( 51, 76 ] 1 0.000% 100.003% ( 110, 170 ] 16 0.002% 100.006% ( 170, 250 ] 16 0.002% 100.008% ( 250, 380 ] 14 0.002% 100.010% ( 380, 580 ] 14 0.002% 100.012% ( 580, 870 ] 11 0.002% 100.014% ( 870, 1300 ] 5 0.001% 100.014% ( 1300, 1900 ] 5 0.001% 100.015% ( 1900, 2900 ] 2 0.000% 100.015% ( 2900, 4400 ] 7 0.001% 100.017% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 63965 Average: 2.4467 StdDev: 20.64 Min: 1 Median: 1.5235 Max: 2358 Percentiles: P50: 1.52 P75: 1.88 P99: 5.51 P99.9: 11.55 P99.99: 1149.88 ------------------------------------------------------ [ 0, 1 ] 8706 13.611% 13.611% ### ( 1, 2 ] 44461 69.508% 83.119% ############## ( 2, 3 ] 7074 11.059% 94.178% ## ( 3, 4 ] 2048 3.202% 97.380% # ( 4, 6 ] 1371 2.143% 99.523% ( 6, 10 ] 224 0.350% 99.873% ( 10, 15 ] 55 0.086% 99.959% ( 15, 22 ] 1 0.002% 99.961% ( 22, 34 ] 1 0.002% 99.962% ( 34, 51 ] 1 0.002% 99.964% ( 110, 170 ] 1 0.002% 99.966% ( 170, 250 ] 1 0.002% 99.967% ( 250, 380 ] 6 0.009% 99.977% ( 380, 580 ] 3 0.005% 99.981% ( 580, 870 ] 3 0.005% 99.986% ( 870, 1300 ] 4 0.006% 99.992% ( 1300, 1900 ] 2 0.003% 99.995% ( 1900, 2900 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.4723 StdDev: 34.97 Min: 1 Median: 1.5205 Max: 6605 Percentiles: P50: 1.52 P75: 1.89 P99: 5.87 P99.9: 12.06 P99.99: 526.85 ------------------------------------------------------ [ 0, 1 ] 7260 15.134% 15.134% ### ( 1, 2 ] 32134 66.985% 82.119% ############# ( 2, 3 ] 4711 9.820% 91.939% ## ( 3, 4 ] 2092 4.361% 96.300% # ( 4, 6 ] 1386 2.889% 99.189% # ( 6, 10 ] 320 0.667% 99.856% ( 10, 15 ] 51 0.106% 99.962% ( 15, 22 ] 7 0.015% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 170, 250 ] 2 0.004% 99.985% ( 380, 580 ] 3 0.006% 99.992% ( 580, 870 ] 1 0.002% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42862 Average: 6.4100 StdDev: 141.45 Min: 1 Median: 1.7935 Max: 9267 Percentiles: P50: 1.79 P75: 2.54 P99: 8.26 P99.9: 635.00 P99.99: 8328.39 ------------------------------------------------------ [ 0, 1 ] 1709 3.987% 3.987% # ( 1, 2 ] 24855 57.988% 61.976% ############ ( 2, 3 ] 10331 24.103% 86.079% ##### ( 3, 4 ] 2564 5.982% 92.061% # ( 4, 6 ] 2648 6.178% 98.239% # ( 6, 10 ] 578 1.349% 99.587% ( 10, 15 ] 109 0.254% 99.841% ( 15, 22 ] 16 0.037% 99.879% ( 22, 34 ] 3 0.007% 99.886% ( 34, 51 ] 1 0.002% 99.888% ( 110, 170 ] 1 0.002% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 380, 580 ] 2 0.005% 99.897% ( 580, 870 ] 6 0.014% 99.911% ( 870, 1300 ] 4 0.009% 99.921% ( 1300, 1900 ] 6 0.014% 99.935% ( 1900, 2900 ] 6 0.014% 99.949% ( 2900, 4400 ] 4 0.009% 99.958% ( 4400, 6600 ] 9 0.021% 99.979% ( 6600, 9900 ] 9 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 221.3742 StdDev: 1054.75 Min: 0 Median: 1.8899 Max: 10022 Percentiles: P50: 1.89 P75: 6.34 P99: 6116.00 P99.9: 10022.00 P99.99: 10022.00 ------------------------------------------------------ [ 0, 1 ] 58 18.710% 18.710% #### ( 1, 2 ] 109 35.161% 53.871% ####### ( 2, 3 ] 40 12.903% 66.774% ### ( 3, 4 ] 11 3.548% 70.323% # ( 4, 6 ] 12 3.871% 74.194% # ( 6, 10 ] 29 9.355% 83.548% ## ( 10, 15 ] 18 5.806% 89.355% # ( 15, 22 ] 3 0.968% 90.323% ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 2 0.645% 91.290% ( 110, 170 ] 1 0.323% 91.613% ( 170, 250 ] 1 0.323% 91.935% ( 250, 380 ] 3 0.968% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 5 1.613% 95.161% ( 870, 1300 ] 2 0.645% 95.806% ( 1300, 1900 ] 3 0.968% 96.774% ( 1900, 2900 ] 1 0.323% 97.097% ( 2900, 4400 ] 2 0.645% 97.742% ( 4400, 6600 ] 5 1.613% 99.355% ( 6600, 9900 ] 1 0.323% 99.677% ( 9900, 14000 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 633.8500 StdDev: 789.48 Min: 83 Median: 250.0000 Max: 3155 Percentiles: P50: 250.00 P75: 870.00 P99: 3155.00 P99.9: 3155.00 P99.99: 3155.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 11 27.500% 45.000% ###### ( 170, 250 ] 2 5.000% 50.000% # ( 250, 380 ] 4 10.000% 60.000% ## ( 380, 580 ] 5 12.500% 72.500% ### ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.238 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.382 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/12-21:38:03 ... thread 0: (1000000,4000000) ops and (340493.1,339404.3) ops/second in (2.936917,11.785354) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 2.77 GB 12.6 2.2 0.0 2.2 5.8 3.7 0.0 1.6 117.2 317.9 18.82 17.56 60 0.314 2238K 2372 0.0 0.0 L1 3/3 235.84 MB 0.0 1.0 0.7 0.2 1.0 0.7 0.2 1.3 234.9 234.3 4.28 4.17 2 2.140 1020K 2441 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 14/0 771.36 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.6 1.0 231.4 231.4 0.81 0.75 1 0.809 190K 0 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 132.7 132.7 1.27 0.90 1 1.270 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/19 99.82 GB 0.0 3.7 1.2 2.5 7.4 4.9 2.7 2.0 144.7 290.0 25.98 24.14 66 0.394 3816K 4914 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.2 2.5 7.4 4.9 2.7 2.0 144.7 290.0 25.98 24.14 66 0.394 3816K 4914 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.2 2.5 3.7 1.2 0.0 0.0 244.1 243.8 15.40 14.68 14 1.100 3816K 4914 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 357.1 10.58 9.47 52 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.36 GB write, 628.77 MB/s write, 3.67 GB read, 313.72 MB/s read, 26.0 seconds Interval compaction: 7.36 GB write, 639.14 MB/s write, 3.67 GB read, 318.89 MB/s read, 26.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 919074 Average: 2.1309 StdDev: 13.51 Min: 0 Median: 1.4507 Max: 4439 Percentiles: P50: 1.45 P75: 1.82 P99: 5.34 P99.9: 10.27 P99.99: 18.09 ------------------------------------------------------ [ 0, 1 ] 176022 19.152% 19.152% #### ( 1, 2 ] 629118 68.451% 87.603% ############## ( 2, 3 ] 72412 7.879% 95.482% ## ( 3, 4 ] 22573 2.456% 97.938% ( 4, 6 ] 14542 1.582% 99.520% ( 6, 10 ] 3444 0.375% 99.895% ( 10, 15 ] 840 0.091% 99.987% ( 15, 22 ] 75 0.008% 99.995% ( 22, 34 ] 14 0.002% 99.996% ( 34, 51 ] 9 0.001% 99.997% ( 51, 76 ] 2 0.000% 99.997% ( 76, 110 ] 2 0.000% 99.998% ( 110, 170 ] 42 0.005% 100.002% ( 170, 250 ] 38 0.004% 100.006% ( 250, 380 ] 22 0.002% 100.009% ( 380, 580 ] 21 0.002% 100.011% ( 580, 870 ] 16 0.002% 100.013% ( 870, 1300 ] 10 0.001% 100.014% ( 1300, 1900 ] 7 0.001% 100.015% ( 1900, 2900 ] 5 0.001% 100.015% ( 2900, 4400 ] 8 0.001% 100.016% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 63966 Average: 2.4466 StdDev: 20.64 Min: 1 Median: 1.5235 Max: 2358 Percentiles: P50: 1.52 P75: 1.88 P99: 5.51 P99.9: 11.55 P99.99: 1149.87 ------------------------------------------------------ [ 0, 1 ] 8706 13.610% 13.610% ### ( 1, 2 ] 44462 69.509% 83.119% ############## ( 2, 3 ] 7074 11.059% 94.178% ## ( 3, 4 ] 2048 3.202% 97.380% # ( 4, 6 ] 1371 2.143% 99.523% ( 6, 10 ] 224 0.350% 99.873% ( 10, 15 ] 55 0.086% 99.959% ( 15, 22 ] 1 0.002% 99.961% ( 22, 34 ] 1 0.002% 99.962% ( 34, 51 ] 1 0.002% 99.964% ( 110, 170 ] 1 0.002% 99.966% ( 170, 250 ] 1 0.002% 99.967% ( 250, 380 ] 6 0.009% 99.977% ( 380, 580 ] 3 0.005% 99.981% ( 580, 870 ] 3 0.005% 99.986% ( 870, 1300 ] 4 0.006% 99.992% ( 1300, 1900 ] 2 0.003% 99.995% ( 1900, 2900 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.4723 StdDev: 34.97 Min: 1 Median: 1.5205 Max: 6605 Percentiles: P50: 1.52 P75: 1.89 P99: 5.87 P99.9: 12.06 P99.99: 526.85 ------------------------------------------------------ [ 0, 1 ] 7260 15.134% 15.134% ### ( 1, 2 ] 32134 66.985% 82.119% ############# ( 2, 3 ] 4711 9.820% 91.939% ## ( 3, 4 ] 2092 4.361% 96.300% # ( 4, 6 ] 1386 2.889% 99.189% # ( 6, 10 ] 320 0.667% 99.856% ( 10, 15 ] 51 0.106% 99.962% ( 15, 22 ] 7 0.015% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 170, 250 ] 2 0.004% 99.985% ( 380, 580 ] 3 0.006% 99.992% ( 580, 870 ] 1 0.002% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42862 Average: 6.4100 StdDev: 141.45 Min: 1 Median: 1.7935 Max: 9267 Percentiles: P50: 1.79 P75: 2.54 P99: 8.26 P99.9: 635.00 P99.99: 8328.39 ------------------------------------------------------ [ 0, 1 ] 1709 3.987% 3.987% # ( 1, 2 ] 24855 57.988% 61.976% ############ ( 2, 3 ] 10331 24.103% 86.079% ##### ( 3, 4 ] 2564 5.982% 92.061% # ( 4, 6 ] 2648 6.178% 98.239% # ( 6, 10 ] 578 1.349% 99.587% ( 10, 15 ] 109 0.254% 99.841% ( 15, 22 ] 16 0.037% 99.879% ( 22, 34 ] 3 0.007% 99.886% ( 34, 51 ] 1 0.002% 99.888% ( 110, 170 ] 1 0.002% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 380, 580 ] 2 0.005% 99.897% ( 580, 870 ] 6 0.014% 99.911% ( 870, 1300 ] 4 0.009% 99.921% ( 1300, 1900 ] 6 0.014% 99.935% ( 1900, 2900 ] 6 0.014% 99.949% ( 2900, 4400 ] 4 0.009% 99.958% ( 4400, 6600 ] 9 0.021% 99.979% ( 6600, 9900 ] 9 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 221.3742 StdDev: 1054.75 Min: 0 Median: 1.8899 Max: 10022 Percentiles: P50: 1.89 P75: 6.34 P99: 6116.00 P99.9: 10022.00 P99.99: 10022.00 ------------------------------------------------------ [ 0, 1 ] 58 18.710% 18.710% #### ( 1, 2 ] 109 35.161% 53.871% ####### ( 2, 3 ] 40 12.903% 66.774% ### ( 3, 4 ] 11 3.548% 70.323% # ( 4, 6 ] 12 3.871% 74.194% # ( 6, 10 ] 29 9.355% 83.548% ## ( 10, 15 ] 18 5.806% 89.355% # ( 15, 22 ] 3 0.968% 90.323% ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 2 0.645% 91.290% ( 110, 170 ] 1 0.323% 91.613% ( 170, 250 ] 1 0.323% 91.935% ( 250, 380 ] 3 0.968% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 5 1.613% 95.161% ( 870, 1300 ] 2 0.645% 95.806% ( 1300, 1900 ] 3 0.968% 96.774% ( 1900, 2900 ] 1 0.323% 97.097% ( 2900, 4400 ] 2 0.645% 97.742% ( 4400, 6600 ] 5 1.613% 99.355% ( 6600, 9900 ] 1 0.323% 99.677% ( 9900, 14000 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 633.8500 StdDev: 789.48 Min: 83 Median: 250.0000 Max: 3155 Percentiles: P50: 250.00 P75: 870.00 P99: 3155.00 P99.9: 3155.00 P99.99: 3155.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 11 27.500% 45.000% ###### ( 170, 250 ] 2 5.000% 50.000% # ( 250, 380 ] 4 10.000% 60.000% ## ( 380, 580 ] 5 12.500% 72.500% ### ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.650 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 335.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-21:38:08 ... thread 0: (1000000,5000000) ops and (190037.8,293298.7) ops/second in (5.262111,17.047465) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.75 GB 37.8 3.4 0.0 3.4 8.1 4.7 0.0 1.7 132.1 311.2 26.71 25.06 81 0.330 3582K 3700 0.0 0.0 L1 3/3 235.84 MB 0.0 1.0 0.7 0.2 1.0 0.7 0.2 1.3 234.9 234.3 4.28 4.17 2 2.140 1020K 2441 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.6 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 14/0 771.36 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.6 1.0 231.4 231.4 0.81 0.75 1 0.809 190K 0 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 132.7 132.7 1.27 0.90 1 1.270 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/20 100.81 GB 0.0 5.0 1.2 3.8 9.6 5.9 2.7 2.1 150.0 291.2 33.87 31.64 87 0.389 5159K 6242 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.2 3.8 9.6 5.9 2.7 2.1 150.0 291.2 33.87 31.64 87 0.389 5159K 6242 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.2 3.8 5.0 1.2 0.0 0.0 249.3 248.9 20.39 19.59 19 1.073 5159K 6242 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.1 13.48 12.06 68 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.2 total, 17.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.63 GB write, 571.99 MB/s write, 4.96 GB read, 294.71 MB/s read, 33.9 seconds Interval compaction: 9.63 GB write, 578.52 MB/s write, 4.96 GB read, 298.07 MB/s read, 33.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 15, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1557987 Average: 2.1760 StdDev: 12.26 Min: 0 Median: 1.4825 Max: 4439 Percentiles: P50: 1.48 P75: 1.84 P99: 5.47 P99.9: 9.95 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 257789 16.546% 16.546% ### ( 1, 2 ] 1080294 69.339% 85.885% ############## ( 2, 3 ] 142265 9.131% 95.017% ## ( 3, 4 ] 42076 2.701% 97.717% # ( 4, 6 ] 27266 1.750% 99.467% ( 6, 10 ] 6823 0.438% 99.905% ( 10, 15 ] 1323 0.085% 99.990% ( 15, 22 ] 118 0.008% 99.998% ( 22, 34 ] 19 0.001% 99.999% ( 34, 51 ] 12 0.001% 100.000% ( 51, 76 ] 5 0.000% 100.000% ( 76, 110 ] 36 0.002% 100.003% ( 110, 170 ] 97 0.006% 100.009% ( 170, 250 ] 63 0.004% 100.013% ( 250, 380 ] 35 0.002% 100.015% ( 380, 580 ] 38 0.002% 100.017% ( 580, 870 ] 30 0.002% 100.019% ( 870, 1300 ] 18 0.001% 100.021% ( 1300, 1900 ] 8 0.001% 100.021% ( 1900, 2900 ] 7 0.000% 100.022% ( 2900, 4400 ] 11 0.001% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 63966 Average: 2.4466 StdDev: 20.64 Min: 1 Median: 1.5235 Max: 2358 Percentiles: P50: 1.52 P75: 1.88 P99: 5.51 P99.9: 11.55 P99.99: 1149.87 ------------------------------------------------------ [ 0, 1 ] 8706 13.610% 13.610% ### ( 1, 2 ] 44462 69.509% 83.119% ############## ( 2, 3 ] 7074 11.059% 94.178% ## ( 3, 4 ] 2048 3.202% 97.380% # ( 4, 6 ] 1371 2.143% 99.523% ( 6, 10 ] 224 0.350% 99.873% ( 10, 15 ] 55 0.086% 99.959% ( 15, 22 ] 1 0.002% 99.961% ( 22, 34 ] 1 0.002% 99.962% ( 34, 51 ] 1 0.002% 99.964% ( 110, 170 ] 1 0.002% 99.966% ( 170, 250 ] 1 0.002% 99.967% ( 250, 380 ] 6 0.009% 99.977% ( 380, 580 ] 3 0.005% 99.981% ( 580, 870 ] 3 0.005% 99.986% ( 870, 1300 ] 4 0.006% 99.992% ( 1300, 1900 ] 2 0.003% 99.995% ( 1900, 2900 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 47972 Average: 2.4723 StdDev: 34.97 Min: 1 Median: 1.5205 Max: 6605 Percentiles: P50: 1.52 P75: 1.89 P99: 5.87 P99.9: 12.06 P99.99: 526.85 ------------------------------------------------------ [ 0, 1 ] 7260 15.134% 15.134% ### ( 1, 2 ] 32134 66.985% 82.119% ############# ( 2, 3 ] 4711 9.820% 91.939% ## ( 3, 4 ] 2092 4.361% 96.300% # ( 4, 6 ] 1386 2.889% 99.189% # ( 6, 10 ] 320 0.667% 99.856% ( 10, 15 ] 51 0.106% 99.962% ( 15, 22 ] 7 0.015% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 170, 250 ] 2 0.004% 99.985% ( 380, 580 ] 3 0.006% 99.992% ( 580, 870 ] 1 0.002% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42862 Average: 6.4100 StdDev: 141.45 Min: 1 Median: 1.7935 Max: 9267 Percentiles: P50: 1.79 P75: 2.54 P99: 8.26 P99.9: 635.00 P99.99: 8328.39 ------------------------------------------------------ [ 0, 1 ] 1709 3.987% 3.987% # ( 1, 2 ] 24855 57.988% 61.976% ############ ( 2, 3 ] 10331 24.103% 86.079% ##### ( 3, 4 ] 2564 5.982% 92.061% # ( 4, 6 ] 2648 6.178% 98.239% # ( 6, 10 ] 578 1.349% 99.587% ( 10, 15 ] 109 0.254% 99.841% ( 15, 22 ] 16 0.037% 99.879% ( 22, 34 ] 3 0.007% 99.886% ( 34, 51 ] 1 0.002% 99.888% ( 110, 170 ] 1 0.002% 99.890% ( 170, 250 ] 1 0.002% 99.893% ( 380, 580 ] 2 0.005% 99.897% ( 580, 870 ] 6 0.014% 99.911% ( 870, 1300 ] 4 0.009% 99.921% ( 1300, 1900 ] 6 0.014% 99.935% ( 1900, 2900 ] 6 0.014% 99.949% ( 2900, 4400 ] 4 0.009% 99.958% ( 4400, 6600 ] 9 0.021% 99.979% ( 6600, 9900 ] 9 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 221.3742 StdDev: 1054.75 Min: 0 Median: 1.8899 Max: 10022 Percentiles: P50: 1.89 P75: 6.34 P99: 6116.00 P99.9: 10022.00 P99.99: 10022.00 ------------------------------------------------------ [ 0, 1 ] 58 18.710% 18.710% #### ( 1, 2 ] 109 35.161% 53.871% ####### ( 2, 3 ] 40 12.903% 66.774% ### ( 3, 4 ] 11 3.548% 70.323% # ( 4, 6 ] 12 3.871% 74.194% # ( 6, 10 ] 29 9.355% 83.548% ## ( 10, 15 ] 18 5.806% 89.355% # ( 15, 22 ] 3 0.968% 90.323% ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 2 0.645% 91.290% ( 110, 170 ] 1 0.323% 91.613% ( 170, 250 ] 1 0.323% 91.935% ( 250, 380 ] 3 0.968% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 5 1.613% 95.161% ( 870, 1300 ] 2 0.645% 95.806% ( 1300, 1900 ] 3 0.968% 96.774% ( 1900, 2900 ] 1 0.323% 97.097% ( 2900, 4400 ] 2 0.645% 97.742% ( 4400, 6600 ] 5 1.613% 99.355% ( 6600, 9900 ] 1 0.323% 99.677% ( 9900, 14000 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 633.8500 StdDev: 789.48 Min: 83 Median: 250.0000 Max: 3155 Percentiles: P50: 250.00 P75: 870.00 P99: 3155.00 P99.9: 3155.00 P99.99: 3155.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 11 27.500% 45.000% ###### ( 170, 250 ] 2 5.000% 50.000% # ( 250, 380 ] 4 10.000% 60.000% ## ( 380, 580 ] 5 12.500% 72.500% ### ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 17.2 total, 5.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 285.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.261 H:M:S, 24.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 187.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.611 H:M:S, 49.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-21:38:15 ... thread 0: (1000000,6000000) ops and (135910.7,245848.9) ops/second in (7.357774,24.405239) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 2.39 GB 0.0 4.7 0.0 4.7 10.4 5.7 0.0 1.8 138.6 304.1 34.98 32.59 97 0.361 4924K 8506 0.0 0.0 L1 13/13 1.53 GB 0.0 3.5 3.1 0.5 3.5 3.0 0.2 1.1 228.5 226.3 15.90 15.30 3 5.299 3688K 34K 0.0 0.0 L2 5/4 643.90 MB 1.3 0.2 0.1 0.1 0.2 0.1 1.6 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 24/3 1.13 GB 1.0 1.0 0.6 0.5 1.0 0.6 0.6 1.9 208.5 207.8 5.14 4.69 4 1.286 1089K 4123 0.0 0.0 L4 173/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 132.7 132.7 1.27 0.90 1 1.270 171K 0 0.0 0.0 L5 1048/0 86.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/34 101.75 GB 0.0 9.7 3.9 5.8 15.3 9.5 3.7 2.7 170.7 269.6 58.10 54.24 107 0.543 10M 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.7 3.9 5.8 15.3 9.5 3.7 2.7 170.7 269.6 58.10 54.24 107 0.543 10M 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.7 3.9 5.8 9.6 3.9 0.0 0.0 239.5 238.3 41.41 39.55 25 1.656 10M 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 347.3 16.69 14.69 82 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.6 total, 24.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.30 GB write, 636.74 MB/s write, 9.68 GB read, 403.09 MB/s read, 58.1 seconds Interval compaction: 15.30 GB write, 641.82 MB/s write, 9.68 GB read, 406.30 MB/s read, 58.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 19, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2283706 Average: 2.4139 StdDev: 14.42 Min: 0 Median: 1.5193 Max: 6616 Percentiles: P50: 1.52 P75: 1.89 P99: 5.93 P99.9: 15.43 P99.99: 169.98 ------------------------------------------------------ [ 0, 1 ] 333196 14.590% 14.590% ### ( 1, 2 ] 1557174 68.186% 82.776% ############## ( 2, 3 ] 245116 10.733% 93.510% ## ( 3, 4 ] 72511 3.175% 96.685% # ( 4, 6 ] 54858 2.402% 99.087% ( 6, 10 ] 15821 0.693% 99.780% ( 10, 15 ] 2723 0.119% 99.899% ( 15, 22 ] 394 0.017% 99.916% ( 22, 34 ] 34 0.001% 99.918% ( 34, 51 ] 15 0.001% 99.918% ( 51, 76 ] 6 0.000% 99.919% ( 76, 110 ] 605 0.026% 99.945% ( 110, 170 ] 1026 0.045% 99.990% ( 170, 250 ] 277 0.012% 100.002% ( 250, 380 ] 203 0.009% 100.011% ( 380, 580 ] 159 0.007% 100.018% ( 580, 870 ] 86 0.004% 100.022% ( 870, 1300 ] 32 0.001% 100.023% ( 1300, 1900 ] 14 0.001% 100.024% ( 1900, 2900 ] 8 0.000% 100.024% ( 2900, 4400 ] 17 0.001% 100.025% ( 4400, 6600 ] 1 0.000% 100.025% ( 6600, 9900 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 441178 Average: 3.4739 StdDev: 22.21 Min: 1 Median: 1.7710 Max: 2457 Percentiles: P50: 1.77 P75: 2.58 P99: 9.12 P99.9: 124.68 P99.99: 304.88 ------------------------------------------------------ [ 0, 1 ] 22464 5.092% 5.092% # ( 1, 2 ] 256963 58.245% 63.337% ############ ( 2, 3 ] 88893 20.149% 83.486% #### ( 3, 4 ] 31141 7.059% 90.544% # ( 4, 6 ] 31209 7.074% 97.618% # ( 6, 10 ] 7804 1.769% 99.387% ( 10, 15 ] 1867 0.423% 99.810% ( 15, 22 ] 183 0.041% 99.852% ( 22, 34 ] 14 0.003% 99.855% ( 34, 51 ] 6 0.001% 99.856% ( 51, 76 ] 1 0.000% 99.857% ( 76, 110 ] 138 0.031% 99.888% ( 110, 170 ] 220 0.050% 99.938% ( 170, 250 ] 157 0.036% 99.973% ( 250, 380 ] 175 0.040% 100.013% ( 380, 580 ] 160 0.036% 100.049% ( 580, 870 ] 92 0.021% 100.070% ( 870, 1300 ] 53 0.012% 100.082% ( 1300, 1900 ] 8 0.002% 100.084% ( 1900, 2900 ] 6 0.001% 100.085% ** Level 2 read latency histogram (micros): Count: 64943 Average: 3.4038 StdDev: 36.26 Min: 1 Median: 1.6159 Max: 6605 Percentiles: P50: 1.62 P75: 2.07 P99: 8.22 P99.9: 385.42 P99.99: 1124.31 ------------------------------------------------------ [ 0, 1 ] 7451 11.473% 11.473% ## ( 1, 2 ] 40621 62.549% 74.022% ############# ( 2, 3 ] 8985 13.835% 87.857% ### ( 3, 4 ] 3858 5.941% 93.798% # ( 4, 6 ] 2979 4.587% 98.385% # ( 6, 10 ] 720 1.109% 99.493% ( 10, 15 ] 151 0.233% 99.726% ( 15, 22 ] 21 0.032% 99.758% ( 22, 34 ] 6 0.009% 99.767% ( 51, 76 ] 1 0.002% 99.769% ( 76, 110 ] 3 0.005% 99.774% ( 110, 170 ] 28 0.043% 99.817% ( 170, 250 ] 33 0.051% 99.868% ( 250, 380 ] 20 0.031% 99.898% ( 380, 580 ] 39 0.060% 99.958% ( 580, 870 ] 14 0.022% 99.980% ( 870, 1300 ] 11 0.017% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 81205 Average: 5.5482 StdDev: 105.99 Min: 1 Median: 1.8362 Max: 9267 Percentiles: P50: 1.84 P75: 2.67 P99: 9.42 P99.9: 655.35 P99.99: 6922.48 ------------------------------------------------------ [ 0, 1 ] 2639 3.250% 3.250% # ( 1, 2 ] 45399 55.907% 59.156% ########### ( 2, 3 ] 19107 23.529% 82.686% ##### ( 3, 4 ] 5920 7.290% 89.976% # ( 4, 6 ] 6131 7.550% 97.526% ## ( 6, 10 ] 1398 1.722% 99.248% ( 10, 15 ] 388 0.478% 99.725% ( 15, 22 ] 55 0.068% 99.793% ( 22, 34 ] 4 0.005% 99.798% ( 34, 51 ] 3 0.004% 99.802% ( 110, 170 ] 12 0.015% 99.817% ( 170, 250 ] 15 0.018% 99.835% ( 250, 380 ] 17 0.021% 99.856% ( 380, 580 ] 28 0.034% 99.890% ( 580, 870 ] 30 0.037% 99.927% ( 870, 1300 ] 19 0.023% 99.951% ( 1300, 1900 ] 10 0.012% 99.963% ( 1900, 2900 ] 8 0.010% 99.973% ( 2900, 4400 ] 4 0.005% 99.978% ( 4400, 6600 ] 9 0.011% 99.989% ( 6600, 9900 ] 9 0.011% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 221.3742 StdDev: 1054.75 Min: 0 Median: 1.8899 Max: 10022 Percentiles: P50: 1.89 P75: 6.34 P99: 6116.00 P99.9: 10022.00 P99.99: 10022.00 ------------------------------------------------------ [ 0, 1 ] 58 18.710% 18.710% #### ( 1, 2 ] 109 35.161% 53.871% ####### ( 2, 3 ] 40 12.903% 66.774% ### ( 3, 4 ] 11 3.548% 70.323% # ( 4, 6 ] 12 3.871% 74.194% # ( 6, 10 ] 29 9.355% 83.548% ## ( 10, 15 ] 18 5.806% 89.355% # ( 15, 22 ] 3 0.968% 90.323% ( 22, 34 ] 1 0.323% 90.645% ( 76, 110 ] 2 0.645% 91.290% ( 110, 170 ] 1 0.323% 91.613% ( 170, 250 ] 1 0.323% 91.935% ( 250, 380 ] 3 0.968% 92.903% ( 380, 580 ] 2 0.645% 93.548% ( 580, 870 ] 5 1.613% 95.161% ( 870, 1300 ] 2 0.645% 95.806% ( 1300, 1900 ] 3 0.968% 96.774% ( 1900, 2900 ] 1 0.323% 97.097% ( 2900, 4400 ] 2 0.645% 97.742% ( 4400, 6600 ] 5 1.613% 99.355% ( 6600, 9900 ] 1 0.323% 99.677% ( 9900, 14000 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 633.8500 StdDev: 789.48 Min: 83 Median: 250.0000 Max: 3155 Percentiles: P50: 250.00 P75: 870.00 P99: 3155.00 P99.9: 3155.00 P99.99: 3155.00 ------------------------------------------------------ ( 76, 110 ] 7 17.500% 17.500% #### ( 110, 170 ] 11 27.500% 45.000% ###### ( 170, 250 ] 2 5.000% 50.000% # ( 250, 380 ] 4 10.000% 60.000% ## ( 380, 580 ] 5 12.500% 72.500% ### ( 580, 870 ] 1 2.500% 75.000% # ( 870, 1300 ] 2 5.000% 80.000% # ( 1300, 1900 ] 4 10.000% 90.000% ## ( 1900, 2900 ] 3 7.500% 97.500% ## ( 2900, 4400 ] 1 2.500% 100.000% # ** DB Stats ** Uptime(secs): 24.6 total, 7.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 240.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.870 H:M:S, 36.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 133.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.609 H:M:S, 62.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/12-21:38:19 ... thread 0: (1000000,7000000) ops and (270114.4,249045.0) ops/second in (3.702135,28.107374) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.38 GB 100.7 5.7 0.0 5.7 12.3 6.6 0.0 1.9 136.8 297.2 42.36 38.91 113 0.375 5883K 9595 0.0 0.0 L1 13/13 1.53 GB 0.0 3.5 3.1 0.5 3.5 3.0 0.2 1.1 228.5 226.3 15.90 15.30 3 5.299 3688K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.6 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 23/0 958.06 MB 1.0 2.0 1.2 0.8 2.0 1.2 0.6 1.7 200.3 199.5 10.13 9.02 7 1.446 2060K 9100 0.0 0.0 L4 176/0 9.47 GB 1.0 0.9 0.9 0.0 0.9 0.9 0.7 1.0 136.6 136.4 6.88 4.57 16 0.430 947K 1197 0.0 0.0 L5 1060/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/27 102.73 GB 0.0 12.3 5.3 7.0 18.9 11.9 4.8 2.8 165.5 254.2 76.06 68.56 141 0.539 12M 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.3 5.3 7.0 18.9 11.9 4.8 2.8 165.5 254.2 76.06 68.56 141 0.539 12M 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.3 5.3 7.0 12.2 5.2 0.0 0.0 225.2 224.2 55.91 51.27 46 1.215 12M 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 337.6 20.15 17.29 95 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.3 total, 28.1 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.88 GB write, 683.20 MB/s write, 12.29 GB read, 444.76 MB/s read, 76.1 seconds Interval compaction: 18.88 GB write, 687.93 MB/s write, 12.29 GB read, 447.84 MB/s read, 76.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 36, interval: 50 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2661970 Average: 2.5003 StdDev: 19.84 Min: 0 Median: 1.5454 Max: 9051 Percentiles: P50: 1.55 P75: 1.92 P99: 6.11 P99.9: 14.72 P99.99: 167.15 ------------------------------------------------------ [ 0, 1 ] 357123 13.416% 13.416% ### ( 1, 2 ] 1785746 67.084% 80.499% ############# ( 2, 3 ] 317505 11.927% 92.427% ## ( 3, 4 ] 95020 3.570% 95.996% # ( 4, 6 ] 79405 2.983% 98.979% # ( 6, 10 ] 20967 0.788% 99.767% ( 10, 15 ] 3757 0.141% 99.908% ( 15, 22 ] 488 0.018% 99.926% ( 22, 34 ] 38 0.001% 99.928% ( 34, 51 ] 17 0.001% 99.928% ( 51, 76 ] 6 0.000% 99.929% ( 76, 110 ] 628 0.024% 99.952% ( 110, 170 ] 1056 0.040% 99.992% ( 170, 250 ] 290 0.011% 100.003% ( 250, 380 ] 216 0.008% 100.011% ( 380, 580 ] 181 0.007% 100.018% ( 580, 870 ] 101 0.004% 100.022% ( 870, 1300 ] 43 0.002% 100.023% ( 1300, 1900 ] 22 0.001% 100.024% ( 1900, 2900 ] 16 0.001% 100.025% ( 2900, 4400 ] 30 0.001% 100.026% ( 4400, 6600 ] 6 0.000% 100.026% ( 6600, 9900 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 560448 Average: 3.6687 StdDev: 40.86 Min: 1 Median: 1.7661 Max: 10413 Percentiles: P50: 1.77 P75: 2.56 P99: 9.19 P99.9: 143.36 P99.99: 363.96 ------------------------------------------------------ [ 0, 1 ] 28279 5.046% 5.046% # ( 1, 2 ] 328848 58.676% 63.722% ############ ( 2, 3 ] 112417 20.058% 83.780% #### ( 3, 4 ] 38205 6.817% 90.597% # ( 4, 6 ] 38832 6.929% 97.526% # ( 6, 10 ] 10373 1.851% 99.377% ( 10, 15 ] 2376 0.424% 99.801% ( 15, 22 ] 221 0.039% 99.840% ( 22, 34 ] 17 0.003% 99.843% ( 34, 51 ] 7 0.001% 99.844% ( 51, 76 ] 2 0.000% 99.845% ( 76, 110 ] 151 0.027% 99.872% ( 110, 170 ] 287 0.051% 99.923% ( 170, 250 ] 199 0.036% 99.958% ( 250, 380 ] 203 0.036% 99.994% ( 380, 580 ] 186 0.033% 100.028% ( 580, 870 ] 104 0.019% 100.046% ( 870, 1300 ] 66 0.012% 100.058% ( 1300, 1900 ] 16 0.003% 100.061% ( 1900, 2900 ] 20 0.004% 100.064% ( 2900, 4400 ] 10 0.002% 100.066% ( 4400, 6600 ] 4 0.001% 100.067% ( 6600, 9900 ] 4 0.001% 100.068% ( 9900, 14000 ] 1 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 64943 Average: 3.4038 StdDev: 36.26 Min: 1 Median: 1.6159 Max: 6605 Percentiles: P50: 1.62 P75: 2.07 P99: 8.22 P99.9: 385.42 P99.99: 1124.31 ------------------------------------------------------ [ 0, 1 ] 7451 11.473% 11.473% ## ( 1, 2 ] 40621 62.549% 74.022% ############# ( 2, 3 ] 8985 13.835% 87.857% ### ( 3, 4 ] 3858 5.941% 93.798% # ( 4, 6 ] 2979 4.587% 98.385% # ( 6, 10 ] 720 1.109% 99.493% ( 10, 15 ] 151 0.233% 99.726% ( 15, 22 ] 21 0.032% 99.758% ( 22, 34 ] 6 0.009% 99.767% ( 51, 76 ] 1 0.002% 99.769% ( 76, 110 ] 3 0.005% 99.774% ( 110, 170 ] 28 0.043% 99.817% ( 170, 250 ] 33 0.051% 99.868% ( 250, 380 ] 20 0.031% 99.898% ( 380, 580 ] 39 0.060% 99.958% ( 580, 870 ] 14 0.022% 99.980% ( 870, 1300 ] 11 0.017% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 305009 Average: 4.0998 StdDev: 64.09 Min: 1 Median: 2.0188 Max: 9267 Percentiles: P50: 2.02 P75: 2.99 P99: 8.78 P99.9: 13.72 P99.99: 14.86 ------------------------------------------------------ [ 0, 1 ] 5131 1.682% 1.682% ( 1, 2 ] 145890 47.831% 49.514% ########## ( 2, 3 ] 78820 25.842% 75.355% ##### ( 3, 4 ] 31363 10.283% 85.638% ## ( 4, 6 ] 36540 11.980% 97.618% ## ( 6, 10 ] 6068 1.989% 99.608% ( 10, 15 ] 1200 0.393% 100.001% ( 15, 22 ] 165 0.054% 100.055% ( 22, 34 ] 13 0.004% 100.059% ( 34, 51 ] 4 0.001% 100.061% ( 51, 76 ] 1 0.000% 100.061% ( 76, 110 ] 17 0.006% 100.067% ( 110, 170 ] 34 0.011% 100.078% ( 170, 250 ] 34 0.011% 100.089% ( 250, 380 ] 31 0.010% 100.099% ( 380, 580 ] 35 0.011% 100.110% ( 580, 870 ] 38 0.012% 100.123% ( 870, 1300 ] 22 0.007% 100.130% ( 1300, 1900 ] 12 0.004% 100.134% ( 1900, 2900 ] 14 0.005% 100.139% ( 2900, 4400 ] 18 0.006% 100.145% ( 4400, 6600 ] 10 0.003% 100.148% ( 6600, 9900 ] 10 0.003% 100.151% ** Level 4 read latency histogram (micros): Count: 11605 Average: 78.6551 StdDev: 372.41 Min: 0 Median: 2.2686 Max: 10022 Percentiles: P50: 2.27 P75: 3.67 P99: 1714.44 P99.9: 4479.00 P99.99: 6567.90 ------------------------------------------------------ [ 0, 1 ] 294 2.533% 2.533% # ( 1, 2 ] 4776 41.155% 43.688% ######## ( 2, 3 ] 2727 23.498% 67.187% ##### ( 3, 4 ] 1357 11.693% 78.880% ## ( 4, 6 ] 1025 8.832% 87.712% ## ( 6, 10 ] 261 2.249% 89.961% ( 10, 15 ] 133 1.146% 91.107% ( 15, 22 ] 10 0.086% 91.193% ( 22, 34 ] 1 0.009% 91.202% ( 76, 110 ] 16 0.138% 91.340% ( 110, 170 ] 87 0.750% 92.090% ( 170, 250 ] 98 0.844% 92.934% ( 250, 380 ] 119 1.025% 93.960% ( 380, 580 ] 190 1.637% 95.597% ( 580, 870 ] 208 1.792% 97.389% ( 870, 1300 ] 131 1.129% 98.518% ( 1300, 1900 ] 81 0.698% 99.216% ( 1900, 2900 ] 37 0.319% 99.535% ( 2900, 4400 ] 42 0.362% 99.897% ( 4400, 6600 ] 11 0.095% 99.991% ( 6600, 9900 ] 1 0.009% 100.000% ( 9900, 14000 ] 1 0.009% 100.009% ** Level 5 read latency histogram (micros): Count: 100 Average: 967.5500 StdDev: 1139.41 Min: 83 Median: 494.2857 Max: 4586 Percentiles: P50: 494.29 P75: 1257.00 P99: 4400.00 P99.9: 4586.00 P99.99: 4586.00 ------------------------------------------------------ ( 76, 110 ] 9 9.000% 9.000% ## ( 110, 170 ] 17 17.000% 26.000% ### ( 170, 250 ] 9 9.000% 35.000% ## ( 250, 380 ] 11 11.000% 46.000% ## ( 380, 580 ] 7 7.000% 53.000% # ( 580, 870 ] 13 13.000% 66.000% ### ( 870, 1300 ] 10 10.000% 76.000% ## ( 1300, 1900 ] 7 7.000% 83.000% # ( 1900, 2900 ] 7 7.000% 90.000% # ( 2900, 4400 ] 9 9.000% 99.000% ## ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 28.3 total, 3.7 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 243.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.936 H:M:S, 35.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 265.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.066 H:M:S, 28.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/12-21:38:22 ... thread 0: (1000000,8000000) ops and (313133.6,255583.7) ops/second in (3.193525,31.300899) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 4.30 GB 226.5 6.8 0.0 6.8 14.3 7.6 0.0 1.9 139.9 296.0 49.54 45.68 130 0.381 7035K 10K 0.0 0.0 L1 13/13 1.53 GB 0.0 3.5 3.1 0.5 3.5 3.0 0.2 1.1 228.5 226.3 15.90 15.30 3 5.299 3688K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.6 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 23/0 958.06 MB 1.0 2.0 1.2 0.8 2.0 1.2 0.6 1.7 200.3 199.5 10.13 9.02 7 1.446 2060K 9100 0.0 0.0 L4 176/0 9.47 GB 1.0 0.9 0.9 0.0 0.9 0.9 0.7 1.0 136.6 136.4 6.88 4.57 16 0.430 947K 1197 0.0 0.0 L5 1060/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/23 103.65 GB 0.0 13.4 5.3 8.1 20.9 12.8 4.8 2.8 164.8 257.2 83.25 75.34 158 0.527 13M 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.4 5.3 8.1 20.9 12.8 4.8 2.8 164.8 257.2 83.25 75.34 158 0.527 13M 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.4 5.3 8.1 13.3 5.2 0.0 0.0 227.5 226.6 60.31 55.58 50 1.206 13M 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 337.9 22.93 19.76 108 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.5 total, 31.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.91 GB write, 679.89 MB/s write, 13.40 GB read, 435.67 MB/s read, 83.2 seconds Interval compaction: 20.91 GB write, 684.11 MB/s write, 13.40 GB read, 438.38 MB/s read, 83.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 39, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2954890 Average: 2.5056 StdDev: 19.40 Min: 0 Median: 1.5486 Max: 9051 Percentiles: P50: 1.55 P75: 1.92 P99: 6.03 P99.9: 14.71 P99.99: 171.10 ------------------------------------------------------ [ 0, 1 ] 387153 13.102% 13.102% ### ( 1, 2 ] 1987340 67.256% 80.358% ############# ( 2, 3 ] 358221 12.123% 92.481% ## ( 3, 4 ] 104944 3.552% 96.033% # ( 4, 6 ] 87531 2.962% 98.995% # ( 6, 10 ] 22987 0.778% 99.773% ( 10, 15 ] 3987 0.135% 99.908% ( 15, 22 ] 517 0.017% 99.925% ( 22, 34 ] 42 0.001% 99.927% ( 34, 51 ] 19 0.001% 99.927% ( 51, 76 ] 7 0.000% 99.928% ( 76, 110 ] 680 0.023% 99.951% ( 110, 170 ] 1162 0.039% 99.990% ( 170, 250 ] 328 0.011% 100.001% ( 250, 380 ] 254 0.009% 100.010% ( 380, 580 ] 216 0.007% 100.017% ( 580, 870 ] 116 0.004% 100.021% ( 870, 1300 ] 54 0.002% 100.023% ( 1300, 1900 ] 27 0.001% 100.024% ( 1900, 2900 ] 17 0.001% 100.024% ( 2900, 4400 ] 31 0.001% 100.025% ( 4400, 6600 ] 6 0.000% 100.025% ( 6600, 9900 ] 4 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 660915 Average: 3.5405 StdDev: 38.13 Min: 1 Median: 1.7360 Max: 10413 Percentiles: P50: 1.74 P75: 2.48 P99: 9.10 P99.9: 148.65 P99.99: 370.50 ------------------------------------------------------ [ 0, 1 ] 37495 5.673% 5.673% # ( 1, 2 ] 398045 60.226% 65.900% ############ ( 2, 3 ] 126608 19.156% 85.056% #### ( 3, 4 ] 41284 6.246% 91.303% # ( 4, 6 ] 41541 6.285% 97.588% # ( 6, 10 ] 12040 1.822% 99.410% ( 10, 15 ] 2526 0.382% 99.792% ( 15, 22 ] 228 0.034% 99.826% ( 22, 34 ] 18 0.003% 99.829% ( 34, 51 ] 7 0.001% 99.830% ( 51, 76 ] 4 0.001% 99.831% ( 76, 110 ] 212 0.032% 99.863% ( 110, 170 ] 382 0.058% 99.921% ( 170, 250 ] 242 0.037% 99.957% ( 250, 380 ] 234 0.035% 99.993% ( 380, 580 ] 196 0.030% 100.022% ( 580, 870 ] 110 0.017% 100.039% ( 870, 1300 ] 66 0.010% 100.049% ( 1300, 1900 ] 17 0.003% 100.051% ( 1900, 2900 ] 20 0.003% 100.054% ( 2900, 4400 ] 11 0.002% 100.056% ( 4400, 6600 ] 4 0.001% 100.057% ( 6600, 9900 ] 4 0.001% 100.057% ( 9900, 14000 ] 1 0.000% 100.057% ** Level 2 read latency histogram (micros): Count: 64943 Average: 3.4038 StdDev: 36.26 Min: 1 Median: 1.6159 Max: 6605 Percentiles: P50: 1.62 P75: 2.07 P99: 8.22 P99.9: 385.42 P99.99: 1124.31 ------------------------------------------------------ [ 0, 1 ] 7451 11.473% 11.473% ## ( 1, 2 ] 40621 62.549% 74.022% ############# ( 2, 3 ] 8985 13.835% 87.857% ### ( 3, 4 ] 3858 5.941% 93.798% # ( 4, 6 ] 2979 4.587% 98.385% # ( 6, 10 ] 720 1.109% 99.493% ( 10, 15 ] 151 0.233% 99.726% ( 15, 22 ] 21 0.032% 99.758% ( 22, 34 ] 6 0.009% 99.767% ( 51, 76 ] 1 0.002% 99.769% ( 76, 110 ] 3 0.005% 99.774% ( 110, 170 ] 28 0.043% 99.817% ( 170, 250 ] 33 0.051% 99.868% ( 250, 380 ] 20 0.031% 99.898% ( 380, 580 ] 39 0.060% 99.958% ( 580, 870 ] 14 0.022% 99.980% ( 870, 1300 ] 11 0.017% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 305009 Average: 4.0998 StdDev: 64.09 Min: 1 Median: 2.0188 Max: 9267 Percentiles: P50: 2.02 P75: 2.99 P99: 8.78 P99.9: 13.72 P99.99: 14.86 ------------------------------------------------------ [ 0, 1 ] 5131 1.682% 1.682% ( 1, 2 ] 145890 47.831% 49.514% ########## ( 2, 3 ] 78820 25.842% 75.355% ##### ( 3, 4 ] 31363 10.283% 85.638% ## ( 4, 6 ] 36540 11.980% 97.618% ## ( 6, 10 ] 6068 1.989% 99.608% ( 10, 15 ] 1200 0.393% 100.001% ( 15, 22 ] 165 0.054% 100.055% ( 22, 34 ] 13 0.004% 100.059% ( 34, 51 ] 4 0.001% 100.061% ( 51, 76 ] 1 0.000% 100.061% ( 76, 110 ] 17 0.006% 100.067% ( 110, 170 ] 34 0.011% 100.078% ( 170, 250 ] 34 0.011% 100.089% ( 250, 380 ] 31 0.010% 100.099% ( 380, 580 ] 35 0.011% 100.110% ( 580, 870 ] 38 0.012% 100.123% ( 870, 1300 ] 22 0.007% 100.130% ( 1300, 1900 ] 12 0.004% 100.134% ( 1900, 2900 ] 14 0.005% 100.139% ( 2900, 4400 ] 18 0.006% 100.145% ( 4400, 6600 ] 10 0.003% 100.148% ( 6600, 9900 ] 10 0.003% 100.151% ** Level 4 read latency histogram (micros): Count: 11605 Average: 78.6551 StdDev: 372.41 Min: 0 Median: 2.2686 Max: 10022 Percentiles: P50: 2.27 P75: 3.67 P99: 1714.44 P99.9: 4479.00 P99.99: 6567.90 ------------------------------------------------------ [ 0, 1 ] 294 2.533% 2.533% # ( 1, 2 ] 4776 41.155% 43.688% ######## ( 2, 3 ] 2727 23.498% 67.187% ##### ( 3, 4 ] 1357 11.693% 78.880% ## ( 4, 6 ] 1025 8.832% 87.712% ## ( 6, 10 ] 261 2.249% 89.961% ( 10, 15 ] 133 1.146% 91.107% ( 15, 22 ] 10 0.086% 91.193% ( 22, 34 ] 1 0.009% 91.202% ( 76, 110 ] 16 0.138% 91.340% ( 110, 170 ] 87 0.750% 92.090% ( 170, 250 ] 98 0.844% 92.934% ( 250, 380 ] 119 1.025% 93.960% ( 380, 580 ] 190 1.637% 95.597% ( 580, 870 ] 208 1.792% 97.389% ( 870, 1300 ] 131 1.129% 98.518% ( 1300, 1900 ] 81 0.698% 99.216% ( 1900, 2900 ] 37 0.319% 99.535% ( 2900, 4400 ] 42 0.362% 99.897% ( 4400, 6600 ] 11 0.095% 99.991% ( 6600, 9900 ] 1 0.009% 100.000% ( 9900, 14000 ] 1 0.009% 100.009% ** Level 5 read latency histogram (micros): Count: 100 Average: 967.5500 StdDev: 1139.41 Min: 83 Median: 494.2857 Max: 4586 Percentiles: P50: 494.29 P75: 1257.00 P99: 4400.00 P99.9: 4586.00 P99.99: 4586.00 ------------------------------------------------------ ( 76, 110 ] 9 9.000% 9.000% ## ( 110, 170 ] 17 17.000% 26.000% ### ( 170, 250 ] 9 9.000% 35.000% ## ( 250, 380 ] 11 11.000% 46.000% ## ( 380, 580 ] 7 7.000% 53.000% # ( 580, 870 ] 13 13.000% 66.000% ### ( 870, 1300 ] 10 10.000% 76.000% ## ( 1300, 1900 ] 7 7.000% 83.000% # ( 1900, 2900 ] 7 7.000% 90.000% # ( 2900, 4400 ] 9 9.000% 99.000% ## ( 4400, 6600 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 31.5 total, 3.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 249.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.549 H:M:S, 33.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 308.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.613 H:M:S, 19.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-21:38:35 ... thread 0: (1000000,9000000) ops and (76107.0,202518.9) ops/second in (13.139399,44.440298) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 3.44 GB 31.5 8.8 0.0 8.8 17.3 8.5 0.0 2.0 145.8 286.3 61.76 56.28 148 0.417 9144K 18K 0.0 0.0 L1 14/14 1.49 GB 0.0 6.9 4.9 2.0 6.8 4.8 0.2 1.4 217.9 215.6 32.22 30.11 4 8.054 7101K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.4 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 20/0 978.01 MB 1.0 4.7 2.9 1.9 4.7 2.8 0.7 1.6 185.2 184.3 26.23 22.03 19 1.381 4935K 25K 0.0 0.0 L4 177/0 9.61 GB 1.0 2.8 2.6 0.2 2.8 2.6 0.7 1.1 150.7 150.4 18.96 13.57 41 0.463 2829K 1740 0.0 0.0 L5 1080/0 89.01 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/25 104.51 GB 0.0 23.4 10.5 12.9 31.7 18.8 8.3 3.7 171.0 232.2 139.97 122.76 214 0.654 24M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.4 10.5 12.9 31.7 18.8 8.2 3.7 171.0 232.2 139.97 122.76 214 0.654 24M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.4 10.5 12.9 23.3 10.3 0.0 0.0 210.4 209.4 113.73 100.50 92 1.236 24M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 331.3 26.24 22.26 122 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.6 total, 44.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.74 GB write, 728.19 MB/s write, 23.37 GB read, 536.21 MB/s read, 140.0 seconds Interval compaction: 31.74 GB write, 731.38 MB/s write, 23.37 GB read, 538.56 MB/s read, 140.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 34, pending-compaction-bytes-stops: 0, total-delays: 52, total-stops: 44, interval: 96 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3872776 Average: 2.9103 StdDev: 24.86 Min: 0 Median: 1.5723 Max: 9051 Percentiles: P50: 1.57 P75: 1.95 P99: 7.59 P99.9: 146.95 P99.99: 392.76 ------------------------------------------------------ [ 0, 1 ] 469338 12.119% 12.119% ## ( 1, 2 ] 2563365 66.189% 78.308% ############# ( 2, 3 ] 502599 12.978% 91.286% ### ( 3, 4 ] 151788 3.919% 95.205% # ( 4, 6 ] 132158 3.412% 98.618% # ( 6, 10 ] 37275 0.962% 99.580% ( 10, 15 ] 6412 0.166% 99.746% ( 15, 22 ] 847 0.022% 99.768% ( 22, 34 ] 62 0.002% 99.769% ( 34, 51 ] 24 0.001% 99.770% ( 51, 76 ] 20 0.001% 99.771% ( 76, 110 ] 2266 0.059% 99.829% ( 110, 170 ] 4467 0.115% 99.944% ( 170, 250 ] 1036 0.027% 99.971% ( 250, 380 ] 695 0.018% 99.989% ( 380, 580 ] 607 0.016% 100.005% ( 580, 870 ] 353 0.009% 100.014% ( 870, 1300 ] 148 0.004% 100.018% ( 1300, 1900 ] 88 0.002% 100.020% ( 1900, 2900 ] 47 0.001% 100.021% ( 2900, 4400 ] 58 0.001% 100.023% ( 4400, 6600 ] 10 0.000% 100.023% ( 6600, 9900 ] 5 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1360620 Average: 4.1297 StdDev: 46.90 Min: 1 Median: 1.7734 Max: 10413 Percentiles: P50: 1.77 P75: 2.61 P99: 9.56 P99.9: 184.05 P99.99: 463.01 ------------------------------------------------------ [ 0, 1 ] 69811 5.131% 5.131% # ( 1, 2 ] 789386 58.017% 63.147% ############ ( 2, 3 ] 265538 19.516% 82.663% #### ( 3, 4 ] 95587 7.025% 89.689% # ( 4, 6 ] 100391 7.378% 97.067% # ( 6, 10 ] 29580 2.174% 99.241% ( 10, 15 ] 6166 0.453% 99.694% ( 15, 22 ] 631 0.046% 99.741% ( 22, 34 ] 56 0.004% 99.745% ( 34, 51 ] 13 0.001% 99.746% ( 51, 76 ] 78 0.006% 99.751% ( 76, 110 ] 909 0.067% 99.818% ( 110, 170 ] 1018 0.075% 99.893% ( 170, 250 ] 543 0.040% 99.933% ( 250, 380 ] 547 0.040% 99.973% ( 380, 580 ] 554 0.041% 100.014% ( 580, 870 ] 404 0.030% 100.044% ( 870, 1300 ] 245 0.018% 100.062% ( 1300, 1900 ] 84 0.006% 100.068% ( 1900, 2900 ] 54 0.004% 100.072% ( 2900, 4400 ] 58 0.004% 100.076% ( 4400, 6600 ] 15 0.001% 100.077% ( 6600, 9900 ] 9 0.001% 100.078% ( 9900, 14000 ] 1 0.000% 100.078% ** Level 2 read latency histogram (micros): Count: 64943 Average: 3.4038 StdDev: 36.26 Min: 1 Median: 1.6159 Max: 6605 Percentiles: P50: 1.62 P75: 2.07 P99: 8.22 P99.9: 385.42 P99.99: 1124.31 ------------------------------------------------------ [ 0, 1 ] 7451 11.473% 11.473% ## ( 1, 2 ] 40621 62.549% 74.022% ############# ( 2, 3 ] 8985 13.835% 87.857% ### ( 3, 4 ] 3858 5.941% 93.798% # ( 4, 6 ] 2979 4.587% 98.385% # ( 6, 10 ] 720 1.109% 99.493% ( 10, 15 ] 151 0.233% 99.726% ( 15, 22 ] 21 0.032% 99.758% ( 22, 34 ] 6 0.009% 99.767% ( 51, 76 ] 1 0.002% 99.769% ( 76, 110 ] 3 0.005% 99.774% ( 110, 170 ] 28 0.043% 99.817% ( 170, 250 ] 33 0.051% 99.868% ( 250, 380 ] 20 0.031% 99.898% ( 380, 580 ] 39 0.060% 99.958% ( 580, 870 ] 14 0.022% 99.980% ( 870, 1300 ] 11 0.017% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1003197 Average: 4.2119 StdDev: 48.89 Min: 1 Median: 2.0689 Max: 9267 Percentiles: P50: 2.07 P75: 3.10 P99: 9.02 P99.9: 14.18 P99.99: 17.63 ------------------------------------------------------ [ 0, 1 ] 13241 1.320% 1.320% ( 1, 2 ] 470589 46.909% 48.229% ######### ( 2, 3 ] 258042 25.722% 73.951% ##### ( 3, 4 ] 108865 10.852% 84.803% ## ( 4, 6 ] 125926 12.552% 97.355% ### ( 6, 10 ] 21871 2.180% 99.535% ( 10, 15 ] 4380 0.437% 99.972% ( 15, 22 ] 486 0.048% 100.020% ( 22, 34 ] 47 0.005% 100.025% ( 34, 51 ] 13 0.001% 100.026% ( 51, 76 ] 45 0.004% 100.031% ( 76, 110 ] 31 0.003% 100.034% ( 110, 170 ] 135 0.013% 100.047% ( 170, 250 ] 158 0.016% 100.063% ( 250, 380 ] 228 0.023% 100.086% ( 380, 580 ] 269 0.027% 100.113% ( 580, 870 ] 284 0.028% 100.141% ( 870, 1300 ] 182 0.018% 100.159% ( 1300, 1900 ] 75 0.007% 100.166% ( 1900, 2900 ] 36 0.004% 100.170% ( 2900, 4400 ] 50 0.005% 100.175% ( 4400, 6600 ] 12 0.001% 100.176% ( 6600, 9900 ] 10 0.001% 100.177% ** Level 4 read latency histogram (micros): Count: 46981 Average: 51.2704 StdDev: 291.72 Min: 0 Median: 2.2003 Max: 10022 Percentiles: P50: 2.20 P75: 3.49 P99: 1216.73 P99.9: 4120.87 P99.99: 6298.67 ------------------------------------------------------ [ 0, 1 ] 962 2.048% 2.048% ( 1, 2 ] 20262 43.128% 45.176% ######### ( 2, 3 ] 11318 24.091% 69.266% ##### ( 3, 4 ] 5496 11.698% 80.965% ## ( 4, 6 ] 4407 9.380% 90.345% ## ( 6, 10 ] 1098 2.337% 92.682% ( 10, 15 ] 425 0.905% 93.587% ( 15, 22 ] 45 0.096% 93.683% ( 22, 34 ] 11 0.023% 93.706% ( 34, 51 ] 5 0.011% 93.717% ( 51, 76 ] 3 0.006% 93.723% ( 76, 110 ] 74 0.158% 93.881% ( 110, 170 ] 326 0.694% 94.574% ( 170, 250 ] 363 0.773% 95.347% ( 250, 380 ] 385 0.819% 96.167% ( 380, 580 ] 545 1.160% 97.327% ( 580, 870 ] 533 1.135% 98.461% ( 870, 1300 ] 314 0.668% 99.129% ( 1300, 1900 ] 175 0.372% 99.502% ( 1900, 2900 ] 104 0.221% 99.723% ( 2900, 4400 ] 102 0.217% 99.940% ( 4400, 6600 ] 27 0.057% 99.998% ( 6600, 9900 ] 4 0.009% 100.006% ( 9900, 14000 ] 1 0.002% 100.009% ** Level 5 read latency histogram (micros): Count: 200 Average: 951.8900 StdDev: 1075.70 Min: 80 Median: 450.0000 Max: 4586 Percentiles: P50: 450.00 P75: 1300.00 P99: 4306.25 P99.9: 4586.00 P99.99: 4586.00 ------------------------------------------------------ ( 76, 110 ] 16 8.000% 8.000% ## ( 110, 170 ] 31 15.500% 23.500% ### ( 170, 250 ] 20 10.000% 33.500% ## ( 250, 380 ] 26 13.000% 46.500% ### ( 380, 580 ] 20 10.000% 56.500% ## ( 580, 870 ] 19 9.500% 66.000% ## ( 870, 1300 ] 18 9.000% 75.000% ## ( 1300, 1900 ] 12 6.000% 81.000% # ( 1900, 2900 ] 21 10.500% 91.500% ## ( 2900, 4400 ] 16 8.000% 99.500% ## ( 4400, 6600 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 44.6 total, 13.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 198.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.738 H:M:S, 46.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 74.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.189 H:M:S, 77.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-21:38:50 ... thread 0: (1000000,10000000) ops and (70754.7,170725.3) ops/second in (14.133334,58.573632) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/7 4.54 GB 176.2 9.9 0.0 9.9 19.5 9.6 0.0 2.0 146.0 287.3 69.44 63.50 167 0.416 10M 19K 0.0 0.0 L1 14/14 1.49 GB 0.0 6.9 4.9 2.0 6.8 4.8 0.2 1.4 217.9 215.6 32.22 30.11 4 8.054 7101K 48K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.4 1.5 240.1 240.0 0.80 0.76 2 0.402 195K 101 0.0 0.0 L3 20/0 978.01 MB 1.0 4.7 2.9 1.9 4.7 2.8 0.7 1.6 185.2 184.3 26.23 22.03 19 1.381 4935K 25K 0.0 0.0 L4 177/0 9.61 GB 1.0 2.8 2.6 0.2 2.8 2.6 0.7 1.1 150.7 150.4 18.96 13.57 41 0.463 2829K 1740 0.0 0.0 L5 1080/0 89.01 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/21 105.61 GB 0.0 24.5 10.5 14.0 34.0 19.9 8.3 3.5 169.8 235.5 147.66 129.98 233 0.634 25M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.5 10.5 14.0 34.0 19.9 8.2 3.5 169.8 235.5 147.66 129.98 233 0.634 25M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.5 10.5 14.0 24.4 10.3 0.0 0.0 212.2 211.1 118.14 104.81 96 1.231 25M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.6 9.6 0.0 0.0 0.0 332.9 29.52 25.17 137 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.8 total, 58.6 interval Flush(GB): cumulative 9.597, interval 9.597 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.96 GB write, 591.64 MB/s write, 24.48 GB read, 426.55 MB/s read, 147.7 seconds Interval compaction: 33.96 GB write, 593.60 MB/s write, 24.48 GB read, 427.97 MB/s read, 147.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 39, pending-compaction-bytes-stops: 0, total-delays: 57, total-stops: 48, interval: 105 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4595607 Average: 2.8740 StdDev: 23.41 Min: 0 Median: 1.5649 Max: 9051 Percentiles: P50: 1.56 P75: 1.94 P99: 7.64 P99.9: 145.20 P99.99: 358.81 ------------------------------------------------------ [ 0, 1 ] 565696 12.309% 12.309% ## ( 1, 2 ] 3066296 66.722% 79.032% ############# ( 2, 3 ] 578778 12.594% 91.626% ### ( 3, 4 ] 172382 3.751% 95.377% # ( 4, 6 ] 148060 3.222% 98.599% # ( 6, 10 ] 44998 0.979% 99.578% ( 10, 15 ] 7286 0.159% 99.736% ( 15, 22 ] 984 0.021% 99.758% ( 22, 34 ] 74 0.002% 99.759% ( 34, 51 ] 28 0.001% 99.760% ( 51, 76 ] 25 0.001% 99.761% ( 76, 110 ] 3113 0.068% 99.828% ( 110, 170 ] 5610 0.122% 99.950% ( 170, 250 ] 1142 0.025% 99.975% ( 250, 380 ] 807 0.018% 99.993% ( 380, 580 ] 678 0.015% 100.008% ( 580, 870 ] 370 0.008% 100.016% ( 870, 1300 ] 154 0.003% 100.019% ( 1300, 1900 ] 93 0.002% 100.021% ( 1900, 2900 ] 49 0.001% 100.022% ( 2900, 4400 ] 60 0.001% 100.023% ( 4400, 6600 ] 10 0.000% 100.024% ( 6600, 9900 ] 5 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1718003 Average: 3.7504 StdDev: 41.92 Min: 1 Median: 1.6694 Max: 10413 Percentiles: P50: 1.67 P75: 2.34 P99: 9.40 P99.9: 162.71 P99.99: 455.86 ------------------------------------------------------ [ 0, 1 ] 175672 10.225% 10.225% ## ( 1, 2 ] 1020736 59.414% 69.639% ############ ( 2, 3 ] 270988 15.773% 85.413% ### ( 3, 4 ] 101528 5.910% 91.323% # ( 4, 6 ] 102558 5.970% 97.292% # ( 6, 10 ] 34521 2.009% 99.302% ( 10, 15 ] 6443 0.375% 99.677% ( 15, 22 ] 753 0.044% 99.720% ( 22, 34 ] 61 0.004% 99.724% ( 34, 51 ] 13 0.001% 99.725% ( 51, 76 ] 79 0.005% 99.729% ( 76, 110 ] 1546 0.090% 99.819% ( 110, 170 ] 1580 0.092% 99.911% ( 170, 250 ] 572 0.033% 99.945% ( 250, 380 ] 566 0.033% 99.977% ( 380, 580 ] 570 0.033% 100.011% ( 580, 870 ] 408 0.024% 100.034% ( 870, 1300 ] 247 0.014% 100.049% ( 1300, 1900 ] 84 0.005% 100.054% ( 1900, 2900 ] 54 0.003% 100.057% ( 2900, 4400 ] 58 0.003% 100.060% ( 4400, 6600 ] 15 0.001% 100.061% ( 6600, 9900 ] 9 0.001% 100.062% ( 9900, 14000 ] 1 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 64943 Average: 3.4038 StdDev: 36.26 Min: 1 Median: 1.6159 Max: 6605 Percentiles: P50: 1.62 P75: 2.07 P99: 8.22 P99.9: 385.42 P99.99: 1124.31 ------------------------------------------------------ [ 0, 1 ] 7451 11.473% 11.473% ## ( 1, 2 ] 40621 62.549% 74.022% ############# ( 2, 3 ] 8985 13.835% 87.857% ### ( 3, 4 ] 3858 5.941% 93.798% # ( 4, 6 ] 2979 4.587% 98.385% # ( 6, 10 ] 720 1.109% 99.493% ( 10, 15 ] 151 0.233% 99.726% ( 15, 22 ] 21 0.032% 99.758% ( 22, 34 ] 6 0.009% 99.767% ( 51, 76 ] 1 0.002% 99.769% ( 76, 110 ] 3 0.005% 99.774% ( 110, 170 ] 28 0.043% 99.817% ( 170, 250 ] 33 0.051% 99.868% ( 250, 380 ] 20 0.031% 99.898% ( 380, 580 ] 39 0.060% 99.958% ( 580, 870 ] 14 0.022% 99.980% ( 870, 1300 ] 11 0.017% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1003197 Average: 4.2119 StdDev: 48.89 Min: 1 Median: 2.0689 Max: 9267 Percentiles: P50: 2.07 P75: 3.10 P99: 9.02 P99.9: 14.18 P99.99: 17.63 ------------------------------------------------------ [ 0, 1 ] 13241 1.320% 1.320% ( 1, 2 ] 470589 46.909% 48.229% ######### ( 2, 3 ] 258042 25.722% 73.951% ##### ( 3, 4 ] 108865 10.852% 84.803% ## ( 4, 6 ] 125926 12.552% 97.355% ### ( 6, 10 ] 21871 2.180% 99.535% ( 10, 15 ] 4380 0.437% 99.972% ( 15, 22 ] 486 0.048% 100.020% ( 22, 34 ] 47 0.005% 100.025% ( 34, 51 ] 13 0.001% 100.026% ( 51, 76 ] 45 0.004% 100.031% ( 76, 110 ] 31 0.003% 100.034% ( 110, 170 ] 135 0.013% 100.047% ( 170, 250 ] 158 0.016% 100.063% ( 250, 380 ] 228 0.023% 100.086% ( 380, 580 ] 269 0.027% 100.113% ( 580, 870 ] 284 0.028% 100.141% ( 870, 1300 ] 182 0.018% 100.159% ( 1300, 1900 ] 75 0.007% 100.166% ( 1900, 2900 ] 36 0.004% 100.170% ( 2900, 4400 ] 50 0.005% 100.175% ( 4400, 6600 ] 12 0.001% 100.176% ( 6600, 9900 ] 10 0.001% 100.177% ** Level 4 read latency histogram (micros): Count: 46981 Average: 51.2704 StdDev: 291.72 Min: 0 Median: 2.2003 Max: 10022 Percentiles: P50: 2.20 P75: 3.49 P99: 1216.73 P99.9: 4120.87 P99.99: 6298.67 ------------------------------------------------------ [ 0, 1 ] 962 2.048% 2.048% ( 1, 2 ] 20262 43.128% 45.176% ######### ( 2, 3 ] 11318 24.091% 69.266% ##### ( 3, 4 ] 5496 11.698% 80.965% ## ( 4, 6 ] 4407 9.380% 90.345% ## ( 6, 10 ] 1098 2.337% 92.682% ( 10, 15 ] 425 0.905% 93.587% ( 15, 22 ] 45 0.096% 93.683% ( 22, 34 ] 11 0.023% 93.706% ( 34, 51 ] 5 0.011% 93.717% ( 51, 76 ] 3 0.006% 93.723% ( 76, 110 ] 74 0.158% 93.881% ( 110, 170 ] 326 0.694% 94.574% ( 170, 250 ] 363 0.773% 95.347% ( 250, 380 ] 385 0.819% 96.167% ( 380, 580 ] 545 1.160% 97.327% ( 580, 870 ] 533 1.135% 98.461% ( 870, 1300 ] 314 0.668% 99.129% ( 1300, 1900 ] 175 0.372% 99.502% ( 1900, 2900 ] 104 0.221% 99.723% ( 2900, 4400 ] 102 0.217% 99.940% ( 4400, 6600 ] 27 0.057% 99.998% ( 6600, 9900 ] 4 0.009% 100.006% ( 9900, 14000 ] 1 0.002% 100.009% ** Level 5 read latency histogram (micros): Count: 200 Average: 951.8900 StdDev: 1075.70 Min: 80 Median: 450.0000 Max: 4586 Percentiles: P50: 450.00 P75: 1300.00 P99: 4306.25 P99.9: 4586.00 P99.99: 4586.00 ------------------------------------------------------ ( 76, 110 ] 16 8.000% 8.000% ## ( 110, 170 ] 31 15.500% 23.500% ### ( 170, 250 ] 20 10.000% 33.500% ## ( 250, 380 ] 26 13.000% 46.500% ### ( 380, 580 ] 20 10.000% 56.500% ## ( 580, 870 ] 19 9.500% 66.000% ## ( 870, 1300 ] 18 9.000% 75.000% ## ( 1300, 1900 ] 12 6.000% 81.000% # ( 1900, 2900 ] 21 10.500% 91.500% ## ( 2900, 4400 ] 16 8.000% 99.500% ## ( 4400, 6600 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 58.8 total, 14.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 167.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:32.010 H:M:S, 54.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 69.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.272 H:M:S, 79.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.007 micros/op 166484 ops/sec 60.120 seconds 10008999 operations; 161.3 MB/s Microseconds per write: Count: 10008999 Average: 6.0066 StdDev: 335.33 Min: 1 Median: 1.7171 Max: 514841 Percentiles: P50: 1.72 P75: 2.66 P99: 8.60 P99.9: 1169.60 P99.99: 2686.72 ------------------------------------------------------ [ 0, 1 ] 1506272 15.049% 15.049% ### ( 1, 2 ] 4878608 48.742% 63.791% ########## ( 2, 3 ] 1709884 17.083% 80.875% ### ( 3, 4 ] 1296670 12.955% 93.830% ### ( 4, 6 ] 452890 4.525% 98.355% # ( 6, 10 ] 99258 0.992% 99.346% ( 10, 15 ] 23667 0.236% 99.583% ( 15, 22 ] 6884 0.069% 99.652% ( 22, 34 ] 1305 0.013% 99.665% ( 34, 51 ] 154 0.002% 99.666% ( 51, 76 ] 23 0.000% 99.666% ( 76, 110 ] 7593 0.076% 99.742% ( 110, 170 ] 2207 0.022% 99.764% ( 170, 250 ] 265 0.003% 99.767% ( 250, 380 ] 101 0.001% 99.768% ( 380, 580 ] 33 0.000% 99.768% ( 580, 870 ] 18 0.000% 99.769% ( 870, 1300 ] 18885 0.189% 99.957% ( 1300, 1900 ] 65 0.001% 99.958% ( 1900, 2900 ] 4088 0.041% 99.999% ( 2900, 4400 ] 85 0.001% 100.000% ( 4400, 6600 ] 16 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 5 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 205539 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10008999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10329286968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 551 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33475155 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31311165618 rocksdb.compact.write.bytes COUNT : 31089016055 rocksdb.flush.write.bytes COUNT : 10304932118 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 49 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 254 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10221897728 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4015104 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31406058561 rocksdb.non.last.level.read.count COUNT : 7585661 rocksdb.block.checksum.compute.count COUNT : 7584608 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.348435 P95 : 3.797413 P99 : 7.023961 P100 : 514838.000000 COUNT : 10008999 SUM : 55546641 rocksdb.compaction.times.micros P50 : 926785.714286 P95 : 3903333.333333 P99 : 18120000.000000 P100 : 20542329.000000 COUNT : 97 SUM : 138677483 rocksdb.compaction.times.cpu_micros P50 : 883611.111111 P95 : 3903333.333333 P99 : 18120000.000000 P100 : 18789052.000000 COUNT : 97 SUM : 123596591 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 705.879121 P95 : 1390.000000 P99 : 43710.000000 P100 : 66960.000000 COUNT : 137 SUM : 237777 rocksdb.compaction.outfile.sync.micros P50 : 925.561798 P95 : 43285.000000 P99 : 102050.000000 P100 : 184975.000000 COUNT : 359 SUM : 2427606 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.523810 P95 : 667.000000 P99 : 2090.000000 P100 : 3526.000000 COUNT : 262 SUM : 54418 rocksdb.table.open.io.micros P50 : 1413.793103 P95 : 6375.600000 P99 : 17992.727273 P100 : 21275.000000 COUNT : 551 SUM : 1201960 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.679954 P95 : 8.073662 P99 : 12.355221 P100 : 10422.000000 COUNT : 7583265 SUM : 43542969 rocksdb.read.block.get.micros P50 : 510.136986 P95 : 3483.695652 P99 : 7538.142857 P100 : 10172.000000 COUNT : 1102 SUM : 996316 rocksdb.write.raw.block.micros P50 : 0.512548 P95 : 0.973840 P99 : 2.856375 P100 : 14569.000000 COUNT : 10028556 SUM : 19125412 rocksdb.numfiles.in.singlecompaction P50 : 2.884615 P95 : 4.433333 P99 : 18.570000 P100 : 21.000000 COUNT : 147 SUM : 508 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558729 P95 : 1145.309737 P99 : 2386.431545 P100 : 514635.000000 COUNT : 220890 SUM : 33490411 rocksdb.sst.read.micros P50 : 1.643450 P95 : 4.891894 P99 : 8.976905 P100 : 10413.000000 COUNT : 7586206 SUM : 28365216 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10008999 SUM : 10329286968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214848.484848 P95 : 367975.000000 P99 : 552425.000000 P100 : 712316.000000 COUNT : 137 SUM : 29522576 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 337 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0