[2024-11-18 21:53:01.831695] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-18 21:53:01.831977] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid704569 ] Set seed to 1731963181825146 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 21:53:01.931407] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 21:53:01.967433] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 21:53:01.967479] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 704569' to capture a snapshot of events at runtime. [2024-11-18 21:53:01.967491] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid704569 for offline analysis/debug. [2024-11-18 21:53:01.967530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 21:53:06 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-21:53:14 ... thread 0: (1000000,1000000) ops and (128190.6,128190.6) ops/second in (7.800881,7.800881) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 818.31 MB 50.3 0.4 0.0 0.4 1.2 0.8 0.0 1.5 39.2 124.2 9.63 3.96 10 0.963 383K 532 0.0 0.0 L1 1/0 58.85 MB 5.9 0.7 0.6 0.1 0.7 0.6 0.0 1.2 106.0 105.8 6.78 3.28 1 6.783 730K 1757 0.0 0.0 L2 9/5 900.08 MB 4.8 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 41/17 3.22 GB 2.0 2.6 1.8 0.8 2.6 1.8 0.0 1.4 96.5 95.2 27.51 12.29 9 3.057 1615K 0 0.0 0.0 L4 185/9 12.16 GB 1.2 3.1 2.5 0.6 3.1 2.5 0.1 1.2 107.5 107.0 29.79 14.83 21 1.418 1830K 0 0.0 0.0 L5 1084/0 89.14 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/35 106.25 GB 0.0 6.8 4.9 1.9 7.5 5.7 0.8 9.4 94.3 104.7 73.71 34.36 41 1.798 4560K 2289 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 4.9 1.9 7.5 5.7 0.8 9.4 94.3 104.7 73.71 34.36 41 1.798 4560K 2289 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 4.9 1.9 6.7 4.9 0.0 0.0 104.2 103.4 66.75 31.93 32 2.086 4560K 2289 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 117.7 6.95 2.44 9 0.773 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.54 GB write, 963.07 MB/s write, 6.79 GB read, 867.59 MB/s read, 73.7 seconds Interval compaction: 7.54 GB write, 989.32 MB/s write, 6.79 GB read, 891.24 MB/s read, 73.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 35, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 318701 Average: 9.4114 StdDev: 125.80 Min: 1 Median: 1.8027 Max: 7598 Percentiles: P50: 1.80 P75: 2.84 P99: 9.93 P99.9: 1934.19 P99.99: 4253.26 ------------------------------------------------------ [ 0, 1 ] 22776 7.147% 7.147% # ( 1, 2 ] 170139 53.385% 60.532% ########### ( 2, 3 ] 54959 17.245% 77.776% ### ( 3, 4 ] 29874 9.374% 87.150% ## ( 4, 6 ] 30781 9.658% 96.808% ## ( 6, 10 ] 7110 2.231% 99.039% ( 10, 15 ] 1434 0.450% 99.489% ( 15, 22 ] 172 0.054% 99.543% ( 22, 34 ] 22 0.007% 99.550% ( 34, 51 ] 7 0.002% 99.552% ( 51, 76 ] 10 0.003% 99.555% ( 76, 110 ] 12 0.004% 99.559% ( 110, 170 ] 11 0.003% 99.563% ( 170, 250 ] 43 0.013% 99.576% ( 250, 380 ] 82 0.026% 99.602% ( 380, 580 ] 153 0.048% 99.650% ( 580, 870 ] 262 0.082% 99.732% ( 870, 1300 ] 295 0.093% 99.825% ( 1300, 1900 ] 237 0.074% 99.899% ( 1900, 2900 ] 155 0.049% 99.948% ( 2900, 4400 ] 152 0.048% 99.995% ( 4400, 6600 ] 41 0.013% 100.008% ( 6600, 9900 ] 1 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 39568 Average: 20.8193 StdDev: 203.31 Min: 1 Median: 2.0040 Max: 6688 Percentiles: P50: 2.00 P75: 3.24 P99: 571.62 P99.9: 3621.89 P99.99: 5877.23 ------------------------------------------------------ [ 0, 1 ] 901 2.277% 2.277% ( 1, 2 ] 18847 47.632% 49.909% ########## ( 2, 3 ] 8899 22.490% 72.399% #### ( 3, 4 ] 4263 10.774% 83.173% ## ( 4, 6 ] 4708 11.899% 95.072% ## ( 6, 10 ] 1114 2.815% 97.887% # ( 10, 15 ] 305 0.771% 98.658% ( 15, 22 ] 38 0.096% 98.754% ( 22, 34 ] 4 0.010% 98.764% ( 34, 51 ] 2 0.005% 98.769% ( 51, 76 ] 7 0.018% 98.787% ( 76, 110 ] 1 0.003% 98.789% ( 110, 170 ] 1 0.003% 98.792% ( 170, 250 ] 4 0.010% 98.802% ( 250, 380 ] 17 0.043% 98.845% ( 380, 580 ] 64 0.162% 99.007% ( 580, 870 ] 104 0.263% 99.270% ( 870, 1300 ] 107 0.270% 99.540% ( 1300, 1900 ] 64 0.162% 99.702% ( 1900, 2900 ] 51 0.129% 99.831% ( 2900, 4400 ] 57 0.144% 99.975% ( 4400, 6600 ] 9 0.023% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 408209 Average: 12.4122 StdDev: 151.56 Min: 1 Median: 1.8807 Max: 8073 Percentiles: P50: 1.88 P75: 2.98 P99: 13.24 P99.9: 1802.56 P99.99: 2958.10 ------------------------------------------------------ [ 0, 1 ] 23341 5.718% 5.718% # ( 1, 2 ] 205247 50.280% 55.998% ########## ( 2, 3 ] 79450 19.463% 75.461% #### ( 3, 4 ] 41590 10.188% 85.649% ## ( 4, 6 ] 41317 10.122% 95.771% ## ( 6, 10 ] 11294 2.767% 98.538% # ( 10, 15 ] 2921 0.716% 99.253% ( 15, 22 ] 431 0.106% 99.359% ( 22, 34 ] 72 0.018% 99.376% ( 34, 51 ] 31 0.008% 99.384% ( 51, 76 ] 18 0.004% 99.388% ( 76, 110 ] 20 0.005% 99.393% ( 110, 170 ] 44 0.011% 99.404% ( 170, 250 ] 87 0.021% 99.425% ( 250, 380 ] 178 0.044% 99.469% ( 380, 580 ] 353 0.086% 99.555% ( 580, 870 ] 509 0.125% 99.680% ( 870, 1300 ] 548 0.134% 99.814% ( 1300, 1900 ] 420 0.103% 99.917% ( 1900, 2900 ] 290 0.071% 99.988% ( 2900, 4400 ] 237 0.058% 100.046% ( 4400, 6600 ] 87 0.021% 100.068% ( 6600, 9900 ] 9 0.002% 100.070% ** Level 3 read latency histogram (micros): Count: 859964 Average: 12.6351 StdDev: 158.71 Min: 1 Median: 1.9090 Max: 9684 Percentiles: P50: 1.91 P75: 2.98 P99: 11.35 P99.9: 1315.17 P99.99: 1954.65 ------------------------------------------------------ [ 0, 1 ] 32256 3.751% 3.751% # ( 1, 2 ] 437561 50.881% 54.632% ########## ( 2, 3 ] 178783 20.790% 75.422% #### ( 3, 4 ] 89565 10.415% 85.837% ## ( 4, 6 ] 90608 10.536% 96.373% ## ( 6, 10 ] 21161 2.461% 98.834% ( 10, 15 ] 5310 0.617% 99.451% ( 15, 22 ] 659 0.077% 99.528% ( 22, 34 ] 64 0.007% 99.535% ( 34, 51 ] 46 0.005% 99.541% ( 51, 76 ] 67 0.008% 99.548% ( 76, 110 ] 25 0.003% 99.551% ( 110, 170 ] 47 0.005% 99.557% ( 170, 250 ] 114 0.013% 99.570% ( 250, 380 ] 264 0.031% 99.601% ( 380, 580 ] 620 0.072% 99.673% ( 580, 870 ] 931 0.108% 99.781% ( 870, 1300 ] 1004 0.117% 99.898% ( 1300, 1900 ] 753 0.088% 99.985% ( 1900, 2900 ] 732 0.085% 100.070% ( 2900, 4400 ] 630 0.073% 100.144% ( 4400, 6600 ] 170 0.020% 100.163% ( 6600, 9900 ] 27 0.003% 100.167% ** Level 4 read latency histogram (micros): Count: 206366 Average: 36.7726 StdDev: 295.05 Min: 1 Median: 1.9033 Max: 9144 Percentiles: P50: 1.90 P75: 2.98 P99: 1165.34 P99.9: 3911.15 P99.99: 4800.00 ------------------------------------------------------ [ 0, 1 ] 7916 3.836% 3.836% # ( 1, 2 ] 105461 51.104% 54.940% ########## ( 2, 3 ] 42113 20.407% 75.347% #### ( 3, 4 ] 21044 10.197% 85.544% ## ( 4, 6 ] 19509 9.454% 94.998% ## ( 6, 10 ] 4471 2.167% 97.164% ( 10, 15 ] 1190 0.577% 97.741% ( 15, 22 ] 166 0.080% 97.821% ( 22, 34 ] 15 0.007% 97.829% ( 34, 51 ] 14 0.007% 97.835% ( 51, 76 ] 17 0.008% 97.844% ( 76, 110 ] 12 0.006% 97.849% ( 110, 170 ] 50 0.024% 97.874% ( 170, 250 ] 129 0.063% 97.936% ( 250, 380 ] 234 0.113% 98.050% ( 380, 580 ] 530 0.257% 98.306% ( 580, 870 ] 818 0.396% 98.703% ( 870, 1300 ] 893 0.433% 99.136% ( 1300, 1900 ] 676 0.328% 99.463% ( 1900, 2900 ] 572 0.277% 99.740% ( 2900, 4400 ] 489 0.237% 99.977% ( 4400, 6600 ] 145 0.070% 100.047% ( 6600, 9900 ] 27 0.013% 100.061% ** Level 5 read latency histogram (micros): Count: 13411 Average: 1683.9011 StdDev: 1390.04 Min: 77 Median: 1191.1148 Max: 12143 Percentiles: P50: 1191.11 P75: 2380.20 P99: 6445.54 P99.9: 9525.83 P99.99: 12143.00 ------------------------------------------------------ ( 76, 110 ] 16 0.119% 0.119% ( 110, 170 ] 80 0.597% 0.716% ( 170, 250 ] 214 1.596% 2.312% ( 250, 380 ] 652 4.862% 7.173% # ( 380, 580 ] 1472 10.976% 18.149% ## ( 580, 870 ] 2359 17.590% 35.739% #### ( 870, 1300 ] 2561 19.096% 54.836% #### ( 1300, 1900 ] 1922 14.332% 69.167% ### ( 1900, 2900 ] 1629 12.147% 81.314% ## ( 2900, 4400 ] 1748 13.034% 94.348% ### ( 4400, 6600 ] 671 5.003% 99.351% # ( 6600, 9900 ] 83 0.619% 99.970% ( 9900, 14000 ] 4 0.030% 100.000% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 122.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.770 H:M:S, 47.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.770 H:M:S, 48.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-21:53:19 ... thread 0: (1000000,2000000) ops and (172694.8,147151.4) ops/second in (5.790561,13.591442) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.78 GB 63.0 1.0 0.0 1.0 2.8 1.8 0.0 1.6 53.1 149.3 18.98 9.41 25 0.759 1023K 1228 0.0 0.0 L1 1/1 58.85 MB 0.0 0.7 0.6 0.1 0.7 0.6 0.0 1.2 106.0 105.8 6.78 3.28 1 6.783 730K 1757 0.0 0.0 L2 2/1 257.53 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 37/16 2.55 GB 1.1 4.8 2.4 2.3 4.7 2.4 0.0 1.9 109.4 108.3 44.49 23.23 16 2.780 2842K 1626 0.0 0.0 L4 157/8 9.49 GB 0.9 4.8 3.5 1.3 4.8 3.5 0.4 1.4 113.6 112.7 43.59 23.04 33 1.321 2653K 31 0.0 0.0 L5 1132/0 93.07 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1342/34 107.21 GB 0.0 11.3 6.5 4.7 13.0 8.2 5.0 7.3 101.4 116.7 113.84 58.96 75 1.518 7249K 4642 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 6.5 4.7 13.0 8.2 5.0 7.3 101.4 116.7 113.84 58.96 75 1.518 7249K 4642 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 6.5 4.7 11.2 6.4 0.0 0.0 114.4 113.5 100.96 53.60 53 1.905 7249K 4642 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 141.8 12.89 5.36 22 0.586 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.8 total, 13.6 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.97 GB write, 962.28 MB/s write, 11.27 GB read, 836.28 MB/s read, 113.8 seconds Interval compaction: 12.97 GB write, 977.34 MB/s write, 11.27 GB read, 849.36 MB/s read, 113.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 55, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 698231 Average: 8.4153 StdDev: 123.19 Min: 1 Median: 1.7805 Max: 22210 Percentiles: P50: 1.78 P75: 2.75 P99: 9.79 P99.9: 1432.60 P99.99: 3508.53 ------------------------------------------------------ [ 0, 1 ] 50690 7.260% 7.260% # ( 1, 2 ] 382329 54.757% 62.017% ########### ( 2, 3 ] 121105 17.345% 79.361% ### ( 3, 4 ] 61729 8.841% 88.202% ## ( 4, 6 ] 62563 8.960% 97.162% ## ( 6, 10 ] 13557 1.942% 99.104% ( 10, 15 ] 2785 0.399% 99.503% ( 15, 22 ] 296 0.042% 99.545% ( 22, 34 ] 31 0.004% 99.549% ( 34, 51 ] 15 0.002% 99.552% ( 51, 76 ] 27 0.004% 99.555% ( 76, 110 ] 33 0.005% 99.560% ( 110, 170 ] 130 0.019% 99.579% ( 170, 250 ] 245 0.035% 99.614% ( 250, 380 ] 336 0.048% 99.662% ( 380, 580 ] 488 0.070% 99.732% ( 580, 870 ] 559 0.080% 99.812% ( 870, 1300 ] 533 0.076% 99.888% ( 1300, 1900 ] 370 0.053% 99.941% ( 1900, 2900 ] 242 0.035% 99.976% ( 2900, 4400 ] 242 0.035% 100.011% ( 4400, 6600 ] 81 0.012% 100.022% ( 6600, 9900 ] 8 0.001% 100.023% ( 9900, 14000 ] 4 0.001% 100.024% ( 14000, 22000 ] 2 0.000% 100.024% ( 22000, 33000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 162835 Average: 14.8092 StdDev: 207.49 Min: 1 Median: 1.9147 Max: 23990 Percentiles: P50: 1.91 P75: 2.99 P99: 13.96 P99.9: 2837.29 P99.99: 4861.76 ------------------------------------------------------ [ 0, 1 ] 5331 3.274% 3.274% # ( 1, 2 ] 83181 51.083% 54.357% ########## ( 2, 3 ] 34063 20.919% 75.276% #### ( 3, 4 ] 16272 9.993% 85.269% ## ( 4, 6 ] 17315 10.633% 95.902% ## ( 6, 10 ] 4291 2.635% 98.537% # ( 10, 15 ] 952 0.585% 99.122% ( 15, 22 ] 103 0.063% 99.185% ( 22, 34 ] 4 0.002% 99.188% ( 34, 51 ] 18 0.011% 99.199% ( 51, 76 ] 24 0.015% 99.213% ( 76, 110 ] 10 0.006% 99.219% ( 110, 170 ] 29 0.018% 99.237% ( 170, 250 ] 48 0.029% 99.267% ( 250, 380 ] 92 0.056% 99.323% ( 380, 580 ] 181 0.111% 99.434% ( 580, 870 ] 290 0.178% 99.612% ( 870, 1300 ] 233 0.143% 99.756% ( 1300, 1900 ] 133 0.082% 99.837% ( 1900, 2900 ] 109 0.067% 99.904% ( 2900, 4400 ] 133 0.082% 99.986% ( 4400, 6600 ] 32 0.020% 100.006% ( 6600, 9900 ] 11 0.007% 100.012% ( 9900, 14000 ] 7 0.004% 100.017% ( 14000, 22000 ] 4 0.002% 100.019% ( 22000, 33000 ] 1 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 435643 Average: 12.2714 StdDev: 151.15 Min: 1 Median: 1.8825 Max: 8073 Percentiles: P50: 1.88 P75: 2.97 P99: 13.10 P99.9: 1826.35 P99.99: 3089.98 ------------------------------------------------------ [ 0, 1 ] 23961 5.500% 5.500% # ( 1, 2 ] 219667 50.424% 55.924% ########## ( 2, 3 ] 85431 19.610% 75.534% #### ( 3, 4 ] 44283 10.165% 85.699% ## ( 4, 6 ] 44067 10.115% 95.814% ## ( 6, 10 ] 11941 2.741% 98.555% # ( 10, 15 ] 3123 0.717% 99.272% ( 15, 22 ] 449 0.103% 99.375% ( 22, 34 ] 77 0.018% 99.393% ( 34, 51 ] 32 0.007% 99.400% ( 51, 76 ] 22 0.005% 99.405% ( 76, 110 ] 22 0.005% 99.411% ( 110, 170 ] 45 0.010% 99.421% ( 170, 250 ] 89 0.020% 99.441% ( 250, 380 ] 182 0.042% 99.483% ( 380, 580 ] 357 0.082% 99.565% ( 580, 870 ] 518 0.119% 99.684% ( 870, 1300 ] 558 0.128% 99.812% ( 1300, 1900 ] 437 0.100% 99.912% ( 1900, 2900 ] 305 0.070% 99.982% ( 2900, 4400 ] 264 0.061% 100.043% ( 4400, 6600 ] 91 0.021% 100.064% ( 6600, 9900 ] 9 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 1632756 Average: 11.5635 StdDev: 169.17 Min: 1 Median: 1.8983 Max: 28684 Percentiles: P50: 1.90 P75: 2.95 P99: 10.37 P99.9: 1101.65 P99.99: 1711.82 ------------------------------------------------------ [ 0, 1 ] 54452 3.335% 3.335% # ( 1, 2 ] 848195 51.949% 55.284% ########## ( 2, 3 ] 340445 20.851% 76.135% #### ( 3, 4 ] 165687 10.148% 86.282% ## ( 4, 6 ] 168144 10.298% 96.580% ## ( 6, 10 ] 38827 2.378% 98.958% ( 10, 15 ] 9136 0.560% 99.518% ( 15, 22 ] 1007 0.062% 99.580% ( 22, 34 ] 87 0.005% 99.585% ( 34, 51 ] 121 0.007% 99.592% ( 51, 76 ] 161 0.010% 99.602% ( 76, 110 ] 59 0.004% 99.606% ( 110, 170 ] 154 0.009% 99.615% ( 170, 250 ] 362 0.022% 99.637% ( 250, 380 ] 616 0.038% 99.675% ( 380, 580 ] 1178 0.072% 99.747% ( 580, 870 ] 1635 0.100% 99.847% ( 870, 1300 ] 1595 0.098% 99.945% ( 1300, 1900 ] 1069 0.065% 100.011% ( 1900, 2900 ] 1045 0.064% 100.075% ( 2900, 4400 ] 1013 0.062% 100.137% ( 4400, 6600 ] 262 0.016% 100.153% ( 6600, 9900 ] 93 0.006% 100.158% ( 9900, 14000 ] 30 0.002% 100.160% ( 14000, 22000 ] 14 0.001% 100.161% ( 22000, 33000 ] 5 0.000% 100.161% ** Level 4 read latency histogram (micros): Count: 422844 Average: 29.9620 StdDev: 280.01 Min: 1 Median: 1.9139 Max: 39985 Percentiles: P50: 1.91 P75: 3.03 P99: 812.29 P99.9: 3563.43 P99.99: 4323.53 ------------------------------------------------------ [ 0, 1 ] 15412 3.645% 3.645% # ( 1, 2 ] 214476 50.722% 54.367% ########## ( 2, 3 ] 85853 20.304% 74.671% #### ( 3, 4 ] 43046 10.180% 84.851% ## ( 4, 6 ] 42764 10.113% 94.964% ## ( 6, 10 ] 9992 2.363% 97.327% ( 10, 15 ] 2532 0.599% 97.926% ( 15, 22 ] 290 0.069% 97.995% ( 22, 34 ] 27 0.006% 98.001% ( 34, 51 ] 27 0.006% 98.008% ( 51, 76 ] 53 0.013% 98.020% ( 76, 110 ] 50 0.012% 98.032% ( 110, 170 ] 264 0.062% 98.094% ( 170, 250 ] 528 0.125% 98.219% ( 250, 380 ] 776 0.184% 98.403% ( 380, 580 ] 1277 0.302% 98.705% ( 580, 870 ] 1560 0.369% 99.074% ( 870, 1300 ] 1422 0.336% 99.410% ( 1300, 1900 ] 968 0.229% 99.639% ( 1900, 2900 ] 773 0.183% 99.822% ( 2900, 4400 ] 751 0.178% 99.999% ( 4400, 6600 ] 223 0.053% 100.052% ( 6600, 9900 ] 49 0.012% 100.064% ( 9900, 14000 ] 6 0.001% 100.065% ( 14000, 22000 ] 10 0.002% 100.067% ( 33000, 50000 ] 1 0.000% 100.068% ** Level 5 read latency histogram (micros): Count: 32215 Average: 1238.1066 StdDev: 1405.24 Min: 77 Median: 781.0550 Max: 31733 Percentiles: P50: 781.05 P75: 1488.17 P99: 6256.42 P99.9: 13706.97 P99.99: 29130.29 ------------------------------------------------------ ( 76, 110 ] 202 0.627% 0.627% ( 110, 170 ] 1245 3.865% 4.492% # ( 170, 250 ] 2093 6.497% 10.989% # ( 250, 380 ] 3199 9.930% 20.919% ## ( 380, 580 ] 5120 15.893% 36.812% ### ( 580, 870 ] 6128 19.022% 55.834% #### ( 870, 1300 ] 5229 16.232% 72.066% ### ( 1300, 1900 ] 3014 9.356% 81.422% ## ( 1900, 2900 ] 2309 7.167% 88.589% # ( 2900, 4400 ] 2602 8.077% 96.666% ## ( 4400, 6600 ] 891 2.766% 99.432% # ( 6600, 9900 ] 135 0.419% 99.851% ( 9900, 14000 ] 17 0.053% 99.904% ( 14000, 22000 ] 20 0.062% 99.966% ( 22000, 33000 ] 12 0.037% 100.003% ** DB Stats ** Uptime(secs): 13.8 total, 5.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 142.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.655 H:M:S, 41.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.885 H:M:S, 32.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-21:53:25 ... thread 0: (1000000,3000000) ops and (184422.1,157780.2) ops/second in (5.422345,19.013787) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 1.91 GB 6.3 1.8 0.0 1.8 4.6 2.8 0.0 1.7 66.3 165.7 28.50 15.87 40 0.712 1918K 2203 0.0 0.0 L1 7/7 555.35 MB 0.0 1.6 1.4 0.2 1.6 1.4 0.0 1.1 131.4 131.0 12.63 7.75 2 6.314 1684K 5012 0.0 0.0 L2 1/1 128.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/4 1.15 GB 0.9 6.7 2.9 3.8 6.7 2.9 0.0 2.3 120.1 119.1 57.36 32.69 21 2.731 4019K 6330 0.0 0.0 L4 169/4 9.69 GB 1.0 8.4 5.3 3.0 8.3 5.2 0.5 1.5 121.4 119.7 70.59 40.16 61 1.157 4658K 31 0.0 0.0 L5 1152/0 94.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1362/27 108.09 GB 0.0 18.6 9.7 8.9 21.1 12.3 7.1 7.6 112.4 128.1 169.07 96.47 124 1.363 12M 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.6 9.7 8.9 21.1 12.3 7.1 7.6 112.4 128.1 169.07 96.47 124 1.363 12M 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.6 9.7 8.9 18.4 9.5 0.0 0.0 125.9 124.6 151.02 88.26 90 1.678 12M 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 157.0 18.05 8.21 34 0.531 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.2 total, 19.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.15 GB write, 1126.28 MB/s write, 18.56 GB read, 988.63 MB/s read, 169.1 seconds Interval compaction: 21.15 GB write, 1138.87 MB/s write, 18.56 GB read, 999.68 MB/s read, 169.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 73, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 890010 Average: 10.8436 StdDev: 149.88 Min: 1 Median: 1.7753 Max: 36485 Percentiles: P50: 1.78 P75: 2.74 P99: 13.98 P99.9: 1689.67 P99.99: 3845.37 ------------------------------------------------------ [ 0, 1 ] 66551 7.478% 7.478% # ( 1, 2 ] 488136 54.846% 62.324% ########### ( 2, 3 ] 152509 17.136% 79.459% ### ( 3, 4 ] 77731 8.734% 88.193% ## ( 4, 6 ] 77796 8.741% 96.934% ## ( 6, 10 ] 15857 1.782% 98.716% ( 10, 15 ] 3178 0.357% 99.073% ( 15, 22 ] 344 0.039% 99.111% ( 22, 34 ] 34 0.004% 99.115% ( 34, 51 ] 36 0.004% 99.119% ( 51, 76 ] 35 0.004% 99.123% ( 76, 110 ] 136 0.015% 99.139% ( 110, 170 ] 725 0.081% 99.220% ( 170, 250 ] 1032 0.116% 99.336% ( 250, 380 ] 1116 0.125% 99.461% ( 380, 580 ] 1252 0.141% 99.602% ( 580, 870 ] 1259 0.141% 99.743% ( 870, 1300 ] 1028 0.116% 99.859% ( 1300, 1900 ] 562 0.063% 99.922% ( 1900, 2900 ] 379 0.043% 99.965% ( 2900, 4400 ] 357 0.040% 100.005% ( 4400, 6600 ] 115 0.013% 100.018% ( 6600, 9900 ] 13 0.001% 100.019% ( 9900, 14000 ] 5 0.001% 100.020% ( 14000, 22000 ] 5 0.001% 100.020% ( 22000, 33000 ] 2 0.000% 100.021% ( 33000, 50000 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 298747 Average: 11.7929 StdDev: 168.38 Min: 1 Median: 1.8859 Max: 23990 Percentiles: P50: 1.89 P75: 2.92 P99: 12.56 P99.9: 1866.24 P99.99: 3762.06 ------------------------------------------------------ [ 0, 1 ] 9772 3.271% 3.271% # ( 1, 2 ] 157582 52.748% 56.019% ########### ( 2, 3 ] 61636 20.632% 76.650% #### ( 3, 4 ] 28498 9.539% 86.189% ## ( 4, 6 ] 29827 9.984% 96.173% ## ( 6, 10 ] 7640 2.557% 98.731% # ( 10, 15 ] 1572 0.526% 99.257% ( 15, 22 ] 154 0.052% 99.308% ( 22, 34 ] 10 0.003% 99.312% ( 34, 51 ] 42 0.014% 99.326% ( 51, 76 ] 41 0.014% 99.340% ( 76, 110 ] 30 0.010% 99.350% ( 110, 170 ] 74 0.025% 99.374% ( 170, 250 ] 117 0.039% 99.414% ( 250, 380 ] 194 0.065% 99.478% ( 380, 580 ] 315 0.105% 99.584% ( 580, 870 ] 427 0.143% 99.727% ( 870, 1300 ] 337 0.113% 99.840% ( 1300, 1900 ] 191 0.064% 99.904% ( 1900, 2900 ] 161 0.054% 99.957% ( 2900, 4400 ] 169 0.057% 100.014% ( 4400, 6600 ] 40 0.013% 100.027% ( 6600, 9900 ] 14 0.005% 100.032% ( 9900, 14000 ] 7 0.002% 100.034% ( 14000, 22000 ] 4 0.001% 100.036% ( 22000, 33000 ] 1 0.000% 100.036% ** Level 2 read latency histogram (micros): Count: 435643 Average: 12.2714 StdDev: 151.15 Min: 1 Median: 1.8825 Max: 8073 Percentiles: P50: 1.88 P75: 2.97 P99: 13.10 P99.9: 1826.35 P99.99: 3089.98 ------------------------------------------------------ [ 0, 1 ] 23961 5.500% 5.500% # ( 1, 2 ] 219667 50.424% 55.924% ########## ( 2, 3 ] 85431 19.610% 75.534% #### ( 3, 4 ] 44283 10.165% 85.699% ## ( 4, 6 ] 44067 10.115% 95.814% ## ( 6, 10 ] 11941 2.741% 98.555% # ( 10, 15 ] 3123 0.717% 99.272% ( 15, 22 ] 449 0.103% 99.375% ( 22, 34 ] 77 0.018% 99.393% ( 34, 51 ] 32 0.007% 99.400% ( 51, 76 ] 22 0.005% 99.405% ( 76, 110 ] 22 0.005% 99.411% ( 110, 170 ] 45 0.010% 99.421% ( 170, 250 ] 89 0.020% 99.441% ( 250, 380 ] 182 0.042% 99.483% ( 380, 580 ] 357 0.082% 99.565% ( 580, 870 ] 518 0.119% 99.684% ( 870, 1300 ] 558 0.128% 99.812% ( 1300, 1900 ] 437 0.100% 99.912% ( 1900, 2900 ] 305 0.070% 99.982% ( 2900, 4400 ] 264 0.061% 100.043% ( 4400, 6600 ] 91 0.021% 100.064% ( 6600, 9900 ] 9 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 2292643 Average: 10.6104 StdDev: 164.25 Min: 1 Median: 1.8851 Max: 40299 Percentiles: P50: 1.89 P75: 2.92 P99: 9.95 P99.9: 969.99 P99.99: 1544.39 ------------------------------------------------------ [ 0, 1 ] 78435 3.421% 3.421% # ( 1, 2 ] 1206499 52.625% 56.046% ########### ( 2, 3 ] 472298 20.601% 76.647% #### ( 3, 4 ] 227802 9.936% 86.583% ## ( 4, 6 ] 231742 10.108% 96.691% ## ( 6, 10 ] 53635 2.339% 99.030% ( 10, 15 ] 11946 0.521% 99.551% ( 15, 22 ] 1282 0.056% 99.607% ( 22, 34 ] 108 0.005% 99.612% ( 34, 51 ] 174 0.008% 99.620% ( 51, 76 ] 239 0.010% 99.630% ( 76, 110 ] 92 0.004% 99.634% ( 110, 170 ] 288 0.013% 99.647% ( 170, 250 ] 608 0.027% 99.673% ( 250, 380 ] 942 0.041% 99.714% ( 380, 580 ] 1635 0.071% 99.785% ( 580, 870 ] 2162 0.094% 99.880% ( 870, 1300 ] 1997 0.087% 99.967% ( 1300, 1900 ] 1303 0.057% 100.024% ( 1900, 2900 ] 1253 0.055% 100.078% ( 2900, 4400 ] 1221 0.053% 100.132% ( 4400, 6600 ] 333 0.015% 100.146% ( 6600, 9900 ] 108 0.005% 100.151% ( 9900, 14000 ] 36 0.002% 100.152% ( 14000, 22000 ] 17 0.001% 100.153% ( 22000, 33000 ] 9 0.000% 100.154% ( 33000, 50000 ] 2 0.000% 100.154% ** Level 4 read latency histogram (micros): Count: 831262 Average: 22.7800 StdDev: 247.10 Min: 1 Median: 1.8854 Max: 39985 Percentiles: P50: 1.89 P75: 2.96 P99: 514.90 P99.9: 2584.78 P99.99: 3560.98 ------------------------------------------------------ [ 0, 1 ] 32124 3.864% 3.864% # ( 1, 2 ] 433127 52.105% 55.969% ########## ( 2, 3 ] 164529 19.793% 75.762% #### ( 3, 4 ] 81203 9.769% 85.531% ## ( 4, 6 ] 81698 9.828% 95.359% ## ( 6, 10 ] 20201 2.430% 97.789% ( 10, 15 ] 4575 0.550% 98.339% ( 15, 22 ] 513 0.062% 98.401% ( 22, 34 ] 46 0.006% 98.407% ( 34, 51 ] 59 0.007% 98.414% ( 51, 76 ] 88 0.011% 98.424% ( 76, 110 ] 120 0.014% 98.439% ( 110, 170 ] 647 0.078% 98.516% ( 170, 250 ] 1113 0.134% 98.650% ( 250, 380 ] 1442 0.173% 98.824% ( 380, 580 ] 2171 0.261% 99.085% ( 580, 870 ] 2565 0.309% 99.394% ( 870, 1300 ] 2192 0.264% 99.657% ( 1300, 1900 ] 1322 0.159% 99.816% ( 1900, 2900 ] 1016 0.122% 99.939% ( 2900, 4400 ] 971 0.117% 100.055% ( 4400, 6600 ] 303 0.036% 100.092% ( 6600, 9900 ] 67 0.008% 100.100% ( 9900, 14000 ] 11 0.001% 100.101% ( 14000, 22000 ] 12 0.001% 100.103% ( 22000, 33000 ] 7 0.001% 100.103% ( 33000, 50000 ] 2 0.000% 100.104% ** Level 5 read latency histogram (micros): Count: 52213 Average: 1071.9931 StdDev: 1333.34 Min: 77 Median: 672.0888 Max: 42818 Percentiles: P50: 672.09 P75: 1226.31 P99: 6028.49 P99.9: 12931.34 P99.99: 31031.43 ------------------------------------------------------ ( 76, 110 ] 524 1.004% 1.004% ( 110, 170 ] 3134 6.002% 7.006% # ( 170, 250 ] 4561 8.735% 15.741% ## ( 250, 380 ] 6040 11.568% 27.309% ## ( 380, 580 ] 8753 16.764% 44.073% ### ( 580, 870 ] 9745 18.664% 62.737% #### ( 870, 1300 ] 7727 14.799% 77.536% ### ( 1300, 1900 ] 4113 7.877% 85.414% ## ( 1900, 2900 ] 3037 5.817% 91.230% # ( 2900, 4400 ] 3233 6.192% 97.422% # ( 4400, 6600 ] 1113 2.132% 99.554% ( 6600, 9900 ] 166 0.318% 99.872% ( 9900, 14000 ] 20 0.038% 99.910% ( 14000, 22000 ] 27 0.052% 99.962% ( 22000, 33000 ] 18 0.034% 99.996% ( 33000, 50000 ] 3 0.006% 100.002% ** DB Stats ** Uptime(secs): 19.2 total, 5.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 153.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.127 H:M:S, 37.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 181.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.472 H:M:S, 27.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/18-21:53:28 ... thread 0: (1000000,4000000) ops and (282258.6,177331.4) ops/second in (3.542850,22.556637) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.89 GB 119.6 3.0 0.0 3.0 6.7 3.7 0.0 1.8 83.7 189.9 36.14 22.96 60 0.602 3070K 3472 0.0 0.0 L1 7/7 555.35 MB 0.0 1.6 1.4 0.2 1.6 1.4 0.0 1.1 131.4 131.0 12.63 7.75 2 6.314 1684K 5012 0.0 0.0 L3 17/0 908.18 MB 0.9 7.0 3.1 3.9 6.9 3.0 0.0 2.3 121.6 120.6 58.92 34.00 22 2.678 4169K 6330 0.0 0.0 L4 170/0 9.70 GB 1.0 9.1 5.6 3.5 9.0 5.5 0.6 1.6 125.1 123.3 74.40 43.49 64 1.162 5221K 31 0.0 0.0 L5 1156/0 95.04 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1366/18 109.06 GB 0.0 20.7 10.1 10.6 24.2 13.7 6.5 6.5 116.2 136.2 182.09 108.20 148 1.230 14M 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.7 10.1 10.6 24.2 13.7 6.5 6.5 116.2 136.2 182.09 108.20 148 1.230 14M 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.7 10.1 10.6 20.5 9.9 0.0 0.0 131.6 130.3 160.82 97.22 98 1.641 14M 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 180.7 21.27 10.98 50 0.425 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.8 total, 22.6 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.21 GB write, 1088.90 MB/s write, 20.66 GB read, 929.11 MB/s read, 182.1 seconds Interval compaction: 24.21 GB write, 1099.16 MB/s write, 20.66 GB read, 937.87 MB/s read, 182.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 73, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1195536 Average: 12.1854 StdDev: 134.38 Min: 0 Median: 1.6985 Max: 36485 Percentiles: P50: 1.70 P75: 2.56 P99: 228.60 P99.9: 1268.55 P99.99: 2979.70 ------------------------------------------------------ [ 0, 1 ] 135518 11.335% 11.335% ## ( 1, 2 ] 661755 55.352% 66.687% ########### ( 2, 3 ] 178531 14.933% 81.621% ### ( 3, 4 ] 88327 7.388% 89.009% # ( 4, 6 ] 84409 7.060% 96.069% # ( 6, 10 ] 16881 1.412% 97.481% ( 10, 15 ] 3304 0.276% 97.757% ( 15, 22 ] 370 0.031% 97.788% ( 22, 34 ] 35 0.003% 97.791% ( 34, 51 ] 38 0.003% 97.794% ( 51, 76 ] 37 0.003% 97.798% ( 76, 110 ] 1903 0.159% 97.957% ( 110, 170 ] 8479 0.709% 98.666% ( 170, 250 ] 5453 0.456% 99.122% ( 250, 380 ] 3277 0.274% 99.396% ( 380, 580 ] 2984 0.250% 99.646% ( 580, 870 ] 1969 0.165% 99.810% ( 870, 1300 ] 1156 0.097% 99.907% ( 1300, 1900 ] 575 0.048% 99.955% ( 1900, 2900 ] 397 0.033% 99.988% ( 2900, 4400 ] 366 0.031% 100.019% ( 4400, 6600 ] 115 0.010% 100.029% ( 6600, 9900 ] 13 0.001% 100.030% ( 9900, 14000 ] 5 0.000% 100.030% ( 14000, 22000 ] 5 0.000% 100.031% ( 22000, 33000 ] 2 0.000% 100.031% ( 33000, 50000 ] 2 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 308443 Average: 11.9584 StdDev: 166.22 Min: 1 Median: 1.8789 Max: 23990 Percentiles: P50: 1.88 P75: 2.91 P99: 14.18 P99.9: 1838.92 P99.99: 3753.45 ------------------------------------------------------ [ 0, 1 ] 10299 3.339% 3.339% # ( 1, 2 ] 163758 53.092% 56.431% ########### ( 2, 3 ] 62962 20.413% 76.844% #### ( 3, 4 ] 29005 9.404% 86.247% ## ( 4, 6 ] 30188 9.787% 96.035% ## ( 6, 10 ] 7807 2.531% 98.566% # ( 10, 15 ] 1602 0.519% 99.085% ( 15, 22 ] 155 0.050% 99.135% ( 22, 34 ] 11 0.004% 99.139% ( 34, 51 ] 42 0.014% 99.153% ( 51, 76 ] 41 0.013% 99.166% ( 76, 110 ] 91 0.030% 99.195% ( 110, 170 ] 307 0.100% 99.295% ( 170, 250 ] 257 0.083% 99.378% ( 250, 380 ] 271 0.088% 99.466% ( 380, 580 ] 371 0.120% 99.586% ( 580, 870 ] 454 0.147% 99.734% ( 870, 1300 ] 342 0.111% 99.844% ( 1300, 1900 ] 191 0.062% 99.906% ( 1900, 2900 ] 162 0.053% 99.959% ( 2900, 4400 ] 169 0.055% 100.014% ( 4400, 6600 ] 40 0.013% 100.027% ( 6600, 9900 ] 14 0.005% 100.031% ( 9900, 14000 ] 7 0.002% 100.033% ( 14000, 22000 ] 4 0.001% 100.035% ( 22000, 33000 ] 1 0.000% 100.035% ** Level 2 read latency histogram (micros): Count: 435643 Average: 12.2714 StdDev: 151.15 Min: 1 Median: 1.8825 Max: 8073 Percentiles: P50: 1.88 P75: 2.97 P99: 13.10 P99.9: 1826.35 P99.99: 3089.98 ------------------------------------------------------ [ 0, 1 ] 23961 5.500% 5.500% # ( 1, 2 ] 219667 50.424% 55.924% ########## ( 2, 3 ] 85431 19.610% 75.534% #### ( 3, 4 ] 44283 10.165% 85.699% ## ( 4, 6 ] 44067 10.115% 95.814% ## ( 6, 10 ] 11941 2.741% 98.555% # ( 10, 15 ] 3123 0.717% 99.272% ( 15, 22 ] 449 0.103% 99.375% ( 22, 34 ] 77 0.018% 99.393% ( 34, 51 ] 32 0.007% 99.400% ( 51, 76 ] 22 0.005% 99.405% ( 76, 110 ] 22 0.005% 99.411% ( 110, 170 ] 45 0.010% 99.421% ( 170, 250 ] 89 0.020% 99.441% ( 250, 380 ] 182 0.042% 99.483% ( 380, 580 ] 357 0.082% 99.565% ( 580, 870 ] 518 0.119% 99.684% ( 870, 1300 ] 558 0.128% 99.812% ( 1300, 1900 ] 437 0.100% 99.912% ( 1900, 2900 ] 305 0.070% 99.982% ( 2900, 4400 ] 264 0.061% 100.043% ( 4400, 6600 ] 91 0.021% 100.064% ( 6600, 9900 ] 9 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 2345577 Average: 10.5128 StdDev: 162.48 Min: 1 Median: 1.8793 Max: 40299 Percentiles: P50: 1.88 P75: 2.91 P99: 9.99 P99.9: 959.44 P99.99: 1541.95 ------------------------------------------------------ [ 0, 1 ] 82794 3.530% 3.530% # ( 1, 2 ] 1239640 52.850% 56.380% ########### ( 2, 3 ] 480407 20.481% 76.861% #### ( 3, 4 ] 230941 9.846% 86.707% ## ( 4, 6 ] 234120 9.981% 96.688% ## ( 6, 10 ] 54423 2.320% 99.009% ( 10, 15 ] 12045 0.514% 99.522% ( 15, 22 ] 1293 0.055% 99.577% ( 22, 34 ] 110 0.005% 99.582% ( 34, 51 ] 174 0.007% 99.589% ( 51, 76 ] 239 0.010% 99.600% ( 76, 110 ] 161 0.007% 99.606% ( 110, 170 ] 662 0.028% 99.635% ( 170, 250 ] 852 0.036% 99.671% ( 250, 380 ] 1053 0.045% 99.716% ( 380, 580 ] 1713 0.073% 99.789% ( 580, 870 ] 2188 0.093% 99.882% ( 870, 1300 ] 2002 0.085% 99.968% ( 1300, 1900 ] 1303 0.056% 100.023% ( 1900, 2900 ] 1254 0.053% 100.077% ( 2900, 4400 ] 1221 0.052% 100.129% ( 4400, 6600 ] 333 0.014% 100.143% ( 6600, 9900 ] 108 0.005% 100.147% ( 9900, 14000 ] 36 0.002% 100.149% ( 14000, 22000 ] 17 0.001% 100.150% ( 22000, 33000 ] 9 0.000% 100.150% ( 33000, 50000 ] 2 0.000% 100.150% ** Level 4 read latency histogram (micros): Count: 914934 Average: 22.6022 StdDev: 236.78 Min: 1 Median: 1.8737 Max: 39985 Percentiles: P50: 1.87 P75: 2.95 P99: 491.53 P99.9: 2482.01 P99.99: 3512.81 ------------------------------------------------------ [ 0, 1 ] 37168 4.062% 4.062% # ( 1, 2 ] 481039 52.576% 56.639% ########### ( 2, 3 ] 177583 19.409% 76.048% #### ( 3, 4 ] 86373 9.440% 85.488% ## ( 4, 6 ] 85828 9.381% 94.869% ## ( 6, 10 ] 21731 2.375% 97.244% ( 10, 15 ] 4801 0.525% 97.769% ( 15, 22 ] 537 0.059% 97.828% ( 22, 34 ] 51 0.006% 97.833% ( 34, 51 ] 59 0.006% 97.840% ( 51, 76 ] 88 0.010% 97.849% ( 76, 110 ] 711 0.078% 97.927% ( 110, 170 ] 3384 0.370% 98.297% ( 170, 250 ] 2637 0.288% 98.585% ( 250, 380 ] 2217 0.242% 98.828% ( 380, 580 ] 2829 0.309% 99.137% ( 580, 870 ] 2811 0.307% 99.444% ( 870, 1300 ] 2253 0.246% 99.690% ( 1300, 1900 ] 1326 0.145% 99.835% ( 1900, 2900 ] 1019 0.111% 99.947% ( 2900, 4400 ] 973 0.106% 100.053% ( 4400, 6600 ] 303 0.033% 100.086% ( 6600, 9900 ] 67 0.007% 100.093% ( 9900, 14000 ] 11 0.001% 100.095% ( 14000, 22000 ] 12 0.001% 100.096% ( 22000, 33000 ] 7 0.001% 100.097% ( 33000, 50000 ] 2 0.000% 100.097% ** Level 5 read latency histogram (micros): Count: 91012 Average: 713.9156 StdDev: 1098.57 Min: 75 Median: 353.9631 Max: 42818 Percentiles: P50: 353.96 P75: 794.45 P99: 5256.85 P99.9: 9363.01 P99.99: 26827.04 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 4257 4.677% 4.679% # ( 110, 170 ] 19108 20.995% 25.674% #### ( 170, 250 ] 13683 15.034% 40.708% ### ( 250, 380 ] 10575 11.619% 52.327% ## ( 380, 580 ] 12395 13.619% 65.946% ### ( 580, 870 ] 11143 12.243% 78.190% ## ( 870, 1300 ] 8045 8.839% 87.029% ## ( 1300, 1900 ] 4151 4.561% 91.590% # ( 1900, 2900 ] 3065 3.368% 94.958% # ( 2900, 4400 ] 3245 3.565% 98.523% # ( 4400, 6600 ] 1114 1.224% 99.747% ( 6600, 9900 ] 166 0.182% 99.930% ( 9900, 14000 ] 20 0.022% 99.952% ( 14000, 22000 ] 27 0.030% 99.981% ( 22000, 33000 ] 18 0.020% 100.001% ( 33000, 50000 ] 3 0.003% 100.004% ** DB Stats ** Uptime(secs): 22.8 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 172.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.127 H:M:S, 31.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-21:53:33 ... thread 0: (1000000,5000000) ops and (196488.1,180858.0) ops/second in (5.089367,27.646004) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 3.87 GB 88.1 4.2 0.0 4.2 8.9 4.7 0.0 1.9 96.9 206.6 44.19 30.52 81 0.546 4349K 4744 0.0 0.0 L1 7/7 555.35 MB 0.0 1.6 1.4 0.2 1.6 1.4 0.0 1.1 131.4 131.0 12.63 7.75 2 6.314 1684K 5012 0.0 0.0 L3 17/0 908.18 MB 0.9 7.0 3.1 3.9 6.9 3.0 0.0 2.3 121.6 120.6 58.92 34.00 22 2.678 4169K 6330 0.0 0.0 L4 170/0 9.70 GB 1.0 9.1 5.6 3.5 9.0 5.5 0.6 1.6 125.1 123.3 74.40 43.49 64 1.162 5221K 31 0.0 0.0 L5 1156/0 95.04 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1367/21 110.04 GB 0.0 21.9 10.1 11.8 26.4 14.6 6.5 5.6 117.9 142.3 190.14 115.76 169 1.125 15M 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.9 10.1 11.8 26.4 14.6 6.5 5.6 117.9 142.3 190.14 115.76 169 1.125 15M 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.9 10.1 11.8 21.7 9.9 0.0 0.0 135.3 134.1 165.67 101.99 103 1.608 15M 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 198.3 24.46 13.77 66 0.371 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.9 total, 27.6 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.43 GB write, 971.34 MB/s write, 21.89 GB read, 804.62 MB/s read, 190.1 seconds Interval compaction: 26.43 GB write, 978.81 MB/s write, 21.89 GB read, 810.81 MB/s read, 190.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 73, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1536795 Average: 13.6897 StdDev: 122.60 Min: 0 Median: 1.6362 Max: 36485 Percentiles: P50: 1.64 P75: 2.41 P99: 242.93 P99.9: 1083.10 P99.99: 2372.93 ------------------------------------------------------ [ 0, 1 ] 237097 15.428% 15.428% ### ( 1, 2 ] 835052 54.337% 69.765% ########### ( 2, 3 ] 198113 12.891% 82.657% ### ( 3, 4 ] 95971 6.245% 88.901% # ( 4, 6 ] 90106 5.863% 94.765% # ( 6, 10 ] 17886 1.164% 95.929% ( 10, 15 ] 3535 0.230% 96.159% ( 15, 22 ] 402 0.026% 96.185% ( 22, 34 ] 40 0.003% 96.187% ( 34, 51 ] 38 0.002% 96.190% ( 51, 76 ] 38 0.002% 96.192% ( 76, 110 ] 6190 0.403% 96.595% ( 110, 170 ] 26074 1.697% 98.292% ( 170, 250 ] 11942 0.777% 99.069% ( 250, 380 ] 5315 0.346% 99.415% ( 380, 580 ] 4492 0.292% 99.707% ( 580, 870 ] 2373 0.154% 99.861% ( 870, 1300 ] 1201 0.078% 99.939% ( 1300, 1900 ] 582 0.038% 99.977% ( 1900, 2900 ] 413 0.027% 100.004% ( 2900, 4400 ] 374 0.024% 100.029% ( 4400, 6600 ] 115 0.007% 100.036% ( 6600, 9900 ] 13 0.001% 100.037% ( 9900, 14000 ] 5 0.000% 100.037% ( 14000, 22000 ] 5 0.000% 100.038% ( 22000, 33000 ] 2 0.000% 100.038% ( 33000, 50000 ] 2 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 309428 Average: 12.4808 StdDev: 166.32 Min: 1 Median: 1.8819 Max: 23990 Percentiles: P50: 1.88 P75: 2.92 P99: 125.95 P99.9: 1836.16 P99.99: 3752.58 ------------------------------------------------------ [ 0, 1 ] 10299 3.328% 3.328% # ( 1, 2 ] 163758 52.923% 56.251% ########### ( 2, 3 ] 62962 20.348% 76.599% #### ( 3, 4 ] 29005 9.374% 85.973% ## ( 4, 6 ] 30188 9.756% 95.729% ## ( 6, 10 ] 7807 2.523% 98.252% # ( 10, 15 ] 1602 0.518% 98.770% ( 15, 22 ] 155 0.050% 98.820% ( 22, 34 ] 11 0.004% 98.823% ( 34, 51 ] 42 0.014% 98.837% ( 51, 76 ] 41 0.013% 98.850% ( 76, 110 ] 242 0.078% 98.928% ( 110, 170 ] 834 0.270% 99.198% ( 170, 250 ] 449 0.145% 99.343% ( 250, 380 ] 331 0.107% 99.450% ( 380, 580 ] 415 0.134% 99.584% ( 580, 870 ] 462 0.149% 99.733% ( 870, 1300 ] 344 0.111% 99.845% ( 1300, 1900 ] 192 0.062% 99.907% ( 1900, 2900 ] 162 0.052% 99.959% ( 2900, 4400 ] 169 0.055% 100.014% ( 4400, 6600 ] 40 0.013% 100.027% ( 6600, 9900 ] 14 0.005% 100.031% ( 9900, 14000 ] 7 0.002% 100.033% ( 14000, 22000 ] 4 0.001% 100.035% ( 22000, 33000 ] 1 0.000% 100.035% ** Level 2 read latency histogram (micros): Count: 435643 Average: 12.2714 StdDev: 151.15 Min: 1 Median: 1.8825 Max: 8073 Percentiles: P50: 1.88 P75: 2.97 P99: 13.10 P99.9: 1826.35 P99.99: 3089.98 ------------------------------------------------------ [ 0, 1 ] 23961 5.500% 5.500% # ( 1, 2 ] 219667 50.424% 55.924% ########## ( 2, 3 ] 85431 19.610% 75.534% #### ( 3, 4 ] 44283 10.165% 85.699% ## ( 4, 6 ] 44067 10.115% 95.814% ## ( 6, 10 ] 11941 2.741% 98.555% # ( 10, 15 ] 3123 0.717% 99.272% ( 15, 22 ] 449 0.103% 99.375% ( 22, 34 ] 77 0.018% 99.393% ( 34, 51 ] 32 0.007% 99.400% ( 51, 76 ] 22 0.005% 99.405% ( 76, 110 ] 22 0.005% 99.411% ( 110, 170 ] 45 0.010% 99.421% ( 170, 250 ] 89 0.020% 99.441% ( 250, 380 ] 182 0.042% 99.483% ( 380, 580 ] 357 0.082% 99.565% ( 580, 870 ] 518 0.119% 99.684% ( 870, 1300 ] 558 0.128% 99.812% ( 1300, 1900 ] 437 0.100% 99.912% ( 1900, 2900 ] 305 0.070% 99.982% ( 2900, 4400 ] 264 0.061% 100.043% ( 4400, 6600 ] 91 0.021% 100.064% ( 6600, 9900 ] 9 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 2347242 Average: 10.6154 StdDev: 162.50 Min: 1 Median: 1.8799 Max: 40299 Percentiles: P50: 1.88 P75: 2.91 P99: 10.51 P99.9: 960.45 P99.99: 1542.97 ------------------------------------------------------ [ 0, 1 ] 82794 3.527% 3.527% # ( 1, 2 ] 1239663 52.814% 56.341% ########### ( 2, 3 ] 480474 20.470% 76.811% #### ( 3, 4 ] 230985 9.841% 86.651% ## ( 4, 6 ] 234195 9.977% 96.629% ## ( 6, 10 ] 54439 2.319% 98.948% ( 10, 15 ] 12046 0.513% 99.461% ( 15, 22 ] 1294 0.055% 99.516% ( 22, 34 ] 110 0.005% 99.521% ( 34, 51 ] 174 0.007% 99.528% ( 51, 76 ] 239 0.010% 99.539% ( 76, 110 ] 378 0.016% 99.555% ( 110, 170 ] 1451 0.062% 99.617% ( 170, 250 ] 1116 0.048% 99.664% ( 250, 380 ] 1131 0.048% 99.712% ( 380, 580 ] 1785 0.076% 99.788% ( 580, 870 ] 2199 0.094% 99.882% ( 870, 1300 ] 2005 0.085% 99.967% ( 1300, 1900 ] 1307 0.056% 100.023% ( 1900, 2900 ] 1254 0.053% 100.077% ( 2900, 4400 ] 1221 0.052% 100.129% ( 4400, 6600 ] 333 0.014% 100.143% ( 6600, 9900 ] 108 0.005% 100.147% ( 9900, 14000 ] 36 0.002% 100.149% ( 14000, 22000 ] 17 0.001% 100.150% ( 22000, 33000 ] 9 0.000% 100.150% ( 33000, 50000 ] 2 0.000% 100.150% ** Level 4 read latency histogram (micros): Count: 927884 Average: 24.6076 StdDev: 236.10 Min: 1 Median: 1.8871 Max: 39985 Percentiles: P50: 1.89 P75: 3.00 P99: 507.67 P99.9: 2470.14 P99.99: 3510.81 ------------------------------------------------------ [ 0, 1 ] 37169 4.006% 4.006% # ( 1, 2 ] 481100 51.849% 55.855% ########## ( 2, 3 ] 177793 19.161% 75.016% #### ( 3, 4 ] 86519 9.324% 84.340% ## ( 4, 6 ] 86113 9.281% 93.621% ## ( 6, 10 ] 21782 2.347% 95.968% ( 10, 15 ] 4810 0.518% 96.487% ( 15, 22 ] 538 0.058% 96.545% ( 22, 34 ] 51 0.005% 96.550% ( 34, 51 ] 60 0.006% 96.557% ( 51, 76 ] 90 0.010% 96.566% ( 76, 110 ] 2607 0.281% 96.847% ( 110, 170 ] 9973 1.075% 97.922% ( 170, 250 ] 4907 0.529% 98.451% ( 250, 380 ] 2940 0.317% 98.768% ( 380, 580 ] 3373 0.364% 99.131% ( 580, 870 ] 2953 0.318% 99.450% ( 870, 1300 ] 2268 0.244% 99.694% ( 1300, 1900 ] 1328 0.143% 99.837% ( 1900, 2900 ] 1021 0.110% 99.947% ( 2900, 4400 ] 973 0.105% 100.052% ( 4400, 6600 ] 303 0.033% 100.085% ( 6600, 9900 ] 67 0.007% 100.092% ( 9900, 14000 ] 11 0.001% 100.093% ( 14000, 22000 ] 12 0.001% 100.095% ( 22000, 33000 ] 7 0.001% 100.095% ( 33000, 50000 ] 2 0.000% 100.095% ** Level 5 read latency histogram (micros): Count: 159650 Average: 483.6126 StdDev: 874.23 Min: 74 Median: 196.1782 Max: 42818 Percentiles: P50: 196.18 P75: 478.16 P99: 4282.93 P99.9: 7978.64 P99.99: 22021.39 ------------------------------------------------------ ( 51, 76 ] 4 0.003% 0.003% ( 76, 110 ] 14668 9.188% 9.190% ## ( 110, 170 ] 56561 35.428% 44.618% ####### ( 170, 250 ] 26257 16.447% 61.065% ### ( 250, 380 ] 14604 9.148% 70.212% ## ( 380, 580 ] 15573 9.754% 79.967% ## ( 580, 870 ] 11975 7.501% 87.468% ## ( 870, 1300 ] 8163 5.113% 92.581% # ( 1300, 1900 ] 4165 2.609% 95.189% # ( 1900, 2900 ] 3089 1.935% 97.124% ( 2900, 4400 ] 3248 2.034% 99.159% ( 4400, 6600 ] 1114 0.698% 99.857% ( 6600, 9900 ] 166 0.104% 99.961% ( 9900, 14000 ] 20 0.013% 99.973% ( 14000, 22000 ] 27 0.017% 99.990% ( 22000, 33000 ] 18 0.011% 100.001% ( 33000, 50000 ] 3 0.002% 100.003% ** DB Stats ** Uptime(secs): 27.9 total, 5.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 176.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.658 H:M:S, 31.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.532 H:M:S, 30.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-21:53:42 ... thread 0: (1000000,6000000) ops and (118000.9,166110.6) ops/second in (8.474513,36.120517) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 4.78 GB 338.8 6.5 0.0 6.5 12.1 5.6 0.0 2.1 118.2 221.4 55.96 41.80 100 0.560 6714K 16K 0.0 0.0 L1 7/7 555.35 MB 0.0 1.6 1.4 0.2 1.6 1.4 0.0 1.1 131.4 131.0 12.63 7.75 2 6.314 1684K 5012 0.0 0.0 L3 17/0 908.18 MB 0.9 7.0 3.1 3.9 6.9 3.0 0.0 2.3 121.6 120.6 58.92 34.00 22 2.678 4169K 6330 0.0 0.0 L4 170/0 9.70 GB 1.0 9.1 5.6 3.5 9.0 5.5 0.6 1.6 125.1 123.3 74.40 43.49 64 1.162 5221K 31 0.0 0.0 L5 1156/0 95.04 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1367/14 110.95 GB 0.0 24.2 10.1 14.1 29.6 15.6 6.5 5.2 122.6 150.2 201.91 127.04 188 1.074 17M 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.2 10.1 14.1 29.6 15.6 6.5 5.2 122.6 150.2 201.91 127.04 188 1.074 17M 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.2 10.1 14.1 24.0 9.9 0.0 0.0 141.8 140.5 174.53 110.73 107 1.631 17M 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 211.7 27.37 16.30 81 0.338 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.3 total, 36.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.61 GB write, 834.60 MB/s write, 24.17 GB read, 681.06 MB/s read, 201.9 seconds Interval compaction: 29.61 GB write, 839.51 MB/s write, 24.17 GB read, 685.07 MB/s read, 201.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 73, interval: 87 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2201811 Average: 14.8193 StdDev: 107.99 Min: 0 Median: 1.5629 Max: 36485 Percentiles: P50: 1.56 P75: 2.16 P99: 244.19 P99.9: 827.27 P99.99: 1564.82 ------------------------------------------------------ [ 0, 1 ] 440368 20.000% 20.000% #### ( 1, 2 ] 1173419 53.293% 73.294% ########### ( 2, 3 ] 236047 10.721% 84.014% ## ( 3, 4 ] 110972 5.040% 89.054% # ( 4, 6 ] 99384 4.514% 93.568% # ( 6, 10 ] 19679 0.894% 94.462% ( 10, 15 ] 4068 0.185% 94.646% ( 15, 22 ] 452 0.021% 94.667% ( 22, 34 ] 45 0.002% 94.669% ( 34, 51 ] 39 0.002% 94.671% ( 51, 76 ] 43 0.002% 94.673% ( 76, 110 ] 14276 0.648% 95.321% ( 110, 170 ] 59671 2.710% 98.031% # ( 170, 250 ] 23001 1.045% 99.076% ( 250, 380 ] 8607 0.391% 99.467% ( 380, 580 ] 6964 0.316% 99.783% ( 580, 870 ] 3019 0.137% 99.920% ( 870, 1300 ] 1272 0.058% 99.978% ( 1300, 1900 ] 600 0.027% 100.005% ( 1900, 2900 ] 441 0.020% 100.025% ( 2900, 4400 ] 387 0.018% 100.043% ( 4400, 6600 ] 116 0.005% 100.048% ( 6600, 9900 ] 13 0.001% 100.049% ( 9900, 14000 ] 5 0.000% 100.049% ( 14000, 22000 ] 5 0.000% 100.049% ( 22000, 33000 ] 2 0.000% 100.049% ( 33000, 50000 ] 2 0.000% 100.049% ** Level 1 read latency histogram (micros): Count: 311107 Average: 13.3334 StdDev: 166.43 Min: 1 Median: 1.8870 Max: 23990 Percentiles: P50: 1.89 P75: 2.94 P99: 164.22 P99.9: 1830.92 P99.99: 3751.09 ------------------------------------------------------ [ 0, 1 ] 10299 3.310% 3.310% # ( 1, 2 ] 163758 52.637% 55.948% ########### ( 2, 3 ] 62962 20.238% 76.186% #### ( 3, 4 ] 29005 9.323% 85.509% ## ( 4, 6 ] 30188 9.703% 95.212% ## ( 6, 10 ] 7807 2.509% 97.722% # ( 10, 15 ] 1602 0.515% 98.237% ( 15, 22 ] 155 0.050% 98.286% ( 22, 34 ] 11 0.004% 98.290% ( 34, 51 ] 42 0.014% 98.303% ( 51, 76 ] 42 0.014% 98.317% ( 76, 110 ] 538 0.173% 98.490% ( 110, 170 ] 1756 0.564% 99.054% ( 170, 250 ] 720 0.231% 99.286% ( 250, 380 ] 437 0.140% 99.426% ( 380, 580 ] 480 0.154% 99.581% ( 580, 870 ] 478 0.154% 99.734% ( 870, 1300 ] 346 0.111% 99.845% ( 1300, 1900 ] 192 0.062% 99.907% ( 1900, 2900 ] 162 0.052% 99.959% ( 2900, 4400 ] 169 0.054% 100.014% ( 4400, 6600 ] 40 0.013% 100.026% ( 6600, 9900 ] 14 0.005% 100.031% ( 9900, 14000 ] 7 0.002% 100.033% ( 14000, 22000 ] 4 0.001% 100.034% ( 22000, 33000 ] 1 0.000% 100.035% ** Level 2 read latency histogram (micros): Count: 435643 Average: 12.2714 StdDev: 151.15 Min: 1 Median: 1.8825 Max: 8073 Percentiles: P50: 1.88 P75: 2.97 P99: 13.10 P99.9: 1826.35 P99.99: 3089.98 ------------------------------------------------------ [ 0, 1 ] 23961 5.500% 5.500% # ( 1, 2 ] 219667 50.424% 55.924% ########## ( 2, 3 ] 85431 19.610% 75.534% #### ( 3, 4 ] 44283 10.165% 85.699% ## ( 4, 6 ] 44067 10.115% 95.814% ## ( 6, 10 ] 11941 2.741% 98.555% # ( 10, 15 ] 3123 0.717% 99.272% ( 15, 22 ] 449 0.103% 99.375% ( 22, 34 ] 77 0.018% 99.393% ( 34, 51 ] 32 0.007% 99.400% ( 51, 76 ] 22 0.005% 99.405% ( 76, 110 ] 22 0.005% 99.411% ( 110, 170 ] 45 0.010% 99.421% ( 170, 250 ] 89 0.020% 99.441% ( 250, 380 ] 182 0.042% 99.483% ( 380, 580 ] 357 0.082% 99.565% ( 580, 870 ] 518 0.119% 99.684% ( 870, 1300 ] 558 0.128% 99.812% ( 1300, 1900 ] 437 0.100% 99.912% ( 1900, 2900 ] 305 0.070% 99.982% ( 2900, 4400 ] 264 0.061% 100.043% ( 4400, 6600 ] 91 0.021% 100.064% ( 6600, 9900 ] 9 0.002% 100.066% ** Level 3 read latency histogram (micros): Count: 2350299 Average: 10.8152 StdDev: 162.55 Min: 1 Median: 1.8812 Max: 40299 Percentiles: P50: 1.88 P75: 2.92 P99: 11.69 P99.9: 961.62 P99.99: 1544.02 ------------------------------------------------------ [ 0, 1 ] 82794 3.523% 3.523% # ( 1, 2 ] 1239684 52.746% 56.269% ########### ( 2, 3 ] 480532 20.446% 76.714% #### ( 3, 4 ] 231014 9.829% 86.543% ## ( 4, 6 ] 234246 9.967% 96.510% ## ( 6, 10 ] 54444 2.316% 98.826% ( 10, 15 ] 12046 0.513% 99.339% ( 15, 22 ] 1294 0.055% 99.394% ( 22, 34 ] 110 0.005% 99.399% ( 34, 51 ] 174 0.007% 99.406% ( 51, 76 ] 239 0.010% 99.416% ( 76, 110 ] 863 0.037% 99.453% ( 110, 170 ] 3076 0.131% 99.584% ( 170, 250 ] 1585 0.067% 99.651% ( 250, 380 ] 1293 0.055% 99.706% ( 380, 580 ] 1902 0.081% 99.787% ( 580, 870 ] 2225 0.095% 99.882% ( 870, 1300 ] 2012 0.086% 99.967% ( 1300, 1900 ] 1308 0.056% 100.023% ( 1900, 2900 ] 1256 0.053% 100.077% ( 2900, 4400 ] 1221 0.052% 100.128% ( 4400, 6600 ] 333 0.014% 100.143% ( 6600, 9900 ] 108 0.005% 100.147% ( 9900, 14000 ] 36 0.002% 100.149% ( 14000, 22000 ] 17 0.001% 100.149% ( 22000, 33000 ] 9 0.000% 100.150% ( 33000, 50000 ] 2 0.000% 100.150% ** Level 4 read latency histogram (micros): Count: 949956 Average: 27.8935 StdDev: 234.91 Min: 1 Median: 1.9099 Max: 39985 Percentiles: P50: 1.91 P75: 3.19 P99: 524.02 P99.9: 2450.29 P99.99: 3506.78 ------------------------------------------------------ [ 0, 1 ] 37170 3.913% 3.913% # ( 1, 2 ] 481158 50.651% 54.563% ########## ( 2, 3 ] 178022 18.740% 73.303% #### ( 3, 4 ] 86635 9.120% 82.423% ## ( 4, 6 ] 86388 9.094% 91.517% ## ( 6, 10 ] 21810 2.296% 93.813% ( 10, 15 ] 4819 0.507% 94.320% ( 15, 22 ] 538 0.057% 94.377% ( 22, 34 ] 52 0.005% 94.382% ( 34, 51 ] 60 0.006% 94.389% ( 51, 76 ] 90 0.009% 94.398% ( 76, 110 ] 6142 0.647% 95.045% ( 110, 170 ] 21960 2.312% 97.357% ( 170, 250 ] 8527 0.898% 98.254% ( 250, 380 ] 4048 0.426% 98.680% ( 380, 580 ] 4218 0.444% 99.124% ( 580, 870 ] 3181 0.335% 99.459% ( 870, 1300 ] 2293 0.241% 99.701% ( 1300, 1900 ] 1331 0.140% 99.841% ( 1900, 2900 ] 1025 0.108% 99.949% ( 2900, 4400 ] 974 0.103% 100.051% ( 4400, 6600 ] 303 0.032% 100.083% ( 6600, 9900 ] 67 0.007% 100.090% ( 9900, 14000 ] 11 0.001% 100.091% ( 14000, 22000 ] 12 0.001% 100.092% ( 22000, 33000 ] 7 0.001% 100.093% ( 33000, 50000 ] 2 0.000% 100.093% ** Level 5 read latency histogram (micros): Count: 276584 Average: 352.0284 StdDev: 685.43 Min: 74 Median: 161.4250 Max: 42818 Percentiles: P50: 161.43 P75: 284.18 P99: 3741.35 P99.9: 6494.18 P99.99: 16767.88 ------------------------------------------------------ ( 51, 76 ] 11 0.004% 0.004% ( 76, 110 ] 34003 12.294% 12.298% ## ( 110, 170 ] 121666 43.989% 56.287% ######### ( 170, 250 ] 46289 16.736% 73.023% ### ( 250, 380 ] 20801 7.521% 80.543% ## ( 380, 580 ] 20455 7.396% 87.939% # ( 580, 870 ] 13177 4.764% 92.703% # ( 870, 1300 ] 8289 2.997% 95.700% # ( 1300, 1900 ] 4185 1.513% 97.213% ( 1900, 2900 ] 3117 1.127% 98.340% ( 2900, 4400 ] 3254 1.176% 99.517% ( 4400, 6600 ] 1114 0.403% 99.919% ( 6600, 9900 ] 166 0.060% 99.979% ( 9900, 14000 ] 20 0.007% 99.987% ( 14000, 22000 ] 27 0.010% 99.996% ( 22000, 33000 ] 18 0.007% 100.003% ( 33000, 50000 ] 3 0.001% 100.004% ** DB Stats ** Uptime(secs): 36.3 total, 8.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 162.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.523 H:M:S, 37.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 116.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.865 H:M:S, 57.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 286.837 micros/op 13933 ops/sec 60.144 seconds 837996 operations; 13.5 MB/s (214999 of 214999 found) Microseconds per read: Count: 837996 Average: 286.8397 StdDev: 812.64 Min: 2 Median: 185.6037 Max: 79709 Percentiles: P50: 185.60 P75: 246.29 P99: 1956.53 P99.9: 12829.77 P99.99: 30917.88 ------------------------------------------------------ ( 1, 2 ] 1 0.000% 0.000% ( 2, 3 ] 17 0.002% 0.002% ( 3, 4 ] 51 0.006% 0.008% ( 4, 6 ] 99 0.012% 0.020% ( 6, 10 ] 350 0.042% 0.062% ( 10, 15 ] 2790 0.333% 0.395% ( 15, 22 ] 3154 0.376% 0.771% ( 22, 34 ] 7651 0.913% 1.684% ( 34, 51 ] 2425 0.289% 1.974% ( 51, 76 ] 395 0.047% 2.021% ( 76, 110 ] 13241 1.580% 3.601% ( 110, 170 ] 334957 39.971% 43.572% ######## ( 170, 250 ] 276175 32.957% 76.529% ####### ( 250, 380 ] 101492 12.111% 88.640% ## ( 380, 580 ] 47954 5.722% 94.362% # ( 580, 870 ] 22521 2.687% 97.050% # ( 870, 1300 ] 11236 1.341% 98.391% ( 1300, 1900 ] 4927 0.588% 98.979% ( 1900, 2900 ] 3185 0.380% 99.359% ( 2900, 4400 ] 2821 0.337% 99.695% ( 4400, 6600 ] 974 0.116% 99.811% ( 6600, 9900 ] 384 0.046% 99.857% ( 9900, 14000 ] 501 0.060% 99.917% ( 14000, 22000 ] 475 0.057% 99.974% ( 22000, 33000 ] 168 0.020% 99.994% ( 33000, 50000 ] 38 0.005% 99.998% ( 50000, 75000 ] 13 0.002% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14523734 rocksdb.bloom.filter.full.positive COUNT : 979011 rocksdb.bloom.filter.full.true.positive COUNT : 837580 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 416 rocksdb.memtable.miss COUNT : 837580 rocksdb.l0.hit COUNT : 37431 rocksdb.l1.hit COUNT : 4292 rocksdb.l2andup.hit COUNT : 795857 rocksdb.compaction.key.drop.new COUNT : 233502 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6304911 rocksdb.number.keys.read COUNT : 837996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6506668152 rocksdb.bytes.read COUNT : 837996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1709 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35560624 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28823237302 rocksdb.compact.write.bytes COUNT : 28579471022 rocksdb.flush.write.bytes COUNT : 6473601590 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 1276 rocksdb.number.superversion_releases COUNT : 1241 rocksdb.number.superversion_cleanups COUNT : 322 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 234 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6421469184 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2558976 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32612629923 rocksdb.non.last.level.read.count COUNT : 7737632 rocksdb.block.checksum.compute.count COUNT : 7970205 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 184.139864 P95 : 647.309472 P99 : 1955.864449 P100 : 79707.000000 COUNT : 837996 SUM : 239602908 rocksdb.db.write.micros P50 : 1.554851 P95 : 4.457162 P99 : 8.996845 P100 : 949922.000000 COUNT : 6304911 SUM : 51665127 rocksdb.compaction.times.micros P50 : 1268292.682927 P95 : 4575000.000000 P99 : 7489404.000000 P100 : 7489404.000000 COUNT : 110 SUM : 181005732 rocksdb.compaction.times.cpu_micros P50 : 838780.487805 P95 : 3250000.000000 P99 : 5861047.000000 P100 : 5861047.000000 COUNT : 110 SUM : 117146013 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 905.833333 P95 : 94250.000000 P99 : 266900.000000 P100 : 301254.000000 COUNT : 87 SUM : 1296934 rocksdb.compaction.outfile.sync.micros P50 : 14148.148148 P95 : 344900.000000 P99 : 539192.857143 P100 : 767383.000000 COUNT : 327 SUM : 19349867 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 271.666667 P95 : 4285.000000 P99 : 6536.750000 P100 : 12193.000000 COUNT : 223 SUM : 248608 rocksdb.table.open.io.micros P50 : 8267.405063 P95 : 19278.873239 P99 : 21846.384977 P100 : 28545.000000 COUNT : 1709 SUM : 14411835 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.819415 P95 : 9.977231 P99 : 184.557887 P100 : 40302.000000 COUNT : 6979581 SUM : 103244802 rocksdb.read.block.get.micros P50 : 144.036135 P95 : 532.837448 P99 : 1810.677709 P100 : 42824.000000 COUNT : 988899 SUM : 207292514 rocksdb.write.raw.block.micros P50 : 0.527390 P95 : 1.060629 P99 : 3.372616 P100 : 49833.000000 COUNT : 8489988 SUM : 25693261 rocksdb.numfiles.in.singlecompaction P50 : 2.689189 P95 : 5.157143 P99 : 9.480000 P100 : 14.000000 COUNT : 139 SUM : 458 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562931 P95 : 1158.276235 P99 : 2397.865280 P100 : 949744.000000 COUNT : 204962 SUM : 35578097 rocksdb.sst.read.micros P50 : 1.877118 P95 : 162.111934 P99 : 508.676172 P100 : 42818.000000 COUNT : 7737647 SUM : 290827244 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 837996 SUM : 837996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6304911 SUM : 6506668152 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 232142.857143 P95 : 816500.000000 P99 : 1101400.000000 P100 : 1186352.000000 COUNT : 87 SUM : 28630710 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 346 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0