[2024-10-13 06:04:40.939725] Starting SPDK v25.01-pre git sha1 bbce7a874 / DPDK 24.03.0 initialization... [2024-10-13 06:04:40.939822] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2511168 ] Set seed to 1728792280937330 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-13 06:04:41.044120] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-13 06:04:41.147102] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-13 06:04:41.147149] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2511168' to capture a snapshot of events at runtime. [2024-10-13 06:04:41.147161] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-13 06:04:41.147171] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-13 06:04:41.147179] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2511168 for offline analysis/debug. [2024-10-13 06:04:41.148581] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Oct 13 06:04:49 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/13-06:04:57 ... thread 0: (1000000,1000000) ops and (125152.8,125152.8) ops/second in (7.990234,7.990234) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/3 629.52 MB 12.6 0.3 0.0 0.3 1.1 0.8 0.0 1.4 33.1 119.0 9.53 3.80 10 0.953 319K 357 0.0 0.0 L1 3/3 247.40 MB 0.0 0.7 0.3 0.3 0.7 0.3 0.0 2.0 114.4 114.3 5.90 3.19 2 2.949 685K 772 0.0 0.0 L2 23/19 2.69 GB 4.1 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 39/22 2.30 GB 1.0 3.0 1.9 1.1 3.0 1.9 0.0 1.6 94.1 93.4 32.76 15.06 17 1.927 1384K 3195 0.0 0.0 L4 193/17 10.79 GB 1.0 1.6 1.1 0.6 1.6 1.1 0.0 1.5 103.6 102.1 16.24 8.00 13 1.249 1177K 49 0.0 0.0 L5 1076/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1338/64 105.35 GB 0.0 5.6 3.3 2.3 6.4 4.1 0.2 8.0 89.3 101.3 64.42 30.06 42 1.534 3568K 4373 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 3.3 2.3 6.4 4.1 0.2 8.0 89.3 101.3 64.42 30.06 42 1.534 3568K 4373 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 3.3 2.3 5.6 3.3 0.0 0.0 100.6 99.8 57.20 27.55 33 1.733 3568K 4373 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 113.3 7.22 2.51 9 0.803 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.1 total, 8.0 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.37 GB write, 801.06 MB/s write, 5.62 GB read, 706.58 MB/s read, 64.4 seconds Interval compaction: 6.37 GB write, 816.51 MB/s write, 5.62 GB read, 720.21 MB/s read, 64.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 26, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 188709 Average: 9.0467 StdDev: 222.57 Min: 1 Median: 1.9654 Max: 63173 Percentiles: P50: 1.97 P75: 2.90 P99: 9.32 P99.9: 1812.73 P99.99: 4073.87 ------------------------------------------------------ [ 0, 1 ] 4312 2.285% 2.285% ( 1, 2 ] 93273 49.427% 51.712% ########## ( 2, 3 ] 48878 25.901% 77.613% ##### ( 3, 4 ] 18099 9.591% 87.204% ## ( 4, 6 ] 19206 10.178% 97.382% ## ( 6, 10 ] 3684 1.952% 99.334% ( 10, 15 ] 612 0.324% 99.658% ( 15, 22 ] 74 0.039% 99.697% ( 22, 34 ] 7 0.004% 99.701% ( 34, 51 ] 2 0.001% 99.702% ( 51, 76 ] 2 0.001% 99.703% ( 76, 110 ] 1 0.001% 99.704% ( 110, 170 ] 2 0.001% 99.705% ( 170, 250 ] 11 0.006% 99.711% ( 250, 380 ] 26 0.014% 99.724% ( 380, 580 ] 54 0.029% 99.753% ( 580, 870 ] 84 0.045% 99.798% ( 870, 1300 ] 101 0.054% 99.851% ( 1300, 1900 ] 108 0.057% 99.908% ( 1900, 2900 ] 115 0.061% 99.969% ( 2900, 4400 ] 50 0.026% 99.996% ( 4400, 6600 ] 11 0.006% 100.002% ( 6600, 9900 ] 8 0.004% 100.006% ( 9900, 14000 ] 5 0.003% 100.008% ( 14000, 22000 ] 4 0.002% 100.011% ( 33000, 50000 ] 1 0.001% 100.011% ( 50000, 75000 ] 1 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 88746 Average: 14.4203 StdDev: 241.14 Min: 1 Median: 2.0631 Max: 36660 Percentiles: P50: 2.06 P75: 2.97 P99: 9.93 P99.9: 3341.53 P99.99: 6668.97 ------------------------------------------------------ [ 0, 1 ] 1625 1.831% 1.831% ( 1, 2 ] 41198 46.422% 48.253% ######### ( 2, 3 ] 24565 27.680% 75.934% ###### ( 3, 4 ] 8924 10.056% 85.989% ## ( 4, 6 ] 9839 11.087% 97.076% ## ( 6, 10 ] 1736 1.956% 99.032% ( 10, 15 ] 357 0.402% 99.434% ( 15, 22 ] 54 0.061% 99.495% ( 22, 34 ] 2 0.002% 99.497% ( 34, 51 ] 4 0.005% 99.502% ( 51, 76 ] 1 0.001% 99.503% ( 76, 110 ] 2 0.002% 99.505% ( 110, 170 ] 3 0.003% 99.509% ( 170, 250 ] 6 0.007% 99.515% ( 250, 380 ] 6 0.007% 99.522% ( 380, 580 ] 19 0.021% 99.544% ( 580, 870 ] 39 0.044% 99.588% ( 870, 1300 ] 70 0.079% 99.666% ( 1300, 1900 ] 85 0.096% 99.762% ( 1900, 2900 ] 99 0.112% 99.874% ( 2900, 4400 ] 79 0.089% 99.963% ( 4400, 6600 ] 24 0.027% 99.990% ( 6600, 9900 ] 6 0.007% 99.997% ( 14000, 22000 ] 1 0.001% 99.998% ( 22000, 33000 ] 1 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 719279 Average: 19.8466 StdDev: 282.99 Min: 1 Median: 2.2096 Max: 74903 Percentiles: P50: 2.21 P75: 3.08 P99: 12.71 P99.9: 2443.14 P99.99: 2965.75 ------------------------------------------------------ [ 0, 1 ] 7096 0.987% 0.987% ( 1, 2 ] 306391 42.597% 43.584% ######### ( 2, 3 ] 220164 30.609% 74.192% ###### ( 3, 4 ] 74031 10.292% 84.485% ## ( 4, 6 ] 81598 11.344% 95.829% ## ( 6, 10 ] 20464 2.845% 98.674% # ( 10, 15 ] 4325 0.601% 99.276% ( 15, 22 ] 620 0.086% 99.362% ( 22, 34 ] 69 0.010% 99.371% ( 34, 51 ] 33 0.005% 99.376% ( 51, 76 ] 27 0.004% 99.380% ( 76, 110 ] 20 0.003% 99.383% ( 110, 170 ] 21 0.003% 99.385% ( 170, 250 ] 41 0.006% 99.391% ( 250, 380 ] 114 0.016% 99.407% ( 380, 580 ] 224 0.031% 99.438% ( 580, 870 ] 524 0.073% 99.511% ( 870, 1300 ] 933 0.130% 99.641% ( 1300, 1900 ] 1139 0.158% 99.799% ( 1900, 2900 ] 1338 0.186% 99.985% ( 2900, 4400 ] 823 0.114% 100.100% ( 4400, 6600 ] 270 0.038% 100.137% ( 6600, 9900 ] 56 0.008% 100.145% ( 9900, 14000 ] 19 0.003% 100.148% ( 14000, 22000 ] 13 0.002% 100.149% ( 22000, 33000 ] 5 0.001% 100.150% ( 33000, 50000 ] 4 0.001% 100.151% ( 50000, 75000 ] 2 0.000% 100.151% ** Level 3 read latency histogram (micros): Count: 621596 Average: 13.9297 StdDev: 201.13 Min: 1 Median: 2.1729 Max: 50182 Percentiles: P50: 2.17 P75: 2.99 P99: 9.85 P99.9: 1880.61 P99.99: 2577.42 ------------------------------------------------------ [ 0, 1 ] 6324 1.017% 1.017% ( 1, 2 ] 271541 43.684% 44.702% ######### ( 2, 3 ] 190446 30.638% 75.340% ###### ( 3, 4 ] 63444 10.207% 85.547% ## ( 4, 6 ] 69570 11.192% 96.739% ## ( 6, 10 ] 14600 2.349% 99.088% ( 10, 15 ] 2651 0.426% 99.514% ( 15, 22 ] 343 0.055% 99.569% ( 22, 34 ] 28 0.005% 99.574% ( 34, 51 ] 17 0.003% 99.577% ( 51, 76 ] 35 0.006% 99.582% ( 76, 110 ] 5 0.001% 99.583% ( 110, 170 ] 22 0.004% 99.587% ( 170, 250 ] 50 0.008% 99.595% ( 250, 380 ] 67 0.011% 99.605% ( 380, 580 ] 188 0.030% 99.636% ( 580, 870 ] 360 0.058% 99.694% ( 870, 1300 ] 577 0.093% 99.786% ( 1300, 1900 ] 730 0.117% 99.904% ( 1900, 2900 ] 791 0.127% 100.031% ( 2900, 4400 ] 462 0.074% 100.105% ( 4400, 6600 ] 131 0.021% 100.126% ( 6600, 9900 ] 24 0.004% 100.130% ( 9900, 14000 ] 4 0.001% 100.131% ( 14000, 22000 ] 5 0.001% 100.132% ( 22000, 33000 ] 3 0.000% 100.132% ( 50000, 75000 ] 1 0.000% 100.132% ** Level 4 read latency histogram (micros): Count: 193208 Average: 41.4304 StdDev: 392.19 Min: 1 Median: 2.1949 Max: 60180 Percentiles: P50: 2.19 P75: 3.12 P99: 1374.58 P99.9: 4187.09 P99.99: 5496.32 ------------------------------------------------------ [ 0, 1 ] 2137 1.106% 1.106% ( 1, 2 ] 83371 43.151% 44.257% ######### ( 2, 3 ] 56944 29.473% 73.730% ###### ( 3, 4 ] 19659 10.175% 83.905% ## ( 4, 6 ] 21103 10.922% 94.827% ## ( 6, 10 ] 5438 2.815% 97.642% # ( 10, 15 ] 908 0.470% 98.112% ( 15, 22 ] 114 0.059% 98.171% ( 22, 34 ] 6 0.003% 98.174% ( 34, 51 ] 10 0.005% 98.179% ( 51, 76 ] 16 0.008% 98.187% ( 76, 110 ] 7 0.004% 98.191% ( 110, 170 ] 9 0.005% 98.196% ( 170, 250 ] 47 0.024% 98.220% ( 250, 380 ] 95 0.049% 98.269% ( 380, 580 ] 207 0.107% 98.376% ( 580, 870 ] 458 0.237% 98.613% ( 870, 1300 ] 666 0.345% 98.958% ( 1300, 1900 ] 651 0.337% 99.295% ( 1900, 2900 ] 696 0.360% 99.655% ( 2900, 4400 ] 551 0.285% 99.940% ( 4400, 6600 ] 192 0.099% 100.040% ( 6600, 9900 ] 43 0.022% 100.062% ( 9900, 14000 ] 8 0.004% 100.066% ( 14000, 22000 ] 3 0.002% 100.068% ( 22000, 33000 ] 5 0.003% 100.070% ( 50000, 75000 ] 1 0.001% 100.071% ** Level 5 read latency histogram (micros): Count: 9498 Average: 2393.0078 StdDev: 2684.48 Min: 121 Median: 1828.3465 Max: 100499 Percentiles: P50: 1828.35 P75: 3349.26 P99: 8988.76 P99.9: 29074.57 P99.99: 93378.50 ------------------------------------------------------ ( 110, 170 ] 18 0.190% 0.190% ( 170, 250 ] 77 0.811% 1.000% ( 250, 380 ] 226 2.379% 3.380% ( 380, 580 ] 533 5.612% 8.991% # ( 580, 870 ] 1096 11.539% 20.531% ## ( 870, 1300 ] 1457 15.340% 35.871% ### ( 1300, 1900 ] 1524 16.045% 51.916% ### ( 1900, 2900 ] 1704 17.941% 69.857% #### ( 2900, 4400 ] 1631 17.172% 87.029% ### ( 4400, 6600 ] 1006 10.592% 97.621% ## ( 6600, 9900 ] 181 1.906% 99.526% ( 9900, 14000 ] 19 0.200% 99.726% ( 14000, 22000 ] 12 0.126% 99.853% ( 22000, 33000 ] 7 0.074% 99.926% ( 50000, 75000 ] 5 0.053% 99.979% ( 75000, 110000 ] 2 0.021% 100.000% ** DB Stats ** Uptime(secs): 8.1 total, 8.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 120.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.159 H:M:S, 51.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 123.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.159 H:M:S, 52.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/13-06:05:03 ... thread 0: (1000000,2000000) ops and (162508.8,141405.3) ops/second in (6.153512,14.143746) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.11 GB 25.2 1.0 0.0 1.0 2.8 1.8 0.0 1.6 52.1 146.6 19.33 9.46 25 0.773 1023K 1265 0.0 0.0 L1 7/7 471.71 MB 0.0 1.4 0.8 0.6 1.4 0.8 0.0 1.7 126.3 126.1 11.29 6.70 3 3.763 1447K 2820 0.0 0.0 L2 5/4 563.04 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 39/16 3.02 GB 1.8 6.5 4.3 2.2 6.5 4.3 0.0 1.5 104.3 103.7 64.19 32.39 22 2.918 3147K 4449 0.0 0.0 L4 176/6 9.73 GB 1.0 4.3 2.8 1.5 4.2 2.7 0.0 1.5 112.1 110.7 39.17 20.80 29 1.351 2661K 802 0.0 0.0 L5 1108/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/37 106.28 GB 0.0 13.2 7.9 5.3 14.9 9.6 3.2 8.3 100.9 113.8 133.98 69.35 79 1.696 8280K 9336 0.0 0.0 Int 0/0 0.00 KB 0.0 13.2 7.9 5.3 14.9 9.6 3.2 8.3 100.9 113.8 133.98 69.35 79 1.696 8280K 9336 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.2 7.9 5.3 13.1 7.8 0.0 0.0 112.3 111.5 120.41 64.00 57 2.113 8280K 9336 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 134.6 13.57 5.35 22 0.617 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.3 total, 14.1 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.89 GB write, 1066.35 MB/s write, 13.20 GB read, 945.36 MB/s read, 134.0 seconds Interval compaction: 14.89 GB write, 1077.97 MB/s write, 13.20 GB read, 955.66 MB/s read, 134.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 54, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 54, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 527217 Average: 8.7538 StdDev: 161.34 Min: 1 Median: 1.9716 Max: 63173 Percentiles: P50: 1.97 P75: 2.87 P99: 9.50 P99.9: 1622.31 P99.99: 3677.94 ------------------------------------------------------ [ 0, 1 ] 12013 2.279% 2.279% ( 1, 2 ] 258947 49.116% 51.394% ########## ( 2, 3 ] 142460 27.021% 78.416% ##### ( 3, 4 ] 48042 9.112% 87.528% ## ( 4, 6 ] 51596 9.786% 97.314% ## ( 6, 10 ] 10167 1.928% 99.243% ( 10, 15 ] 1741 0.330% 99.573% ( 15, 22 ] 234 0.044% 99.617% ( 22, 34 ] 12 0.002% 99.620% ( 34, 51 ] 15 0.003% 99.623% ( 51, 76 ] 16 0.003% 99.626% ( 76, 110 ] 7 0.001% 99.627% ( 110, 170 ] 17 0.003% 99.630% ( 170, 250 ] 53 0.010% 99.640% ( 250, 380 ] 130 0.025% 99.665% ( 380, 580 ] 267 0.051% 99.715% ( 580, 870 ] 410 0.078% 99.793% ( 870, 1300 ] 408 0.077% 99.871% ( 1300, 1900 ] 290 0.055% 99.926% ( 1900, 2900 ] 249 0.047% 99.973% ( 2900, 4400 ] 176 0.033% 100.006% ( 4400, 6600 ] 39 0.007% 100.014% ( 6600, 9900 ] 12 0.002% 100.016% ( 9900, 14000 ] 5 0.001% 100.017% ( 14000, 22000 ] 4 0.001% 100.018% ( 33000, 50000 ] 1 0.000% 100.018% ( 50000, 75000 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 203115 Average: 15.0363 StdDev: 205.72 Min: 1 Median: 2.1377 Max: 36660 Percentiles: P50: 2.14 P75: 2.98 P99: 12.81 P99.9: 3083.20 P99.99: 5898.22 ------------------------------------------------------ [ 0, 1 ] 2538 1.250% 1.250% ( 1, 2 ] 90706 44.657% 45.907% ######### ( 2, 3 ] 60371 29.723% 75.630% ###### ( 3, 4 ] 20177 9.934% 85.563% ## ( 4, 6 ] 21965 10.814% 96.377% ## ( 6, 10 ] 4825 2.376% 98.753% ( 10, 15 ] 893 0.440% 99.193% ( 15, 22 ] 117 0.058% 99.250% ( 22, 34 ] 4 0.002% 99.252% ( 34, 51 ] 11 0.005% 99.258% ( 51, 76 ] 12 0.006% 99.263% ( 76, 110 ] 7 0.003% 99.267% ( 110, 170 ] 12 0.006% 99.273% ( 170, 250 ] 39 0.019% 99.292% ( 250, 380 ] 75 0.037% 99.329% ( 380, 580 ] 184 0.091% 99.420% ( 580, 870 ] 262 0.129% 99.549% ( 870, 1300 ] 284 0.140% 99.688% ( 1300, 1900 ] 208 0.102% 99.791% ( 1900, 2900 ] 201 0.099% 99.890% ( 2900, 4400 ] 171 0.084% 99.974% ( 4400, 6600 ] 48 0.024% 99.998% ( 6600, 9900 ] 12 0.006% 100.003% ( 14000, 22000 ] 1 0.000% 100.004% ( 22000, 33000 ] 1 0.000% 100.004% ( 33000, 50000 ] 1 0.000% 100.005% ** Level 2 read latency histogram (micros): Count: 973292 Average: 18.1123 StdDev: 258.03 Min: 1 Median: 2.2254 Max: 74903 Percentiles: P50: 2.23 P75: 3.07 P99: 12.62 P99.9: 2477.45 P99.99: 3260.87 ------------------------------------------------------ [ 0, 1 ] 7850 0.807% 0.807% ( 1, 2 ] 410055 42.131% 42.937% ######## ( 2, 3 ] 304963 31.333% 74.270% ###### ( 3, 4 ] 100643 10.340% 84.611% ## ( 4, 6 ] 109696 11.271% 95.882% ## ( 6, 10 ] 27354 2.810% 98.692% # ( 10, 15 ] 5725 0.588% 99.280% ( 15, 22 ] 785 0.081% 99.361% ( 22, 34 ] 80 0.008% 99.369% ( 34, 51 ] 69 0.007% 99.376% ( 51, 76 ] 58 0.006% 99.382% ( 76, 110 ] 25 0.003% 99.385% ( 110, 170 ] 36 0.004% 99.388% ( 170, 250 ] 68 0.007% 99.395% ( 250, 380 ] 203 0.021% 99.416% ( 380, 580 ] 420 0.043% 99.459% ( 580, 870 ] 822 0.084% 99.544% ( 870, 1300 ] 1271 0.131% 99.674% ( 1300, 1900 ] 1334 0.137% 99.811% ( 1900, 2900 ] 1494 0.153% 99.965% ( 2900, 4400 ] 1017 0.104% 100.069% ( 4400, 6600 ] 336 0.035% 100.104% ( 6600, 9900 ] 76 0.008% 100.112% ( 9900, 14000 ] 19 0.002% 100.114% ( 14000, 22000 ] 13 0.001% 100.115% ( 22000, 33000 ] 5 0.001% 100.116% ( 33000, 50000 ] 4 0.000% 100.116% ( 50000, 75000 ] 2 0.000% 100.116% ** Level 3 read latency histogram (micros): Count: 1405562 Average: 12.9876 StdDev: 177.33 Min: 1 Median: 2.2124 Max: 50182 Percentiles: P50: 2.21 P75: 3.00 P99: 9.95 P99.9: 1486.90 P99.99: 2206.98 ------------------------------------------------------ [ 0, 1 ] 10133 0.721% 0.721% ( 1, 2 ] 597972 42.543% 43.264% ######### ( 2, 3 ] 445757 31.714% 74.978% ###### ( 3, 4 ] 146145 10.398% 85.376% ## ( 4, 6 ] 156658 11.146% 96.521% ## ( 6, 10 ] 35308 2.512% 99.033% # ( 10, 15 ] 6581 0.468% 99.501% ( 15, 22 ] 789 0.056% 99.558% ( 22, 34 ] 71 0.005% 99.563% ( 34, 51 ] 78 0.006% 99.568% ( 51, 76 ] 109 0.008% 99.576% ( 76, 110 ] 20 0.001% 99.577% ( 110, 170 ] 79 0.006% 99.583% ( 170, 250 ] 167 0.012% 99.595% ( 250, 380 ] 387 0.028% 99.622% ( 380, 580 ] 817 0.058% 99.680% ( 580, 870 ] 1263 0.090% 99.770% ( 870, 1300 ] 1436 0.102% 99.873% ( 1300, 1900 ] 1247 0.089% 99.961% ( 1900, 2900 ] 1324 0.094% 100.055% ( 2900, 4400 ] 1053 0.075% 100.130% ( 4400, 6600 ] 284 0.020% 100.151% ( 6600, 9900 ] 52 0.004% 100.154% ( 9900, 14000 ] 5 0.000% 100.155% ( 14000, 22000 ] 5 0.000% 100.155% ( 22000, 33000 ] 3 0.000% 100.155% ( 50000, 75000 ] 1 0.000% 100.155% ** Level 4 read latency histogram (micros): Count: 390031 Average: 35.7678 StdDev: 328.24 Min: 1 Median: 2.1862 Max: 60180 Percentiles: P50: 2.19 P75: 3.08 P99: 1116.57 P99.9: 3971.38 P99.99: 5184.06 ------------------------------------------------------ [ 0, 1 ] 3867 0.991% 0.991% ( 1, 2 ] 169519 43.463% 44.454% ######### ( 2, 3 ] 116139 29.777% 74.231% ###### ( 3, 4 ] 39062 10.015% 84.246% ## ( 4, 6 ] 41445 10.626% 94.872% ## ( 6, 10 ] 10468 2.684% 97.556% # ( 10, 15 ] 1769 0.454% 98.010% ( 15, 22 ] 220 0.056% 98.066% ( 22, 34 ] 15 0.004% 98.070% ( 34, 51 ] 23 0.006% 98.076% ( 51, 76 ] 42 0.011% 98.087% ( 76, 110 ] 11 0.003% 98.090% ( 110, 170 ] 49 0.013% 98.102% ( 170, 250 ] 186 0.048% 98.150% ( 250, 380 ] 365 0.094% 98.243% ( 380, 580 ] 726 0.186% 98.430% ( 580, 870 ] 1329 0.341% 98.770% ( 870, 1300 ] 1562 0.400% 99.171% ( 1300, 1900 ] 1157 0.297% 99.467% ( 1900, 2900 ] 1067 0.274% 99.741% ( 2900, 4400 ] 868 0.223% 99.964% ( 4400, 6600 ] 289 0.074% 100.038% ( 6600, 9900 ] 60 0.015% 100.053% ( 9900, 14000 ] 8 0.002% 100.055% ( 14000, 22000 ] 3 0.001% 100.056% ( 22000, 33000 ] 5 0.001% 100.057% ( 50000, 75000 ] 1 0.000% 100.057% ** Level 5 read latency histogram (micros): Count: 24512 Average: 1698.7414 StdDev: 1970.95 Min: 87 Median: 1139.0730 Max: 100499 Percentiles: P50: 1139.07 P75: 2279.74 P99: 6940.11 P99.9: 14992.00 P99.99: 72744.00 ------------------------------------------------------ ( 76, 110 ] 18 0.073% 0.073% ( 110, 170 ] 200 0.816% 0.889% ( 170, 250 ] 600 2.448% 3.337% ( 250, 380 ] 1327 5.414% 8.751% # ( 380, 580 ] 2759 11.256% 20.007% ## ( 580, 870 ] 4436 18.097% 38.104% #### ( 870, 1300 ] 4660 19.011% 57.115% #### ( 1300, 1900 ] 3323 13.557% 70.672% ### ( 1900, 2900 ] 2794 11.398% 82.070% ## ( 2900, 4400 ] 2763 11.272% 93.342% ## ( 4400, 6600 ] 1364 5.565% 98.907% # ( 6600, 9900 ] 222 0.906% 99.812% ( 9900, 14000 ] 20 0.082% 99.894% ( 14000, 22000 ] 12 0.049% 99.943% ( 22000, 33000 ] 7 0.029% 99.971% ( 50000, 75000 ] 5 0.020% 99.992% ( 75000, 110000 ] 2 0.008% 100.000% ** DB Stats ** Uptime(secs): 14.3 total, 6.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 137.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.493 H:M:S, 45.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 159.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.335 H:M:S, 37.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/13-06:05:10 ... thread 0: (1000000,3000000) ops and (154749.3,145590.0) ops/second in (6.462064,20.605810) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 2.09 GB 100.7 1.8 0.0 1.8 4.6 2.8 0.0 1.7 63.7 159.1 29.68 16.16 41 0.724 1918K 2230 0.0 0.0 L1 7/7 471.71 MB 0.0 1.4 0.8 0.6 1.4 0.8 0.0 1.7 126.3 126.1 11.29 6.70 3 3.763 1447K 2820 0.0 0.0 L3 15/0 924.84 MB 0.9 8.1 4.9 3.3 8.1 4.8 0.0 1.7 107.0 106.4 77.64 40.34 27 2.876 4328K 7616 0.0 0.0 L4 177/0 9.66 GB 1.0 7.8 5.1 2.8 7.8 5.0 0.4 1.5 112.3 111.1 71.52 39.95 52 1.375 5775K 3042 0.0 0.0 L5 1140/0 94.12 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1351/15 107.23 GB 0.0 19.2 10.8 8.4 21.8 13.4 5.8 7.9 103.4 117.6 190.13 103.15 123 1.546 13M 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.2 10.8 8.4 21.8 13.4 5.8 7.9 103.4 117.6 190.13 103.15 123 1.546 13M 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.2 10.8 8.4 19.1 10.6 0.0 0.0 115.4 114.6 170.30 94.79 88 1.935 13M 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 143.0 19.83 8.35 35 0.567 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.8 total, 20.6 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.83 GB write, 1076.79 MB/s write, 19.19 GB read, 946.69 MB/s read, 190.1 seconds Interval compaction: 21.83 GB write, 1084.84 MB/s write, 19.19 GB read, 953.77 MB/s read, 190.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 79, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 895287 Average: 9.3195 StdDev: 182.75 Min: 1 Median: 1.9411 Max: 63173 Percentiles: P50: 1.94 P75: 2.83 P99: 9.66 P99.9: 1532.62 P99.99: 3637.52 ------------------------------------------------------ [ 0, 1 ] 25744 2.876% 2.876% # ( 1, 2 ] 448318 50.075% 52.951% ########## ( 2, 3 ] 236723 26.441% 79.392% ##### ( 3, 4 ] 78061 8.719% 88.111% ## ( 4, 6 ] 82482 9.213% 97.324% ## ( 6, 10 ] 16399 1.832% 99.156% ( 10, 15 ] 2806 0.313% 99.469% ( 15, 22 ] 324 0.036% 99.505% ( 22, 34 ] 20 0.002% 99.507% ( 34, 51 ] 25 0.003% 99.510% ( 51, 76 ] 35 0.004% 99.514% ( 76, 110 ] 31 0.003% 99.518% ( 110, 170 ] 322 0.036% 99.554% ( 170, 250 ] 367 0.041% 99.595% ( 250, 380 ] 440 0.049% 99.644% ( 380, 580 ] 665 0.074% 99.718% ( 580, 870 ] 758 0.085% 99.803% ( 870, 1300 ] 706 0.079% 99.881% ( 1300, 1900 ] 430 0.048% 99.930% ( 1900, 2900 ] 393 0.044% 99.973% ( 2900, 4400 ] 304 0.034% 100.007% ( 4400, 6600 ] 73 0.008% 100.016% ( 6600, 9900 ] 24 0.003% 100.018% ( 9900, 14000 ] 8 0.001% 100.019% ( 14000, 22000 ] 14 0.002% 100.021% ( 22000, 33000 ] 7 0.001% 100.021% ( 33000, 50000 ] 3 0.000% 100.022% ( 50000, 75000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 362554 Average: 13.5673 StdDev: 201.17 Min: 1 Median: 2.1230 Max: 36660 Percentiles: P50: 2.12 P75: 2.96 P99: 11.77 P99.9: 2815.33 P99.99: 5506.81 ------------------------------------------------------ [ 0, 1 ] 4509 1.244% 1.244% ( 1, 2 ] 163466 45.087% 46.331% ######### ( 2, 3 ] 108179 29.838% 76.169% ###### ( 3, 4 ] 35063 9.671% 85.840% ## ( 4, 6 ] 38089 10.506% 96.346% ## ( 6, 10 ] 9070 2.502% 98.848% # ( 10, 15 ] 1562 0.431% 99.278% ( 15, 22 ] 184 0.051% 99.329% ( 22, 34 ] 9 0.002% 99.332% ( 34, 51 ] 17 0.005% 99.336% ( 51, 76 ] 20 0.006% 99.342% ( 76, 110 ] 22 0.006% 99.348% ( 110, 170 ] 75 0.021% 99.369% ( 170, 250 ] 98 0.027% 99.396% ( 250, 380 ] 143 0.039% 99.435% ( 380, 580 ] 275 0.076% 99.511% ( 580, 870 ] 408 0.113% 99.624% ( 870, 1300 ] 439 0.121% 99.745% ( 1300, 1900 ] 298 0.082% 99.827% ( 1900, 2900 ] 290 0.080% 99.907% ( 2900, 4400 ] 262 0.072% 99.979% ( 4400, 6600 ] 79 0.022% 100.001% ( 6600, 9900 ] 25 0.007% 100.008% ( 9900, 14000 ] 1 0.000% 100.008% ( 14000, 22000 ] 3 0.001% 100.009% ( 22000, 33000 ] 2 0.001% 100.009% ( 33000, 50000 ] 2 0.001% 100.010% ** Level 2 read latency histogram (micros): Count: 983643 Average: 18.0193 StdDev: 257.08 Min: 1 Median: 2.2248 Max: 74903 Percentiles: P50: 2.22 P75: 3.07 P99: 12.58 P99.9: 2476.80 P99.99: 3267.83 ------------------------------------------------------ [ 0, 1 ] 7883 0.801% 0.801% ( 1, 2 ] 414642 42.154% 42.955% ######## ( 2, 3 ] 308258 31.338% 74.294% ###### ( 3, 4 ] 101654 10.334% 84.628% ## ( 4, 6 ] 110751 11.259% 95.887% ## ( 6, 10 ] 27636 2.810% 98.697% # ( 10, 15 ] 5773 0.587% 99.284% ( 15, 22 ] 789 0.080% 99.364% ( 22, 34 ] 81 0.008% 99.372% ( 34, 51 ] 69 0.007% 99.379% ( 51, 76 ] 60 0.006% 99.385% ( 76, 110 ] 25 0.003% 99.388% ( 110, 170 ] 36 0.004% 99.391% ( 170, 250 ] 68 0.007% 99.398% ( 250, 380 ] 203 0.021% 99.419% ( 380, 580 ] 423 0.043% 99.462% ( 580, 870 ] 825 0.084% 99.546% ( 870, 1300 ] 1280 0.130% 99.676% ( 1300, 1900 ] 1337 0.136% 99.812% ( 1900, 2900 ] 1502 0.153% 99.965% ( 2900, 4400 ] 1018 0.103% 100.068% ( 4400, 6600 ] 341 0.035% 100.103% ( 6600, 9900 ] 76 0.008% 100.111% ( 9900, 14000 ] 19 0.002% 100.112% ( 14000, 22000 ] 13 0.001% 100.114% ( 22000, 33000 ] 5 0.001% 100.114% ( 33000, 50000 ] 4 0.000% 100.115% ( 50000, 75000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 2120424 Average: 13.8685 StdDev: 233.47 Min: 1 Median: 2.2174 Max: 60810 Percentiles: P50: 2.22 P75: 3.01 P99: 9.89 P99.9: 1302.04 P99.99: 2050.36 ------------------------------------------------------ [ 0, 1 ] 16048 0.757% 0.757% ( 1, 2 ] 897725 42.337% 43.094% ######## ( 2, 3 ] 673634 31.769% 74.863% ###### ( 3, 4 ] 223078 10.520% 85.383% ## ( 4, 6 ] 237769 11.213% 96.596% ## ( 6, 10 ] 52422 2.472% 99.069% ( 10, 15 ] 9868 0.465% 99.534% ( 15, 22 ] 1112 0.052% 99.586% ( 22, 34 ] 96 0.005% 99.591% ( 34, 51 ] 131 0.006% 99.597% ( 51, 76 ] 228 0.011% 99.608% ( 76, 110 ] 50 0.002% 99.610% ( 110, 170 ] 148 0.007% 99.617% ( 170, 250 ] 293 0.014% 99.631% ( 250, 380 ] 578 0.027% 99.658% ( 380, 580 ] 1247 0.059% 99.717% ( 580, 870 ] 1857 0.088% 99.805% ( 870, 1300 ] 2014 0.095% 99.900% ( 1300, 1900 ] 1643 0.077% 99.977% ( 1900, 2900 ] 1802 0.085% 100.062% ( 2900, 4400 ] 1698 0.080% 100.142% ( 4400, 6600 ] 451 0.021% 100.164% ( 6600, 9900 ] 119 0.006% 100.169% ( 9900, 14000 ] 45 0.002% 100.171% ( 14000, 22000 ] 50 0.002% 100.174% ( 22000, 33000 ] 30 0.001% 100.175% ( 33000, 50000 ] 5 0.000% 100.175% ( 50000, 75000 ] 3 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 714825 Average: 30.8035 StdDev: 348.55 Min: 1 Median: 2.1740 Max: 60180 Percentiles: P50: 2.17 P75: 3.02 P99: 815.11 P99.9: 3701.14 P99.99: 4658.43 ------------------------------------------------------ [ 0, 1 ] 6871 0.961% 0.961% ( 1, 2 ] 313121 43.804% 44.765% ######### ( 2, 3 ] 215002 30.078% 74.843% ###### ( 3, 4 ] 72006 10.073% 84.916% ## ( 4, 6 ] 74483 10.420% 95.336% ## ( 6, 10 ] 17369 2.430% 97.765% ( 10, 15 ] 2954 0.413% 98.179% ( 15, 22 ] 331 0.046% 98.225% ( 22, 34 ] 30 0.004% 98.229% ( 34, 51 ] 45 0.006% 98.236% ( 51, 76 ] 54 0.008% 98.243% ( 76, 110 ] 68 0.010% 98.253% ( 110, 170 ] 491 0.069% 98.321% ( 170, 250 ] 725 0.101% 98.423% ( 250, 380 ] 891 0.125% 98.547% ( 380, 580 ] 1440 0.201% 98.749% ( 580, 870 ] 2215 0.310% 99.059% ( 870, 1300 ] 2282 0.319% 99.378% ( 1300, 1900 ] 1590 0.222% 99.600% ( 1900, 2900 ] 1458 0.204% 99.804% ( 2900, 4400 ] 1281 0.179% 99.983% ( 4400, 6600 ] 396 0.055% 100.039% ( 6600, 9900 ] 92 0.013% 100.052% ( 9900, 14000 ] 17 0.002% 100.054% ( 14000, 22000 ] 22 0.003% 100.057% ( 22000, 33000 ] 24 0.003% 100.061% ( 33000, 50000 ] 5 0.001% 100.061% ( 50000, 75000 ] 2 0.000% 100.062% ** Level 5 read latency histogram (micros): Count: 44153 Average: 1371.6564 StdDev: 1960.52 Min: 86 Median: 831.7998 Max: 100499 Percentiles: P50: 831.80 P75: 1706.80 P99: 6523.31 P99.9: 25094.77 P99.99: 57923.50 ------------------------------------------------------ ( 76, 110 ] 282 0.639% 0.639% ( 110, 170 ] 2704 6.124% 6.763% # ( 170, 250 ] 3346 7.578% 14.341% ## ( 250, 380 ] 3641 8.246% 22.587% ## ( 380, 580 ] 5680 12.864% 35.452% ### ( 580, 870 ] 7398 16.755% 52.207% ### ( 870, 1300 ] 6987 15.825% 68.032% ### ( 1300, 1900 ] 4538 10.278% 78.310% ## ( 1900, 2900 ] 3844 8.706% 87.016% ## ( 2900, 4400 ] 3754 8.502% 95.518% ## ( 4400, 6600 ] 1593 3.608% 99.126% # ( 6600, 9900 ] 255 0.578% 99.703% ( 9900, 14000 ] 38 0.086% 99.789% ( 14000, 22000 ] 39 0.088% 99.878% ( 22000, 33000 ] 35 0.079% 99.957% ( 33000, 50000 ] 13 0.029% 99.986% ( 50000, 75000 ] 5 0.011% 99.998% ( 75000, 110000 ] 2 0.005% 100.002% ** DB Stats ** Uptime(secs): 20.8 total, 6.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 142.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.036 H:M:S, 43.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 152.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.543 H:M:S, 39.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/13-06:05:13 ... thread 0: (1000000,4000000) ops and (285798.7,165942.2) ops/second in (3.498966,24.104776) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.21 GB 201.4 2.8 0.0 2.8 6.6 3.7 0.0 1.8 78.1 181.6 37.11 22.95 61 0.608 2942K 3240 0.0 0.0 L1 13/0 920.29 MB 92.0 2.7 1.7 1.0 2.7 1.7 0.0 1.6 137.2 136.7 20.25 13.43 4 5.063 2821K 9769 0.0 0.0 L2 1/1 128.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/3 1.19 GB 1.0 8.8 5.1 3.6 8.8 5.1 0.0 1.7 111.0 110.4 81.16 43.52 30 2.705 5040K 10K 0.0 0.0 L4 177/0 9.66 GB 1.0 7.8 5.1 2.8 7.8 5.0 0.4 1.5 112.3 111.1 71.52 39.95 52 1.375 5775K 3042 0.0 0.0 L5 1140/0 94.12 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/8 108.20 GB 0.0 22.2 11.9 10.3 25.8 15.5 6.7 6.9 108.2 125.8 210.04 119.84 147 1.429 16M 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.2 11.9 10.3 25.8 15.5 6.7 6.9 108.2 125.8 210.04 119.84 147 1.429 16M 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.2 11.9 10.3 22.0 11.8 0.0 0.0 121.6 120.8 186.82 108.64 96 1.946 16M 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 165.4 23.23 11.20 51 0.455 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.3 total, 24.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.80 GB write, 1088.77 MB/s write, 22.18 GB read, 936.36 MB/s read, 210.0 seconds Interval compaction: 25.80 GB write, 1095.74 MB/s write, 22.18 GB read, 942.35 MB/s read, 210.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 79, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1189009 Average: 8.4813 StdDev: 160.04 Min: 1 Median: 1.8515 Max: 63173 Percentiles: P50: 1.85 P75: 2.71 P99: 9.91 P99.9: 1184.92 P99.99: 3006.93 ------------------------------------------------------ [ 0, 1 ] 59144 4.974% 4.974% # ( 1, 2 ] 628731 52.879% 57.853% ########### ( 2, 3 ] 287714 24.198% 82.051% ##### ( 3, 4 ] 91075 7.660% 89.710% ## ( 4, 6 ] 92616 7.789% 97.500% ## ( 6, 10 ] 18261 1.536% 99.035% ( 10, 15 ] 3181 0.268% 99.303% ( 15, 22 ] 367 0.031% 99.334% ( 22, 34 ] 28 0.002% 99.336% ( 34, 51 ] 26 0.002% 99.338% ( 51, 76 ] 35 0.003% 99.341% ( 76, 110 ] 136 0.011% 99.353% ( 110, 170 ] 1322 0.111% 99.464% ( 170, 250 ] 1419 0.119% 99.583% ( 250, 380 ] 1056 0.089% 99.672% ( 380, 580 ] 1159 0.097% 99.770% ( 580, 870 ] 978 0.082% 99.852% ( 870, 1300 ] 781 0.066% 99.918% ( 1300, 1900 ] 439 0.037% 99.954% ( 1900, 2900 ] 400 0.034% 99.988% ( 2900, 4400 ] 310 0.026% 100.014% ( 4400, 6600 ] 73 0.006% 100.020% ( 6600, 9900 ] 24 0.002% 100.022% ( 9900, 14000 ] 8 0.001% 100.023% ( 14000, 22000 ] 14 0.001% 100.024% ( 22000, 33000 ] 7 0.001% 100.025% ( 33000, 50000 ] 3 0.000% 100.025% ( 50000, 75000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 484064 Average: 11.4087 StdDev: 175.10 Min: 1 Median: 2.0501 Max: 36660 Percentiles: P50: 2.05 P75: 2.90 P99: 11.36 P99.9: 2245.55 P99.99: 4283.61 ------------------------------------------------------ [ 0, 1 ] 7285 1.505% 1.505% ( 1, 2 ] 227617 47.022% 48.527% ######### ( 2, 3 ] 142428 29.423% 77.950% ###### ( 3, 4 ] 43421 8.970% 86.921% ## ( 4, 6 ] 46052 9.514% 96.434% ## ( 6, 10 ] 11898 2.458% 98.892% ( 10, 15 ] 1922 0.397% 99.289% ( 15, 22 ] 256 0.053% 99.342% ( 22, 34 ] 10 0.002% 99.344% ( 34, 51 ] 18 0.004% 99.348% ( 51, 76 ] 20 0.004% 99.352% ( 76, 110 ] 38 0.008% 99.360% ( 110, 170 ] 268 0.055% 99.415% ( 170, 250 ] 331 0.068% 99.484% ( 250, 380 ] 297 0.061% 99.545% ( 380, 580 ] 386 0.080% 99.625% ( 580, 870 ] 465 0.096% 99.721% ( 870, 1300 ] 458 0.095% 99.815% ( 1300, 1900 ] 308 0.064% 99.879% ( 1900, 2900 ] 295 0.061% 99.940% ( 2900, 4400 ] 263 0.054% 99.994% ( 4400, 6600 ] 79 0.016% 100.011% ( 6600, 9900 ] 25 0.005% 100.016% ( 9900, 14000 ] 1 0.000% 100.016% ( 14000, 22000 ] 3 0.001% 100.017% ( 22000, 33000 ] 2 0.000% 100.017% ( 33000, 50000 ] 2 0.000% 100.017% ** Level 2 read latency histogram (micros): Count: 983643 Average: 18.0193 StdDev: 257.08 Min: 1 Median: 2.2248 Max: 74903 Percentiles: P50: 2.22 P75: 3.07 P99: 12.58 P99.9: 2476.80 P99.99: 3267.83 ------------------------------------------------------ [ 0, 1 ] 7883 0.801% 0.801% ( 1, 2 ] 414642 42.154% 42.955% ######## ( 2, 3 ] 308258 31.338% 74.294% ###### ( 3, 4 ] 101654 10.334% 84.628% ## ( 4, 6 ] 110751 11.259% 95.887% ## ( 6, 10 ] 27636 2.810% 98.697% # ( 10, 15 ] 5773 0.587% 99.284% ( 15, 22 ] 789 0.080% 99.364% ( 22, 34 ] 81 0.008% 99.372% ( 34, 51 ] 69 0.007% 99.379% ( 51, 76 ] 60 0.006% 99.385% ( 76, 110 ] 25 0.003% 99.388% ( 110, 170 ] 36 0.004% 99.391% ( 170, 250 ] 68 0.007% 99.398% ( 250, 380 ] 203 0.021% 99.419% ( 380, 580 ] 423 0.043% 99.462% ( 580, 870 ] 825 0.084% 99.546% ( 870, 1300 ] 1280 0.130% 99.676% ( 1300, 1900 ] 1337 0.136% 99.812% ( 1900, 2900 ] 1502 0.153% 99.965% ( 2900, 4400 ] 1018 0.103% 100.068% ( 4400, 6600 ] 341 0.035% 100.103% ( 6600, 9900 ] 76 0.008% 100.111% ( 9900, 14000 ] 19 0.002% 100.112% ( 14000, 22000 ] 13 0.001% 100.114% ( 22000, 33000 ] 5 0.001% 100.114% ( 33000, 50000 ] 4 0.000% 100.115% ( 50000, 75000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 2244978 Average: 13.4173 StdDev: 227.11 Min: 1 Median: 2.1985 Max: 60810 Percentiles: P50: 2.20 P75: 2.99 P99: 9.91 P99.9: 1266.11 P99.99: 2015.02 ------------------------------------------------------ [ 0, 1 ] 17900 0.797% 0.797% ( 1, 2 ] 963726 42.928% 43.725% ######### ( 2, 3 ] 709636 31.610% 75.335% ###### ( 3, 4 ] 231520 10.313% 85.648% ## ( 4, 6 ] 245968 10.956% 96.605% ## ( 6, 10 ] 55043 2.452% 99.056% ( 10, 15 ] 10189 0.454% 99.510% ( 15, 22 ] 1153 0.051% 99.562% ( 22, 34 ] 99 0.004% 99.566% ( 34, 51 ] 132 0.006% 99.572% ( 51, 76 ] 228 0.010% 99.582% ( 76, 110 ] 75 0.003% 99.585% ( 110, 170 ] 416 0.019% 99.604% ( 170, 250 ] 610 0.027% 99.631% ( 250, 380 ] 784 0.035% 99.666% ( 380, 580 ] 1424 0.063% 99.729% ( 580, 870 ] 1937 0.086% 99.816% ( 870, 1300 ] 2055 0.092% 99.907% ( 1300, 1900 ] 1651 0.074% 99.981% ( 1900, 2900 ] 1804 0.080% 100.061% ( 2900, 4400 ] 1700 0.076% 100.137% ( 4400, 6600 ] 451 0.020% 100.157% ( 6600, 9900 ] 119 0.005% 100.162% ( 9900, 14000 ] 45 0.002% 100.164% ( 14000, 22000 ] 50 0.002% 100.166% ( 22000, 33000 ] 30 0.001% 100.168% ( 33000, 50000 ] 5 0.000% 100.168% ( 50000, 75000 ] 3 0.000% 100.168% ** Level 4 read latency histogram (micros): Count: 720442 Average: 32.7497 StdDev: 348.60 Min: 1 Median: 2.1868 Max: 60180 Percentiles: P50: 2.19 P75: 3.07 P99: 832.72 P99.9: 3697.38 P99.99: 4660.21 ------------------------------------------------------ [ 0, 1 ] 6871 0.954% 0.954% ( 1, 2 ] 313166 43.469% 44.422% ######### ( 2, 3 ] 215172 29.867% 74.289% ###### ( 3, 4 ] 72102 10.008% 84.297% ## ( 4, 6 ] 74606 10.356% 94.653% ## ( 6, 10 ] 17395 2.414% 97.067% ( 10, 15 ] 2960 0.411% 97.478% ( 15, 22 ] 332 0.046% 97.524% ( 22, 34 ] 30 0.004% 97.528% ( 34, 51 ] 45 0.006% 97.534% ( 51, 76 ] 54 0.007% 97.542% ( 76, 110 ] 240 0.033% 97.575% ( 110, 170 ] 1896 0.263% 97.838% ( 170, 250 ] 2139 0.297% 98.135% ( 250, 380 ] 1762 0.245% 98.380% ( 380, 580 ] 2221 0.308% 98.688% ( 580, 870 ] 2578 0.358% 99.046% ( 870, 1300 ] 2395 0.332% 99.378% ( 1300, 1900 ] 1605 0.223% 99.601% ( 1900, 2900 ] 1470 0.204% 99.805% ( 2900, 4400 ] 1284 0.178% 99.983% ( 4400, 6600 ] 397 0.055% 100.039% ( 6600, 9900 ] 92 0.013% 100.051% ( 9900, 14000 ] 17 0.002% 100.054% ( 14000, 22000 ] 22 0.003% 100.057% ( 22000, 33000 ] 24 0.003% 100.060% ( 33000, 50000 ] 5 0.001% 100.061% ( 50000, 75000 ] 2 0.000% 100.061% ** Level 5 read latency histogram (micros): Count: 75486 Average: 927.5597 StdDev: 1597.41 Min: 81 Median: 456.9479 Max: 100499 Percentiles: P50: 456.95 P75: 1043.36 P99: 6090.91 P99.9: 17592.62 P99.99: 47974.91 ------------------------------------------------------ ( 76, 110 ] 1362 1.804% 1.804% ( 110, 170 ] 11462 15.184% 16.989% ### ( 170, 250 ] 12129 16.068% 33.056% ### ( 250, 380 ] 8968 11.880% 44.937% ## ( 380, 580 ] 9934 13.160% 58.097% ### ( 580, 870 ] 9687 12.833% 70.930% ### ( 870, 1300 ] 7621 10.096% 81.026% ## ( 1300, 1900 ] 4651 6.161% 87.187% # ( 1900, 2900 ] 3914 5.185% 92.372% # ( 2900, 4400 ] 3778 5.005% 97.377% # ( 4400, 6600 ] 1594 2.112% 99.489% ( 6600, 9900 ] 255 0.338% 99.826% ( 9900, 14000 ] 38 0.050% 99.877% ( 14000, 22000 ] 39 0.052% 99.928% ( 22000, 33000 ] 35 0.046% 99.975% ( 33000, 50000 ] 13 0.017% 99.992% ( 50000, 75000 ] 5 0.007% 99.999% ( 75000, 110000 ] 2 0.003% 100.001% ** DB Stats ** Uptime(secs): 24.3 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 162.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.036 H:M:S, 37.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 281.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/13-06:05:17 ... thread 0: (1000000,5000000) ops and (281134.4,180754.7) ops/second in (3.557017,27.661793) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.20 GB 276.9 3.6 0.0 3.6 8.3 4.7 0.0 1.8 84.3 196.1 43.34 28.59 80 0.542 3709K 3958 0.0 0.0 L1 13/0 920.29 MB 92.0 2.7 1.7 1.0 2.7 1.7 0.0 1.6 137.2 136.7 20.25 13.43 4 5.063 2821K 9769 0.0 0.0 L3 19/0 965.01 MB 1.0 9.2 5.3 3.9 9.1 5.2 0.0 1.7 113.1 112.6 82.86 45.13 31 2.673 5412K 12K 0.0 0.0 L4 178/0 9.70 GB 1.0 8.7 5.4 3.3 8.6 5.3 0.5 1.6 117.3 116.0 76.02 44.00 56 1.357 6422K 3042 0.0 0.0 L5 1144/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1373/8 109.17 GB 0.0 24.1 12.3 11.8 28.7 16.9 6.2 6.1 111.1 132.2 222.48 131.15 171 1.301 18M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.1 12.3 11.8 28.7 16.9 6.2 6.1 111.1 132.2 222.48 131.15 171 1.301 18M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.1 12.3 11.8 24.0 12.2 0.0 0.0 126.2 125.3 195.98 117.21 104 1.884 18M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 183.0 26.50 13.94 67 0.396 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.8 total, 27.7 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.72 GB write, 1057.26 MB/s write, 24.15 GB read, 888.84 MB/s read, 222.5 seconds Interval compaction: 28.72 GB write, 1063.15 MB/s write, 24.15 GB read, 893.79 MB/s read, 222.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 79, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1445537 Average: 8.0738 StdDev: 146.62 Min: 1 Median: 1.7991 Max: 63173 Percentiles: P50: 1.80 P75: 2.62 P99: 11.17 P99.9: 1060.20 P99.99: 2814.19 ------------------------------------------------------ [ 0, 1 ] 94518 6.539% 6.539% # ( 1, 2 ] 786196 54.388% 60.926% ########### ( 2, 3 ] 327095 22.628% 83.554% ##### ( 3, 4 ] 101839 7.045% 90.599% # ( 4, 6 ] 101248 7.004% 97.604% # ( 6, 10 ] 19402 1.342% 98.946% ( 10, 15 ] 3362 0.233% 99.178% ( 15, 22 ] 388 0.027% 99.205% ( 22, 34 ] 30 0.002% 99.207% ( 34, 51 ] 27 0.002% 99.209% ( 51, 76 ] 35 0.002% 99.212% ( 76, 110 ] 268 0.019% 99.230% ( 110, 170 ] 2635 0.182% 99.412% ( 170, 250 ] 2456 0.170% 99.582% ( 250, 380 ] 1516 0.105% 99.687% ( 380, 580 ] 1550 0.107% 99.794% ( 580, 870 ] 1158 0.080% 99.875% ( 870, 1300 ] 833 0.058% 99.932% ( 1300, 1900 ] 447 0.031% 99.963% ( 1900, 2900 ] 426 0.029% 99.993% ( 2900, 4400 ] 319 0.022% 100.015% ( 4400, 6600 ] 73 0.005% 100.020% ( 6600, 9900 ] 24 0.002% 100.021% ( 9900, 14000 ] 8 0.001% 100.022% ( 14000, 22000 ] 14 0.001% 100.023% ( 22000, 33000 ] 7 0.000% 100.023% ( 33000, 50000 ] 3 0.000% 100.024% ( 50000, 75000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 495059 Average: 11.4794 StdDev: 173.53 Min: 1 Median: 2.0348 Max: 36660 Percentiles: P50: 2.03 P75: 2.89 P99: 12.40 P99.9: 2215.24 P99.99: 4277.34 ------------------------------------------------------ [ 0, 1 ] 8054 1.627% 1.627% ( 1, 2 ] 234444 47.357% 48.984% ######### ( 2, 3 ] 144544 29.197% 78.181% ###### ( 3, 4 ] 43740 8.835% 87.016% ## ( 4, 6 ] 46309 9.354% 96.371% ## ( 6, 10 ] 12088 2.442% 98.812% ( 10, 15 ] 1933 0.390% 99.203% ( 15, 22 ] 261 0.053% 99.255% ( 22, 34 ] 10 0.002% 99.257% ( 34, 51 ] 18 0.004% 99.261% ( 51, 76 ] 20 0.004% 99.265% ( 76, 110 ] 58 0.012% 99.277% ( 110, 170 ] 463 0.094% 99.370% ( 170, 250 ] 457 0.092% 99.463% ( 250, 380 ] 372 0.075% 99.538% ( 380, 580 ] 439 0.089% 99.627% ( 580, 870 ] 482 0.097% 99.724% ( 870, 1300 ] 468 0.095% 99.818% ( 1300, 1900 ] 310 0.063% 99.881% ( 1900, 2900 ] 298 0.060% 99.941% ( 2900, 4400 ] 263 0.053% 99.994% ( 4400, 6600 ] 79 0.016% 100.010% ( 6600, 9900 ] 25 0.005% 100.015% ( 9900, 14000 ] 1 0.000% 100.016% ( 14000, 22000 ] 3 0.001% 100.016% ( 22000, 33000 ] 2 0.000% 100.017% ( 33000, 50000 ] 2 0.000% 100.017% ** Level 2 read latency histogram (micros): Count: 983643 Average: 18.0193 StdDev: 257.08 Min: 1 Median: 2.2248 Max: 74903 Percentiles: P50: 2.22 P75: 3.07 P99: 12.58 P99.9: 2476.80 P99.99: 3267.83 ------------------------------------------------------ [ 0, 1 ] 7883 0.801% 0.801% ( 1, 2 ] 414642 42.154% 42.955% ######## ( 2, 3 ] 308258 31.338% 74.294% ###### ( 3, 4 ] 101654 10.334% 84.628% ## ( 4, 6 ] 110751 11.259% 95.887% ## ( 6, 10 ] 27636 2.810% 98.697% # ( 10, 15 ] 5773 0.587% 99.284% ( 15, 22 ] 789 0.080% 99.364% ( 22, 34 ] 81 0.008% 99.372% ( 34, 51 ] 69 0.007% 99.379% ( 51, 76 ] 60 0.006% 99.385% ( 76, 110 ] 25 0.003% 99.388% ( 110, 170 ] 36 0.004% 99.391% ( 170, 250 ] 68 0.007% 99.398% ( 250, 380 ] 203 0.021% 99.419% ( 380, 580 ] 423 0.043% 99.462% ( 580, 870 ] 825 0.084% 99.546% ( 870, 1300 ] 1280 0.130% 99.676% ( 1300, 1900 ] 1337 0.136% 99.812% ( 1900, 2900 ] 1502 0.153% 99.965% ( 2900, 4400 ] 1018 0.103% 100.068% ( 4400, 6600 ] 341 0.035% 100.103% ( 6600, 9900 ] 76 0.008% 100.111% ( 9900, 14000 ] 19 0.002% 100.112% ( 14000, 22000 ] 13 0.001% 100.114% ( 22000, 33000 ] 5 0.001% 100.114% ( 33000, 50000 ] 4 0.000% 100.115% ( 50000, 75000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 2366036 Average: 12.9142 StdDev: 221.30 Min: 1 Median: 2.1740 Max: 60810 Percentiles: P50: 2.17 P75: 2.97 P99: 9.86 P99.9: 1236.57 P99.99: 1994.85 ------------------------------------------------------ [ 0, 1 ] 21516 0.909% 0.909% ( 1, 2 ] 1032371 43.633% 44.542% ######### ( 2, 3 ] 742120 31.366% 75.908% ###### ( 3, 4 ] 238950 10.099% 86.007% ## ( 4, 6 ] 253063 10.696% 96.703% ## ( 6, 10 ] 56282 2.379% 99.081% ( 10, 15 ] 10355 0.438% 99.519% ( 15, 22 ] 1165 0.049% 99.568% ( 22, 34 ] 99 0.004% 99.572% ( 34, 51 ] 132 0.006% 99.578% ( 51, 76 ] 230 0.010% 99.588% ( 76, 110 ] 98 0.004% 99.592% ( 110, 170 ] 544 0.023% 99.615% ( 170, 250 ] 718 0.030% 99.645% ( 250, 380 ] 837 0.035% 99.681% ( 380, 580 ] 1467 0.062% 99.743% ( 580, 870 ] 1966 0.083% 99.826% ( 870, 1300 ] 2061 0.087% 99.913% ( 1300, 1900 ] 1654 0.070% 99.983% ( 1900, 2900 ] 1807 0.076% 100.059% ( 2900, 4400 ] 1700 0.072% 100.131% ( 4400, 6600 ] 451 0.019% 100.150% ( 6600, 9900 ] 119 0.005% 100.155% ( 9900, 14000 ] 45 0.002% 100.157% ( 14000, 22000 ] 50 0.002% 100.159% ( 22000, 33000 ] 30 0.001% 100.160% ( 33000, 50000 ] 5 0.000% 100.161% ( 50000, 75000 ] 3 0.000% 100.161% ** Level 4 read latency histogram (micros): Count: 870272 Average: 29.7988 StdDev: 319.11 Min: 1 Median: 2.1682 Max: 60180 Percentiles: P50: 2.17 P75: 3.03 P99: 687.57 P99.9: 3310.67 P99.99: 4220.01 ------------------------------------------------------ [ 0, 1 ] 8647 0.994% 0.994% ( 1, 2 ] 383017 44.011% 45.005% ######### ( 2, 3 ] 258448 29.697% 74.702% ###### ( 3, 4 ] 83932 9.644% 84.347% ## ( 4, 6 ] 87078 10.006% 94.352% ## ( 6, 10 ] 20982 2.411% 96.763% ( 10, 15 ] 3425 0.394% 97.157% ( 15, 22 ] 376 0.043% 97.200% ( 22, 34 ] 33 0.004% 97.204% ( 34, 51 ] 50 0.006% 97.210% ( 51, 76 ] 55 0.006% 97.216% ( 76, 110 ] 543 0.062% 97.278% ( 110, 170 ] 4162 0.478% 97.757% ( 170, 250 ] 3907 0.449% 98.206% ( 250, 380 ] 2762 0.317% 98.523% ( 380, 580 ] 3058 0.351% 98.874% ( 580, 870 ] 2950 0.339% 99.213% ( 870, 1300 ] 2483 0.285% 99.499% ( 1300, 1900 ] 1629 0.187% 99.686% ( 1900, 2900 ] 1511 0.174% 99.859% ( 2900, 4400 ] 1292 0.148% 100.008% ( 4400, 6600 ] 397 0.046% 100.053% ( 6600, 9900 ] 92 0.011% 100.064% ( 9900, 14000 ] 17 0.002% 100.066% ( 14000, 22000 ] 22 0.003% 100.068% ( 22000, 33000 ] 24 0.003% 100.071% ( 33000, 50000 ] 5 0.001% 100.072% ( 50000, 75000 ] 2 0.000% 100.072% ** Level 5 read latency histogram (micros): Count: 109513 Average: 725.0514 StdDev: 1369.55 Min: 81 Median: 311.8581 Max: 100499 Percentiles: P50: 311.86 P75: 752.48 P99: 5622.50 P99.9: 12218.33 P99.99: 43525.22 ------------------------------------------------------ ( 76, 110 ] 3135 2.863% 2.863% # ( 110, 170 ] 24027 21.940% 24.803% #### ( 170, 250 ] 21186 19.346% 44.148% #### ( 250, 380 ] 13468 12.298% 56.446% ## ( 380, 580 ] 13599 12.418% 68.864% ## ( 580, 870 ] 11298 10.317% 79.181% ## ( 870, 1300 ] 8114 7.409% 86.590% # ( 1300, 1900 ] 4737 4.326% 90.915% # ( 1900, 2900 ] 4133 3.774% 94.689% # ( 2900, 4400 ] 3834 3.501% 98.190% # ( 4400, 6600 ] 1596 1.457% 99.648% ( 6600, 9900 ] 255 0.233% 99.880% ( 9900, 14000 ] 38 0.035% 99.915% ( 14000, 22000 ] 39 0.036% 99.951% ( 22000, 33000 ] 35 0.032% 99.983% ( 33000, 50000 ] 13 0.012% 99.995% ( 50000, 75000 ] 5 0.005% 99.999% ( 75000, 110000 ] 2 0.002% 100.001% ** DB Stats ** Uptime(secs): 27.8 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 176.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.036 H:M:S, 32.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 276.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/13-06:05:34 ... thread 0: (1000000,6000000) ops and (59163.6,134637.6) ops/second in (16.902276,44.564069) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 4.12 GB 50.3 4.8 0.0 4.8 10.5 5.7 0.0 1.8 95.8 208.8 51.27 35.93 100 0.513 4989K 5186 0.0 0.0 L1 13/13 920.29 MB 0.0 2.7 1.7 1.0 2.7 1.7 0.0 1.6 137.2 136.7 20.25 13.43 4 5.063 2821K 9769 0.0 0.0 L3 19/0 965.01 MB 1.0 9.2 5.3 3.9 9.1 5.2 0.0 1.7 113.1 112.6 82.86 45.13 31 2.673 5412K 12K 0.0 0.0 L4 178/0 9.70 GB 1.0 8.7 5.4 3.3 8.6 5.3 0.5 1.6 117.3 116.0 76.02 44.00 56 1.357 6422K 3042 0.0 0.0 L5 1144/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1373/30 110.09 GB 0.0 25.4 12.3 13.0 30.9 17.8 6.2 5.5 112.8 137.2 230.41 138.49 191 1.206 19M 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.4 12.3 13.0 30.9 17.8 6.2 5.5 112.8 137.2 230.41 138.49 191 1.206 19M 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.4 12.3 13.0 25.2 12.2 0.0 0.0 129.4 128.6 200.80 121.90 109 1.842 19M 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 195.7 29.61 16.59 82 0.361 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.7 total, 44.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.87 GB write, 706.93 MB/s write, 25.38 GB read, 581.07 MB/s read, 230.4 seconds Interval compaction: 30.87 GB write, 709.38 MB/s write, 25.38 GB read, 583.08 MB/s read, 230.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 79, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 79, interval: 89 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1907692 Average: 15.7805 StdDev: 134.58 Min: 1 Median: 1.8062 Max: 63173 Percentiles: P50: 1.81 P75: 2.77 P99: 227.63 P99.9: 836.70 P99.99: 2376.17 ------------------------------------------------------ [ 0, 1 ] 165172 8.658% 8.658% ## ( 1, 2 ] 978282 51.281% 59.939% ########## ( 2, 3 ] 372038 19.502% 79.441% #### ( 3, 4 ] 132731 6.958% 86.399% # ( 4, 6 ] 115088 6.033% 92.432% # ( 6, 10 ] 21402 1.122% 93.554% ( 10, 15 ] 3985 0.209% 93.762% ( 15, 22 ] 437 0.023% 93.785% ( 22, 34 ] 33 0.002% 93.787% ( 34, 51 ] 27 0.001% 93.788% ( 51, 76 ] 40 0.002% 93.791% ( 76, 110 ] 7903 0.414% 94.205% ( 110, 170 ] 68822 3.608% 97.812% # ( 170, 250 ] 31453 1.649% 99.461% ( 250, 380 ] 4111 0.215% 99.677% ( 380, 580 ] 2908 0.152% 99.829% ( 580, 870 ] 1530 0.080% 99.909% ( 870, 1300 ] 872 0.046% 99.955% ( 1300, 1900 ] 454 0.024% 99.979% ( 1900, 2900 ] 452 0.024% 100.003% ( 2900, 4400 ] 350 0.018% 100.021% ( 4400, 6600 ] 74 0.004% 100.025% ( 6600, 9900 ] 25 0.001% 100.026% ( 9900, 14000 ] 8 0.000% 100.026% ( 14000, 22000 ] 14 0.001% 100.027% ( 22000, 33000 ] 7 0.000% 100.028% ( 33000, 50000 ] 3 0.000% 100.028% ( 50000, 75000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 499546 Average: 12.8573 StdDev: 173.56 Min: 1 Median: 2.0503 Max: 36660 Percentiles: P50: 2.05 P75: 2.91 P99: 160.69 P99.9: 2206.89 P99.99: 4275.73 ------------------------------------------------------ [ 0, 1 ] 8054 1.612% 1.612% ( 1, 2 ] 234444 46.931% 48.544% ######### ( 2, 3 ] 144544 28.935% 77.479% ###### ( 3, 4 ] 43740 8.756% 86.235% ## ( 4, 6 ] 46309 9.270% 95.505% ## ( 6, 10 ] 12088 2.420% 97.925% ( 10, 15 ] 1933 0.387% 98.312% ( 15, 22 ] 261 0.052% 98.364% ( 22, 34 ] 10 0.002% 98.366% ( 34, 51 ] 18 0.004% 98.370% ( 51, 76 ] 20 0.004% 98.374% ( 76, 110 ] 362 0.072% 98.446% ( 110, 170 ] 3276 0.656% 99.102% ( 170, 250 ] 1622 0.325% 99.426% ( 250, 380 ] 486 0.097% 99.524% ( 380, 580 ] 509 0.102% 99.626% ( 580, 870 ] 499 0.100% 99.726% ( 870, 1300 ] 470 0.094% 99.820% ( 1300, 1900 ] 310 0.062% 99.882% ( 1900, 2900 ] 298 0.060% 99.941% ( 2900, 4400 ] 265 0.053% 99.994% ( 4400, 6600 ] 79 0.016% 100.010% ( 6600, 9900 ] 25 0.005% 100.015% ( 9900, 14000 ] 1 0.000% 100.015% ( 14000, 22000 ] 3 0.001% 100.016% ( 22000, 33000 ] 2 0.000% 100.016% ( 33000, 50000 ] 2 0.000% 100.017% ** Level 2 read latency histogram (micros): Count: 983643 Average: 18.0193 StdDev: 257.08 Min: 1 Median: 2.2248 Max: 74903 Percentiles: P50: 2.22 P75: 3.07 P99: 12.58 P99.9: 2476.80 P99.99: 3267.83 ------------------------------------------------------ [ 0, 1 ] 7883 0.801% 0.801% ( 1, 2 ] 414642 42.154% 42.955% ######## ( 2, 3 ] 308258 31.338% 74.294% ###### ( 3, 4 ] 101654 10.334% 84.628% ## ( 4, 6 ] 110751 11.259% 95.887% ## ( 6, 10 ] 27636 2.810% 98.697% # ( 10, 15 ] 5773 0.587% 99.284% ( 15, 22 ] 789 0.080% 99.364% ( 22, 34 ] 81 0.008% 99.372% ( 34, 51 ] 69 0.007% 99.379% ( 51, 76 ] 60 0.006% 99.385% ( 76, 110 ] 25 0.003% 99.388% ( 110, 170 ] 36 0.004% 99.391% ( 170, 250 ] 68 0.007% 99.398% ( 250, 380 ] 203 0.021% 99.419% ( 380, 580 ] 423 0.043% 99.462% ( 580, 870 ] 825 0.084% 99.546% ( 870, 1300 ] 1280 0.130% 99.676% ( 1300, 1900 ] 1337 0.136% 99.812% ( 1900, 2900 ] 1502 0.153% 99.965% ( 2900, 4400 ] 1018 0.103% 100.068% ( 4400, 6600 ] 341 0.035% 100.103% ( 6600, 9900 ] 76 0.008% 100.111% ( 9900, 14000 ] 19 0.002% 100.112% ( 14000, 22000 ] 13 0.001% 100.114% ( 22000, 33000 ] 5 0.001% 100.114% ( 33000, 50000 ] 4 0.000% 100.115% ( 50000, 75000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 2371848 Average: 13.2060 StdDev: 221.15 Min: 1 Median: 2.1777 Max: 60810 Percentiles: P50: 2.18 P75: 2.98 P99: 11.33 P99.9: 1235.39 P99.99: 1994.53 ------------------------------------------------------ [ 0, 1 ] 21518 0.907% 0.907% ( 1, 2 ] 1032484 43.531% 44.438% ######### ( 2, 3 ] 742489 31.304% 75.742% ###### ( 3, 4 ] 239231 10.086% 85.829% ## ( 4, 6 ] 253336 10.681% 96.509% ## ( 6, 10 ] 56319 2.374% 98.884% ( 10, 15 ] 10364 0.437% 99.321% ( 15, 22 ] 1166 0.049% 99.370% ( 22, 34 ] 99 0.004% 99.374% ( 34, 51 ] 132 0.006% 99.380% ( 51, 76 ] 230 0.010% 99.390% ( 76, 110 ] 416 0.018% 99.407% ( 110, 170 ] 3501 0.148% 99.555% ( 170, 250 ] 1997 0.084% 99.639% ( 250, 380 ] 942 0.040% 99.679% ( 380, 580 ] 1523 0.064% 99.743% ( 580, 870 ] 1977 0.083% 99.826% ( 870, 1300 ] 2062 0.087% 99.913% ( 1300, 1900 ] 1654 0.070% 99.983% ( 1900, 2900 ] 1807 0.076% 100.059% ( 2900, 4400 ] 1700 0.072% 100.131% ( 4400, 6600 ] 451 0.019% 100.150% ( 6600, 9900 ] 119 0.005% 100.155% ( 9900, 14000 ] 45 0.002% 100.157% ( 14000, 22000 ] 50 0.002% 100.159% ( 22000, 33000 ] 30 0.001% 100.160% ( 33000, 50000 ] 5 0.000% 100.160% ( 50000, 75000 ] 3 0.000% 100.160% ** Level 4 read latency histogram (micros): Count: 916950 Average: 36.1186 StdDev: 312.71 Min: 1 Median: 2.2560 Max: 60180 Percentiles: P50: 2.26 P75: 3.43 P99: 659.55 P99.9: 3258.85 P99.99: 4214.01 ------------------------------------------------------ [ 0, 1 ] 8647 0.943% 0.943% ( 1, 2 ] 383401 41.813% 42.756% ######## ( 2, 3 ] 259467 28.297% 71.052% ###### ( 3, 4 ] 84642 9.231% 80.283% ## ( 4, 6 ] 87822 9.578% 89.861% ## ( 6, 10 ] 21048 2.295% 92.156% ( 10, 15 ] 3450 0.376% 92.533% ( 15, 22 ] 378 0.041% 92.574% ( 22, 34 ] 33 0.004% 92.577% ( 34, 51 ] 50 0.005% 92.583% ( 51, 76 ] 55 0.006% 92.589% ( 76, 110 ] 3860 0.421% 93.010% ( 110, 170 ] 31215 3.404% 96.414% # ( 170, 250 ] 15320 1.671% 98.085% ( 250, 380 ] 3849 0.420% 98.504% ( 380, 580 ] 3680 0.401% 98.906% ( 580, 870 ] 3148 0.343% 99.249% ( 870, 1300 ] 2504 0.273% 99.522% ( 1300, 1900 ] 1635 0.178% 99.701% ( 1900, 2900 ] 1519 0.166% 99.866% ( 2900, 4400 ] 1296 0.141% 100.008% ( 4400, 6600 ] 397 0.043% 100.051% ( 6600, 9900 ] 92 0.010% 100.061% ( 9900, 14000 ] 17 0.002% 100.063% ( 14000, 22000 ] 22 0.002% 100.065% ( 22000, 33000 ] 24 0.003% 100.068% ( 33000, 50000 ] 5 0.001% 100.068% ( 50000, 75000 ] 2 0.000% 100.068% ** Level 5 read latency histogram (micros): Count: 361656 Average: 333.8896 StdDev: 799.40 Min: 78 Median: 162.8011 Max: 100499 Percentiles: P50: 162.80 P75: 233.36 P99: 3763.82 P99.9: 6915.04 P99.99: 27605.10 ------------------------------------------------------ ( 76, 110 ] 21615 5.977% 5.977% # ( 110, 170 ] 180920 50.025% 56.002% ########## ( 170, 250 ] 86748 23.986% 79.988% ##### ( 250, 380 ] 19771 5.467% 85.455% # ( 380, 580 ] 17267 4.774% 90.230% # ( 580, 870 ] 12280 3.395% 93.625% # ( 870, 1300 ] 8248 2.281% 95.906% ( 1300, 1900 ] 4790 1.324% 97.230% ( 1900, 2900 ] 4181 1.156% 98.386% ( 2900, 4400 ] 3854 1.066% 99.452% ( 4400, 6600 ] 1596 0.441% 99.893% ( 6600, 9900 ] 255 0.071% 99.964% ( 9900, 14000 ] 38 0.011% 99.974% ( 14000, 22000 ] 39 0.011% 99.985% ( 22000, 33000 ] 35 0.010% 99.995% ( 33000, 50000 ] 13 0.004% 99.998% ( 50000, 75000 ] 5 0.001% 100.000% ( 75000, 110000 ] 2 0.001% 100.000% ** DB Stats ** Uptime(secs): 44.7 total, 16.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 132.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.824 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.788 H:M:S, 75.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 323.413 micros/op 12349 ops/sec 60.163 seconds 742996 operations; 12.0 MB/s (182999 of 182999 found) Microseconds per read: Count: 742996 Average: 323.4166 StdDev: 1149.75 Min: 2 Median: 205.2543 Max: 181816 Percentiles: P50: 205.25 P75: 249.00 P99: 2557.67 P99.9: 18917.17 P99.99: 42845.13 ------------------------------------------------------ ( 1, 2 ] 1 0.000% 0.000% ( 2, 3 ] 26 0.003% 0.004% ( 3, 4 ] 51 0.007% 0.010% ( 4, 6 ] 79 0.011% 0.021% ( 6, 10 ] 337 0.045% 0.066% ( 10, 15 ] 2705 0.364% 0.431% ( 15, 22 ] 4314 0.581% 1.011% ( 22, 34 ] 6985 0.940% 1.951% ( 34, 51 ] 4248 0.572% 2.523% ( 51, 76 ] 627 0.084% 2.607% ( 76, 110 ] 2103 0.283% 2.890% ( 110, 170 ] 200342 26.964% 29.855% ##### ( 170, 250 ] 339658 45.715% 75.569% ######### ( 250, 380 ] 90177 12.137% 87.706% ## ( 380, 580 ] 45491 6.123% 93.829% # ( 580, 870 ] 19484 2.622% 96.451% # ( 870, 1300 ] 10816 1.456% 97.907% ( 1300, 1900 ] 5421 0.730% 98.636% ( 1900, 2900 ] 4107 0.553% 99.189% ( 2900, 4400 ] 3367 0.453% 99.642% ( 4400, 6600 ] 1052 0.142% 99.784% ( 6600, 9900 ] 234 0.031% 99.815% ( 9900, 14000 ] 183 0.025% 99.840% ( 14000, 22000 ] 724 0.097% 99.938% ( 22000, 33000 ] 337 0.045% 99.983% ( 33000, 50000 ] 91 0.012% 99.995% ( 50000, 75000 ] 29 0.004% 99.999% ( 75000, 110000 ] 3 0.000% 99.999% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 15344650 rocksdb.bloom.filter.full.positive COUNT : 892862 rocksdb.bloom.filter.full.true.positive COUNT : 742610 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 386 rocksdb.memtable.miss COUNT : 742610 rocksdb.l0.hit COUNT : 28455 rocksdb.l1.hit COUNT : 6210 rocksdb.l2andup.hit COUNT : 707945 rocksdb.compaction.key.drop.new COUNT : 185703 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6065762 rocksdb.number.keys.read COUNT : 742996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6259866384 rocksdb.bytes.read COUNT : 742996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1770 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36814356 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28272855616 rocksdb.compact.write.bytes COUNT : 28079268229 rocksdb.flush.write.bytes COUNT : 6209394114 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 1247 rocksdb.number.superversion_releases COUNT : 1220 rocksdb.number.superversion_cleanups COUNT : 311 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 388 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6159346688 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2414592 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31803115168 rocksdb.non.last.level.read.count COUNT : 7543478 rocksdb.block.checksum.compute.count COUNT : 7751695 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 204.327380 P95 : 708.186305 P99 : 2556.449963 P100 : 181813.000000 COUNT : 742996 SUM : 239586454 rocksdb.db.write.micros P50 : 1.561247 P95 : 4.342012 P99 : 8.604014 P100 : 1046115.000000 COUNT : 6065762 SUM : 52206326 rocksdb.compaction.times.micros P50 : 1441666.666667 P95 : 4703333.333333 P99 : 9651500.000000 P100 : 13033057.000000 COUNT : 109 SUM : 200796888 rocksdb.compaction.times.cpu_micros P50 : 909210.526316 P95 : 2750000.000000 P99 : 7125735.000000 P100 : 7125735.000000 COUNT : 109 SUM : 121897203 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1031.250000 P95 : 32266.666667 P99 : 216400.000000 P100 : 228136.000000 COUNT : 84 SUM : 910842 rocksdb.compaction.outfile.sync.micros P50 : 10544.285714 P95 : 179538.461538 P99 : 321716.666667 P100 : 674675.000000 COUNT : 369 SUM : 13818022 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 465.714286 P95 : 4059.090909 P99 : 6490.000000 P100 : 13980.000000 COUNT : 220 SUM : 261114 rocksdb.table.open.io.micros P50 : 11435.281385 P95 : 21645.951036 P99 : 31460.000000 P100 : 154456.000000 COUNT : 1770 SUM : 20059954 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.343356 P95 : 9.808054 P99 : 187.754252 P100 : 63178.000000 COUNT : 6846887 SUM : 116164020 rocksdb.read.block.get.micros P50 : 153.897863 P95 : 557.964505 P99 : 2397.312058 P100 : 100651.000000 COUNT : 903005 SUM : 206621772 rocksdb.write.raw.block.micros P50 : 0.523929 P95 : 0.995465 P99 : 3.336987 P100 : 73128.000000 COUNT : 8305434 SUM : 29078697 rocksdb.numfiles.in.singlecompaction P50 : 2.843750 P95 : 6.200000 P99 : 14.383333 P100 : 30.000000 COUNT : 137 SUM : 511 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.584025 P95 : 2020.851293 P99 : 2726.325431 P100 : 1045927.000000 COUNT : 130936 SUM : 36828317 rocksdb.sst.read.micros P50 : 2.266667 P95 : 169.287642 P99 : 531.556624 P100 : 100499.000000 COUNT : 7543492 SUM : 303922203 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 742996 SUM : 742996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6065762 SUM : 6259866384 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 232222.222222 P95 : 1044571.428571 P99 : 1305630.000000 P100 : 1305630.000000 COUNT : 84 SUM : 30019802 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 395 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0