[2024-11-17 02:33:58.688445] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 24.03.0 initialization... [2024-11-17 02:33:58.688708] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1707212 ] Set seed to 1731807238681698 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 02:33:58.812131] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 02:33:58.919440] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 02:33:58.919480] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1707212' to capture a snapshot of events at runtime. [2024-11-17 02:33:58.919490] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 02:33:58.919500] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 02:33:58.919508] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1707212 for offline analysis/debug. [2024-11-17 02:33:58.921099] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 02:34:07 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-02:34:12 ... thread 0: (1000000,1000000) ops and (189370.6,189370.6) ops/second in (5.280652,5.280652) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.88 GB 69.2 0.6 0.0 0.6 1.5 0.9 0.0 1.7 89.0 222.4 7.08 4.95 15 0.472 639K 767 0.0 0.0 L2 1/0 94.08 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 997.03 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.0 1.5 93.6 93.5 2.05 0.92 1 2.051 130K 0 0.0 0.0 L4 160/0 9.66 GB 1.0 2.0 1.1 0.9 2.0 1.1 0.1 1.8 97.7 97.4 20.86 9.61 9 2.317 632K 0 0.0 0.0 L5 1116/0 91.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/15 105.39 GB 0.0 2.8 1.2 1.6 3.7 2.2 4.8 4.0 95.4 126.6 29.98 15.48 25 1.199 1402K 767 0.0 0.0 Int 0/0 0.00 KB 0.0 2.8 1.2 1.6 3.7 2.2 4.8 4.0 95.4 126.6 29.98 15.48 25 1.199 1402K 767 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.8 1.2 1.6 2.8 1.2 0.0 0.0 112.6 112.3 25.39 12.94 12 2.116 1402K 767 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 205.7 4.59 2.54 13 0.353 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.5 total, 5.3 interval Flush(GB): cumulative 0.923, interval 0.923 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.71 GB write, 694.02 MB/s write, 2.79 GB read, 522.81 MB/s read, 30.0 seconds Interval compaction: 3.71 GB write, 718.74 MB/s write, 2.79 GB read, 541.44 MB/s read, 30.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 10, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 342153 Average: 11.8992 StdDev: 166.32 Min: 0 Median: 1.6791 Max: 21437 Percentiles: P50: 1.68 P75: 2.31 P99: 149.75 P99.9: 1694.26 P99.99: 2651.94 ------------------------------------------------------ [ 0, 1 ] 33114 9.678% 9.678% ## ( 1, 2 ] 203143 59.372% 69.050% ############ ( 2, 3 ] 65409 19.117% 88.167% #### ( 3, 4 ] 15777 4.611% 92.778% # ( 4, 6 ] 14590 4.264% 97.042% # ( 6, 10 ] 4703 1.375% 98.417% ( 10, 15 ] 1029 0.301% 98.718% ( 15, 22 ] 230 0.067% 98.785% ( 22, 34 ] 19 0.006% 98.790% ( 34, 51 ] 6 0.002% 98.792% ( 51, 76 ] 5 0.001% 98.794% ( 76, 110 ] 94 0.027% 98.821% ( 110, 170 ] 929 0.272% 99.093% ( 170, 250 ] 794 0.232% 99.325% ( 250, 380 ] 519 0.152% 99.476% ( 380, 580 ] 473 0.138% 99.614% ( 580, 870 ] 433 0.127% 99.741% ( 870, 1300 ] 353 0.103% 99.844% ( 1300, 1900 ] 295 0.086% 99.930% ( 1900, 2900 ] 275 0.080% 100.011% ( 2900, 4400 ] 104 0.030% 100.041% ( 4400, 6600 ] 25 0.007% 100.049% ( 6600, 9900 ] 2 0.001% 100.049% ( 9900, 14000 ] 9 0.003% 100.052% ( 14000, 22000 ] 9 0.003% 100.054% ** Level 2 read latency histogram (micros): Count: 32735 Average: 18.8517 StdDev: 263.21 Min: 1 Median: 1.9160 Max: 20411 Percentiles: P50: 1.92 P75: 2.85 P99: 14.69 P99.9: 3261.44 P99.99: 12878.65 ------------------------------------------------------ [ 0, 1 ] 976 2.982% 2.982% # ( 1, 2 ] 16803 51.330% 54.312% ########## ( 2, 3 ] 7952 24.292% 78.604% ##### ( 3, 4 ] 2816 8.602% 87.206% ## ( 4, 6 ] 2857 8.728% 95.934% ## ( 6, 10 ] 774 2.364% 98.298% ( 10, 15 ] 245 0.748% 99.047% ( 15, 22 ] 40 0.122% 99.169% ( 76, 110 ] 1 0.003% 99.172% ( 110, 170 ] 6 0.018% 99.190% ( 170, 250 ] 5 0.015% 99.206% ( 250, 380 ] 12 0.037% 99.242% ( 380, 580 ] 21 0.064% 99.307% ( 580, 870 ] 28 0.086% 99.392% ( 870, 1300 ] 40 0.122% 99.514% ( 1300, 1900 ] 50 0.153% 99.667% ( 1900, 2900 ] 70 0.214% 99.881% ( 2900, 4400 ] 26 0.079% 99.960% ( 4400, 6600 ] 7 0.021% 99.982% ( 6600, 9900 ] 2 0.006% 99.988% ( 9900, 14000 ] 1 0.003% 99.991% ( 14000, 22000 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 146478 Average: 20.9229 StdDev: 233.71 Min: 1 Median: 1.9458 Max: 18473 Percentiles: P50: 1.95 P75: 2.86 P99: 21.89 P99.9: 3008.57 P99.99: 4151.61 ------------------------------------------------------ [ 0, 1 ] 3873 2.644% 2.644% # ( 1, 2 ] 73338 50.068% 52.712% ########## ( 2, 3 ] 38010 25.949% 78.661% ##### ( 3, 4 ] 12177 8.313% 86.974% ## ( 4, 6 ] 12896 8.804% 95.778% ## ( 6, 10 ] 3597 2.456% 98.234% ( 10, 15 ] 940 0.642% 98.876% ( 15, 22 ] 185 0.126% 99.002% ( 22, 34 ] 12 0.008% 99.010% ( 34, 51 ] 4 0.003% 99.013% ( 76, 110 ] 9 0.006% 99.019% ( 110, 170 ] 49 0.033% 99.052% ( 170, 250 ] 82 0.056% 99.108% ( 250, 380 ] 82 0.056% 99.164% ( 380, 580 ] 106 0.072% 99.237% ( 580, 870 ] 142 0.097% 99.334% ( 870, 1300 ] 196 0.134% 99.467% ( 1300, 1900 ] 283 0.193% 99.661% ( 1900, 2900 ] 338 0.231% 99.891% ( 2900, 4400 ] 173 0.118% 100.010% ( 4400, 6600 ] 44 0.030% 100.040% ( 6600, 9900 ] 8 0.005% 100.045% ( 9900, 14000 ] 5 0.003% 100.048% ( 14000, 22000 ] 2 0.001% 100.050% ** Level 4 read latency histogram (micros): Count: 158916 Average: 40.1875 StdDev: 304.44 Min: 1 Median: 1.9861 Max: 8798 Percentiles: P50: 1.99 P75: 2.91 P99: 1305.33 P99.9: 3048.73 P99.99: 3622.36 ------------------------------------------------------ [ 0, 1 ] 4276 2.691% 2.691% # ( 1, 2 ] 76238 47.974% 50.665% ########## ( 2, 3 ] 42296 26.615% 77.280% ##### ( 3, 4 ] 13833 8.705% 85.984% ## ( 4, 6 ] 13316 8.379% 94.364% ## ( 6, 10 ] 3905 2.457% 96.821% ( 10, 15 ] 948 0.597% 97.418% ( 15, 22 ] 160 0.101% 97.518% ( 22, 34 ] 14 0.009% 97.527% ( 34, 51 ] 2 0.001% 97.528% ( 51, 76 ] 4 0.003% 97.531% ( 76, 110 ] 53 0.033% 97.564% ( 110, 170 ] 441 0.278% 97.842% ( 170, 250 ] 360 0.227% 98.068% ( 250, 380 ] 280 0.176% 98.244% ( 380, 580 ] 283 0.178% 98.422% ( 580, 870 ] 368 0.232% 98.654% ( 870, 1300 ] 544 0.342% 98.996% ( 1300, 1900 ] 657 0.413% 99.410% ( 1900, 2900 ] 742 0.467% 99.877% ( 2900, 4400 ] 374 0.235% 100.112% ( 4400, 6600 ] 101 0.064% 100.176% ( 6600, 9900 ] 17 0.011% 100.186% ** Level 5 read latency histogram (micros): Count: 16599 Average: 883.8266 StdDev: 1250.84 Min: 79 Median: 335.3693 Max: 10390 Percentiles: P50: 335.37 P75: 981.22 P99: 6173.04 P99.9: 9267.93 P99.99: 10390.00 ------------------------------------------------------ ( 76, 110 ] 432 2.603% 2.603% # ( 110, 170 ] 3763 22.670% 25.273% ##### ( 170, 250 ] 2931 17.658% 42.930% #### ( 250, 380 ] 1787 10.766% 53.696% ## ( 380, 580 ] 1781 10.730% 64.426% ## ( 580, 870 ] 1479 8.910% 73.336% ## ( 870, 1300 ] 1068 6.434% 79.770% # ( 1300, 1900 ] 956 5.759% 85.529% # ( 1900, 2900 ] 998 6.012% 91.542% # ( 2900, 4400 ] 856 5.157% 96.699% # ( 4400, 6600 ] 474 2.856% 99.554% # ( 6600, 9900 ] 71 0.428% 99.982% ( 9900, 14000 ] 3 0.018% 100.000% ** DB Stats ** Uptime(secs): 5.5 total, 5.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 179.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.607 H:M:S, 29.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 186.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.607 H:M:S, 30.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/17-02:34:21 ... thread 0: (1000000,2000000) ops and (114252.7,142519.4) ops/second in (8.752527,14.033179) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 3.80 GB 188.3 2.6 0.0 2.6 4.5 1.8 0.0 2.4 151.6 257.1 17.86 15.09 35 0.510 2749K 6433 0.0 0.0 L2 1/0 94.08 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 997.03 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.0 1.5 93.6 93.5 2.05 0.92 1 2.051 130K 0 0.0 0.0 L4 160/0 9.66 GB 1.0 2.0 1.1 0.9 2.0 1.1 0.1 1.8 97.7 97.4 20.86 9.61 9 2.317 632K 0 0.0 0.0 L5 1116/0 91.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/11 106.31 GB 0.0 4.8 1.2 3.6 6.7 3.1 4.8 3.6 121.1 167.2 40.76 25.63 45 0.906 3512K 6433 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.2 3.6 6.7 3.1 4.8 3.6 121.1 167.2 40.76 25.63 45 0.906 3512K 6433 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.2 3.6 4.8 1.2 0.0 0.0 149.0 148.6 33.13 20.52 17 1.949 3512K 6433 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 247.6 7.63 5.11 28 0.273 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.2 total, 14.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.65 GB write, 479.07 MB/s write, 4.82 GB read, 347.18 MB/s read, 40.8 seconds Interval compaction: 6.65 GB write, 485.50 MB/s write, 4.82 GB read, 351.84 MB/s read, 40.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 10, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 936624 Average: 17.2631 StdDev: 114.28 Min: 0 Median: 1.5471 Max: 21437 Percentiles: P50: 1.55 P75: 1.99 P99: 249.18 P99.9: 800.99 P99.99: 1534.93 ------------------------------------------------------ [ 0, 1 ] 179209 19.134% 19.134% #### ( 1, 2 ] 528422 56.418% 75.551% ########### ( 2, 3 ] 104842 11.194% 86.745% ## ( 3, 4 ] 30946 3.304% 90.049% # ( 4, 6 ] 23663 2.526% 92.575% # ( 6, 10 ] 6355 0.679% 93.254% ( 10, 15 ] 1511 0.161% 93.415% ( 15, 22 ] 317 0.034% 93.449% ( 22, 34 ] 33 0.004% 93.452% ( 34, 51 ] 12 0.001% 93.454% ( 51, 76 ] 7 0.001% 93.454% ( 76, 110 ] 3134 0.335% 93.789% ( 110, 170 ] 29853 3.187% 96.976% # ( 170, 250 ] 19149 2.044% 99.021% ( 250, 380 ] 4535 0.484% 99.505% ( 380, 580 ] 2852 0.304% 99.810% ( 580, 870 ] 1112 0.119% 99.928% ( 870, 1300 ] 455 0.049% 99.977% ( 1300, 1900 ] 315 0.034% 100.010% ( 1900, 2900 ] 294 0.031% 100.042% ( 2900, 4400 ] 117 0.012% 100.054% ( 4400, 6600 ] 26 0.003% 100.057% ( 6600, 9900 ] 2 0.000% 100.057% ( 9900, 14000 ] 9 0.001% 100.058% ( 14000, 22000 ] 9 0.001% 100.059% ** Level 2 read latency histogram (micros): Count: 32909 Average: 19.7155 StdDev: 262.84 Min: 1 Median: 1.9212 Max: 20411 Percentiles: P50: 1.92 P75: 2.87 P99: 176.02 P99.9: 3251.40 P99.99: 12807.31 ------------------------------------------------------ [ 0, 1 ] 976 2.966% 2.966% # ( 1, 2 ] 16803 51.059% 54.025% ########## ( 2, 3 ] 7952 24.164% 78.188% ##### ( 3, 4 ] 2816 8.557% 86.745% ## ( 4, 6 ] 2857 8.682% 95.427% ## ( 6, 10 ] 774 2.352% 97.779% ( 10, 15 ] 245 0.744% 98.523% ( 15, 22 ] 40 0.122% 98.645% ( 76, 110 ] 6 0.018% 98.663% ( 110, 170 ] 107 0.325% 98.988% ( 170, 250 ] 52 0.158% 99.146% ( 250, 380 ] 26 0.079% 99.225% ( 380, 580 ] 28 0.085% 99.310% ( 580, 870 ] 28 0.085% 99.395% ( 870, 1300 ] 40 0.122% 99.517% ( 1300, 1900 ] 50 0.152% 99.669% ( 1900, 2900 ] 70 0.213% 99.881% ( 2900, 4400 ] 26 0.079% 99.960% ( 4400, 6600 ] 7 0.021% 99.982% ( 6600, 9900 ] 2 0.006% 99.988% ( 9900, 14000 ] 1 0.003% 99.991% ( 14000, 22000 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 148243 Average: 22.9691 StdDev: 233.40 Min: 1 Median: 1.9579 Max: 18473 Percentiles: P50: 1.96 P75: 2.89 P99: 282.54 P99.9: 2993.27 P99.99: 4150.08 ------------------------------------------------------ [ 0, 1 ] 3873 2.613% 2.613% # ( 1, 2 ] 73338 49.471% 52.084% ########## ( 2, 3 ] 38018 25.646% 77.730% ##### ( 3, 4 ] 12182 8.218% 85.947% ## ( 4, 6 ] 12898 8.701% 94.648% ## ( 6, 10 ] 3599 2.428% 97.076% ( 10, 15 ] 940 0.634% 97.710% ( 15, 22 ] 185 0.125% 97.835% ( 22, 34 ] 12 0.008% 97.843% ( 34, 51 ] 4 0.003% 97.845% ( 76, 110 ] 74 0.050% 97.895% ( 110, 170 ] 908 0.613% 98.508% ( 170, 250 ] 674 0.455% 98.963% ( 250, 380 ] 222 0.150% 99.112% ( 380, 580 ] 168 0.113% 99.226% ( 580, 870 ] 165 0.111% 99.337% ( 870, 1300 ] 202 0.136% 99.473% ( 1300, 1900 ] 283 0.191% 99.664% ( 1900, 2900 ] 339 0.229% 99.893% ( 2900, 4400 ] 173 0.117% 100.009% ( 4400, 6600 ] 44 0.030% 100.039% ( 6600, 9900 ] 8 0.005% 100.045% ( 9900, 14000 ] 5 0.003% 100.048% ( 14000, 22000 ] 2 0.001% 100.049% ** Level 4 read latency histogram (micros): Count: 175134 Average: 53.0783 StdDev: 294.90 Min: 1 Median: 2.1648 Max: 8798 Percentiles: P50: 2.16 P75: 3.58 P99: 1185.74 P99.9: 2983.69 P99.99: 3615.86 ------------------------------------------------------ [ 0, 1 ] 4276 2.442% 2.442% ( 1, 2 ] 76274 43.552% 45.993% ######### ( 2, 3 ] 42588 24.317% 70.311% ##### ( 3, 4 ] 14109 8.056% 78.367% ## ( 4, 6 ] 13716 7.832% 86.199% ## ( 6, 10 ] 3932 2.245% 88.444% ( 10, 15 ] 957 0.546% 88.990% ( 15, 22 ] 162 0.093% 89.083% ( 22, 34 ] 14 0.008% 89.091% ( 34, 51 ] 2 0.001% 89.092% ( 51, 76 ] 4 0.002% 89.094% ( 76, 110 ] 723 0.413% 89.507% ( 110, 170 ] 8234 4.702% 94.208% # ( 170, 250 ] 5172 2.953% 97.162% # ( 250, 380 ] 1322 0.755% 97.916% ( 380, 580 ] 929 0.530% 98.447% ( 580, 870 ] 556 0.317% 98.764% ( 870, 1300 ] 562 0.321% 99.085% ( 1300, 1900 ] 658 0.376% 99.461% ( 1900, 2900 ] 748 0.427% 99.888% ( 2900, 4400 ] 374 0.214% 100.102% ( 4400, 6600 ] 101 0.058% 100.159% ( 6600, 9900 ] 17 0.010% 100.169% ** Level 5 read latency histogram (micros): Count: 131761 Average: 278.5487 StdDev: 510.80 Min: 79 Median: 167.3231 Max: 10390 Percentiles: P50: 167.32 P75: 231.13 P99: 3059.03 P99.9: 6327.27 P99.99: 9380.55 ------------------------------------------------------ ( 76, 110 ] 5482 4.161% 4.161% # ( 110, 170 ] 63219 47.980% 52.141% ########## ( 170, 250 ] 39420 29.918% 82.058% ###### ( 250, 380 ] 9412 7.143% 89.202% # ( 380, 580 ] 6724 5.103% 94.305% # ( 580, 870 ] 2833 2.150% 96.455% ( 870, 1300 ] 1239 0.940% 97.395% ( 1300, 1900 ] 987 0.749% 98.144% ( 1900, 2900 ] 1036 0.786% 98.931% ( 2900, 4400 ] 862 0.654% 99.585% ( 4400, 6600 ] 474 0.360% 99.945% ( 6600, 9900 ] 71 0.054% 99.998% ( 9900, 14000 ] 3 0.002% 100.001% ** DB Stats ** Uptime(secs): 14.2 total, 8.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 138.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.762 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 112.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.155 H:M:S, 58.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/17-02:34:30 ... thread 0: (1000000,3000000) ops and (113627.5,131383.8) ops/second in (8.800687,22.833866) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 4.78 GB 288.8 4.4 0.0 4.4 7.2 2.8 0.0 2.6 162.5 265.9 27.91 24.50 56 0.498 4603K 9902 0.0 0.0 L2 1/0 94.08 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/0 997.03 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.0 1.5 93.6 93.5 2.05 0.92 1 2.051 130K 0 0.0 0.0 L4 160/0 9.66 GB 1.0 2.0 1.1 0.9 2.0 1.1 0.1 1.8 97.7 97.4 20.86 9.61 9 2.317 632K 0 0.0 0.0 L5 1116/0 91.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1309/11 107.29 GB 0.0 6.6 1.2 5.4 9.4 4.0 4.8 3.3 133.1 189.8 50.81 35.03 66 0.770 5366K 9902 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 1.2 5.4 9.4 4.0 4.8 3.3 133.1 189.8 50.81 35.03 66 0.770 5366K 9902 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 1.2 5.4 6.6 1.2 0.0 0.0 169.4 169.0 39.93 27.21 22 1.815 5366K 9902 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 266.2 10.89 7.82 44 0.247 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.0 total, 22.8 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.42 GB write, 418.90 MB/s write, 6.61 GB read, 293.80 MB/s read, 50.8 seconds Interval compaction: 9.42 GB write, 422.35 MB/s write, 6.61 GB read, 296.22 MB/s read, 50.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 10, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1487153 Average: 19.0123 StdDev: 100.33 Min: 0 Median: 1.5226 Max: 21437 Percentiles: P50: 1.52 P75: 1.97 P99: 265.59 P99.9: 707.59 P99.99: 1120.40 ------------------------------------------------------ [ 0, 1 ] 312522 21.015% 21.015% #### ( 1, 2 ] 824847 55.465% 76.480% ########### ( 2, 3 ] 141315 9.502% 85.982% ## ( 3, 4 ] 46555 3.130% 89.112% # ( 4, 6 ] 32568 2.190% 91.302% ( 6, 10 ] 8162 0.549% 91.851% ( 10, 15 ] 2033 0.137% 91.988% ( 15, 22 ] 440 0.030% 92.018% ( 22, 34 ] 69 0.005% 92.022% ( 34, 51 ] 16 0.001% 92.023% ( 51, 76 ] 15 0.001% 92.024% ( 76, 110 ] 5546 0.373% 92.397% ( 110, 170 ] 58833 3.956% 96.353% # ( 170, 250 ] 38359 2.579% 98.933% # ( 250, 380 ] 8351 0.562% 99.494% ( 380, 580 ] 5235 0.352% 99.846% ( 580, 870 ] 1818 0.122% 99.968% ( 870, 1300 ] 550 0.037% 100.005% ( 1300, 1900 ] 338 0.023% 100.028% ( 1900, 2900 ] 313 0.021% 100.049% ( 2900, 4400 ] 130 0.009% 100.058% ( 4400, 6600 ] 26 0.002% 100.060% ( 6600, 9900 ] 2 0.000% 100.060% ( 9900, 14000 ] 9 0.001% 100.060% ( 14000, 22000 ] 9 0.001% 100.061% ** Level 2 read latency histogram (micros): Count: 33062 Average: 20.4806 StdDev: 262.55 Min: 1 Median: 1.9257 Max: 20411 Percentiles: P50: 1.93 P75: 2.88 P99: 221.79 P99.9: 3242.58 P99.99: 12744.58 ------------------------------------------------------ [ 0, 1 ] 976 2.952% 2.952% # ( 1, 2 ] 16803 50.823% 53.775% ########## ( 2, 3 ] 7952 24.052% 77.827% ##### ( 3, 4 ] 2816 8.517% 86.344% ## ( 4, 6 ] 2857 8.641% 94.985% ## ( 6, 10 ] 774 2.341% 97.326% ( 10, 15 ] 245 0.741% 98.067% ( 15, 22 ] 40 0.121% 98.188% ( 76, 110 ] 16 0.048% 98.237% ( 110, 170 ] 187 0.566% 98.802% ( 170, 250 ] 101 0.305% 99.108% ( 250, 380 ] 32 0.097% 99.205% ( 380, 580 ] 34 0.103% 99.307% ( 580, 870 ] 30 0.091% 99.398% ( 870, 1300 ] 40 0.121% 99.519% ( 1300, 1900 ] 50 0.151% 99.670% ( 1900, 2900 ] 70 0.212% 99.882% ( 2900, 4400 ] 26 0.079% 99.961% ( 4400, 6600 ] 7 0.021% 99.982% ( 6600, 9900 ] 2 0.006% 99.988% ( 9900, 14000 ] 1 0.003% 99.991% ( 14000, 22000 ] 3 0.009% 100.000% ** Level 3 read latency histogram (micros): Count: 150046 Average: 24.9401 StdDev: 232.93 Min: 1 Median: 1.9702 Max: 18473 Percentiles: P50: 1.97 P75: 2.93 P99: 344.04 P99.9: 2977.64 P99.99: 4148.52 ------------------------------------------------------ [ 0, 1 ] 3873 2.581% 2.581% # ( 1, 2 ] 73338 48.877% 51.458% ########## ( 2, 3 ] 38018 25.338% 76.796% ##### ( 3, 4 ] 12182 8.119% 84.915% ## ( 4, 6 ] 12898 8.596% 93.511% ## ( 6, 10 ] 3599 2.399% 95.909% ( 10, 15 ] 940 0.626% 96.536% ( 15, 22 ] 185 0.123% 96.659% ( 22, 34 ] 12 0.008% 96.667% ( 34, 51 ] 4 0.003% 96.670% ( 76, 110 ] 166 0.111% 96.780% ( 110, 170 ] 1865 1.243% 98.023% ( 170, 250 ] 1229 0.819% 98.842% ( 250, 380 ] 327 0.218% 99.060% ( 380, 580 ] 240 0.160% 99.220% ( 580, 870 ] 184 0.123% 99.343% ( 870, 1300 ] 205 0.137% 99.479% ( 1300, 1900 ] 283 0.189% 99.668% ( 1900, 2900 ] 339 0.226% 99.894% ( 2900, 4400 ] 173 0.115% 100.009% ( 4400, 6600 ] 44 0.029% 100.039% ( 6600, 9900 ] 8 0.005% 100.044% ( 9900, 14000 ] 5 0.003% 100.047% ( 14000, 22000 ] 2 0.001% 100.049% ** Level 4 read latency histogram (micros): Count: 191592 Average: 64.4140 StdDev: 286.13 Min: 1 Median: 2.3569 Max: 8798 Percentiles: P50: 2.36 P75: 4.91 P99: 1073.24 P99.9: 2925.56 P99.99: 3613.46 ------------------------------------------------------ [ 0, 1 ] 4276 2.232% 2.232% ( 1, 2 ] 76297 39.823% 42.054% ######## ( 2, 3 ] 42650 22.261% 64.315% #### ( 3, 4 ] 14168 7.395% 71.710% # ( 4, 6 ] 13785 7.195% 78.905% # ( 6, 10 ] 3941 2.057% 80.962% ( 10, 15 ] 959 0.501% 81.463% ( 15, 22 ] 162 0.085% 81.547% ( 22, 34 ] 14 0.007% 81.555% ( 34, 51 ] 2 0.001% 81.556% ( 51, 76 ] 4 0.002% 81.558% ( 76, 110 ] 1537 0.802% 82.360% ( 110, 170 ] 16723 8.728% 91.088% ## ( 170, 250 ] 10268 5.359% 96.448% # ( 250, 380 ] 2314 1.208% 97.655% ( 380, 580 ] 1573 0.821% 98.476% ( 580, 870 ] 728 0.380% 98.856% ( 870, 1300 ] 582 0.304% 99.160% ( 1300, 1900 ] 663 0.346% 99.506% ( 1900, 2900 ] 748 0.390% 99.897% ( 2900, 4400 ] 376 0.196% 100.093% ( 4400, 6600 ] 101 0.053% 100.146% ( 6600, 9900 ] 17 0.009% 100.154% ** Level 5 read latency histogram (micros): Count: 249406 Average: 235.9134 StdDev: 381.24 Min: 79 Median: 164.5624 Max: 10390 Percentiles: P50: 164.56 P75: 223.42 P99: 1888.79 P99.9: 5781.23 P99.99: 8833.74 ------------------------------------------------------ ( 76, 110 ] 11315 4.537% 4.537% # ( 110, 170 ] 124689 49.994% 54.531% ########## ( 170, 250 ] 76459 30.656% 85.188% ###### ( 250, 380 ] 16509 6.619% 91.807% # ( 380, 580 ] 11391 4.567% 96.374% # ( 580, 870 ] 4154 1.666% 98.040% ( 870, 1300 ] 1394 0.559% 98.599% ( 1300, 1900 ] 1021 0.409% 99.008% ( 1900, 2900 ] 1057 0.424% 99.432% ( 2900, 4400 ] 871 0.349% 99.781% ( 4400, 6600 ] 474 0.190% 99.971% ( 6600, 9900 ] 71 0.028% 100.000% ( 9900, 14000 ] 3 0.001% 100.001% ** DB Stats ** Uptime(secs): 23.0 total, 8.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 128.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.832 H:M:S, 51.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 111.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.070 H:M:S, 57.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 239.964 micros/op 16648 ops/sec 60.125 seconds 1000996 operations; 16.1 MB/s (250999 of 250999 found) Microseconds per read: Count: 1000996 Average: 239.9663 StdDev: 573.62 Min: 2 Median: 202.3682 Max: 70078 Percentiles: P50: 202.37 P75: 242.05 P99: 765.99 P99.9: 7125.26 P99.99: 27858.55 ------------------------------------------------------ ( 1, 2 ] 7 0.001% 0.001% ( 2, 3 ] 35 0.003% 0.004% ( 3, 4 ] 31 0.003% 0.007% ( 4, 6 ] 66 0.007% 0.014% ( 6, 10 ] 289 0.029% 0.043% ( 10, 15 ] 2828 0.283% 0.325% ( 15, 22 ] 2825 0.282% 0.607% ( 22, 34 ] 11765 1.175% 1.783% ( 34, 51 ] 2032 0.203% 1.986% ( 51, 76 ] 251 0.025% 2.011% ( 76, 110 ] 1873 0.187% 2.198% ( 110, 170 ] 274365 27.409% 29.607% ##### ( 170, 250 ] 504522 50.402% 80.009% ########## ( 250, 380 ] 123655 12.353% 92.362% ## ( 380, 580 ] 57796 5.774% 98.136% # ( 580, 870 ] 13481 1.347% 99.483% ( 870, 1300 ] 2869 0.287% 99.770% ( 1300, 1900 ] 500 0.050% 99.820% ( 1900, 2900 ] 335 0.033% 99.853% ( 2900, 4400 ] 228 0.023% 99.876% ( 4400, 6600 ] 189 0.019% 99.895% ( 6600, 9900 ] 333 0.033% 99.928% ( 9900, 14000 ] 226 0.023% 99.951% ( 14000, 22000 ] 323 0.032% 99.983% ( 22000, 33000 ] 135 0.013% 99.996% ( 33000, 50000 ] 33 0.003% 100.000% ( 50000, 75000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18034496 rocksdb.bloom.filter.full.positive COUNT : 1175957 rocksdb.bloom.filter.full.true.positive COUNT : 1000619 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 377 rocksdb.memtable.miss COUNT : 1000619 rocksdb.l0.hit COUNT : 44397 rocksdb.l1.hit COUNT : 3282 rocksdb.l2andup.hit COUNT : 952940 rocksdb.compaction.key.drop.new COUNT : 43083 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3298641 rocksdb.number.keys.read COUNT : 1000996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3404197512 rocksdb.bytes.read COUNT : 1000996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1423 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 47356848 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10082956803 rocksdb.compact.write.bytes COUNT : 10034406893 rocksdb.flush.write.bytes COUNT : 3369107133 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 75 rocksdb.number.superversion_acquires COUNT : 523 rocksdb.number.superversion_releases COUNT : 505 rocksdb.number.superversion_cleanups COUNT : 134 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 105 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3341784064 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1162240 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 14681986446 rocksdb.non.last.level.read.count COUNT : 3400584 rocksdb.block.checksum.compute.count COUNT : 3628076 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 201.375708 P95 : 469.474293 P99 : 764.506824 P100 : 70075.000000 COUNT : 1000996 SUM : 239190626 rocksdb.db.write.micros P50 : 1.515206 P95 : 4.992609 P99 : 77.521410 P100 : 779484.000000 COUNT : 3298641 SUM : 55658251 rocksdb.compaction.times.micros P50 : 1900000.000000 P95 : 4160000.000000 P99 : 51685505.000000 P100 : 51685505.000000 COUNT : 24 SUM : 92532552 rocksdb.compaction.times.cpu_micros P50 : 1056842.105263 P95 : 4160000.000000 P99 : 14968462.000000 P100 : 14968462.000000 COUNT : 24 SUM : 43083115 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 841.000000 P95 : 8415.000000 P99 : 56972.000000 P100 : 56972.000000 COUNT : 49 SUM : 127873 rocksdb.compaction.outfile.sync.micros P50 : 2400.000000 P95 : 34133.333333 P99 : 189200.000000 P100 : 201436.000000 COUNT : 76 SUM : 724321 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 180.000000 P95 : 4752.000000 P99 : 5947.000000 P100 : 5947.000000 COUNT : 84 SUM : 70476 rocksdb.table.open.io.micros P50 : 8523.714953 P95 : 20379.342723 P99 : 30910.000000 P100 : 39825.000000 COUNT : 1423 SUM : 13347471 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.721749 P95 : 160.655301 P99 : 247.203742 P100 : 15437.000000 COUNT : 2440912 SUM : 65762487 rocksdb.read.block.get.micros P50 : 154.869178 P95 : 285.038485 P99 : 578.070402 P100 : 21479.000000 COUNT : 1185742 SUM : 204600330 rocksdb.write.raw.block.micros P50 : 0.536986 P95 : 1.394064 P99 : 3.392509 P100 : 14770.000000 COUNT : 3246230 SUM : 8434062 rocksdb.numfiles.in.singlecompaction P50 : 3.514286 P95 : 5.900000 P99 : 27.000000 P100 : 27.000000 COUNT : 42 SUM : 191 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.571725 P95 : 2037.702242 P99 : 2727.830661 P100 : 779290.000000 COUNT : 237801 SUM : 47376705 rocksdb.sst.read.micros P50 : 2.638863 P95 : 232.523176 P99 : 463.496067 P100 : 21437.000000 COUNT : 3400702 SUM : 257407106 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1000996 SUM : 1000996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3298641 SUM : 3404197512 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215581.395349 P95 : 501125.000000 P99 : 985217.000000 P100 : 985217.000000 COUNT : 49 SUM : 11930550 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 107 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0