[2024-11-16 23:28:39.805132] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-16 23:28:39.805423] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid704801 ] Set seed to 1731796119798494 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-16 23:28:39.904380] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-16 23:28:39.940877] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-16 23:28:39.940939] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 704801' to capture a snapshot of events at runtime. [2024-11-16 23:28:39.940951] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid704801 for offline analysis/debug. [2024-11-16 23:28:39.940991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 16 23:28:44 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/16-23:28:48 ... thread 0: (1000000,1000000) ops and (225086.2,225086.2) ops/second in (4.442743,4.442743) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 2.83 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 95.7 244.6 5.92 4.57 15 0.395 575K 591 0.0 0.0 L1 14/14 1.50 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/0 977.29 MB 1.0 0.3 0.1 0.1 0.3 0.1 0.0 2.2 136.0 134.4 1.93 1.18 1 1.926 120K 0 0.0 0.0 L4 163/0 9.64 GB 1.0 1.5 0.9 0.6 1.5 0.9 0.0 1.7 128.3 126.9 12.26 7.58 9 1.362 222K 0 0.0 0.0 L5 1109/0 91.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/23 106.46 GB 0.0 2.3 1.0 1.3 3.2 1.9 2.3 3.7 119.4 162.3 20.11 13.33 25 0.804 918K 591 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.0 1.3 3.2 1.9 2.3 3.7 119.4 162.3 20.11 13.33 25 0.804 918K 591 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.0 1.3 2.3 1.0 0.0 0.0 146.7 145.4 16.38 10.89 12 1.365 918K 591 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 236.2 3.73 2.44 13 0.287 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.6 total, 4.4 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.19 GB write, 708.66 MB/s write, 2.35 GB read, 521.58 MB/s read, 20.1 seconds Interval compaction: 3.19 GB write, 734.28 MB/s write, 2.35 GB read, 540.44 MB/s read, 20.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 372357 Average: 5.5404 StdDev: 75.58 Min: 1 Median: 1.6254 Max: 20970 Percentiles: P50: 1.63 P75: 2.20 P99: 9.94 P99.9: 525.68 P99.99: 1054.47 ------------------------------------------------------ [ 0, 1 ] 48335 12.981% 12.981% ### ( 1, 2 ] 220392 59.188% 72.169% ############ ( 2, 3 ] 53950 14.489% 86.658% ### ( 3, 4 ] 21050 5.653% 92.311% # ( 4, 6 ] 19212 5.160% 97.471% # ( 6, 10 ] 5789 1.555% 99.025% ( 10, 15 ] 1073 0.288% 99.314% ( 15, 22 ] 169 0.045% 99.359% ( 22, 34 ] 49 0.013% 99.372% ( 34, 51 ] 7 0.002% 99.374% ( 51, 76 ] 9 0.002% 99.376% ( 76, 110 ] 179 0.048% 99.424% ( 110, 170 ] 662 0.178% 99.602% ( 170, 250 ] 500 0.134% 99.737% ( 250, 380 ] 370 0.099% 99.836% ( 380, 580 ] 329 0.088% 99.924% ( 580, 870 ] 196 0.053% 99.977% ( 870, 1300 ] 116 0.031% 100.008% ( 1300, 1900 ] 70 0.019% 100.027% ( 1900, 2900 ] 52 0.014% 100.041% ( 2900, 4400 ] 23 0.006% 100.047% ( 4400, 6600 ] 12 0.003% 100.050% ( 6600, 9900 ] 2 0.001% 100.051% ( 9900, 14000 ] 1 0.000% 100.051% ( 14000, 22000 ] 1 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 342 Average: 803.3392 StdDev: 1351.38 Min: 83 Median: 227.1429 Max: 7341 Percentiles: P50: 227.14 P75: 601.75 P99: 6339.67 P99.9: 7341.00 P99.99: 7341.00 ------------------------------------------------------ ( 76, 110 ] 41 11.988% 11.988% ## ( 110, 170 ] 100 29.240% 41.228% ###### ( 170, 250 ] 42 12.281% 53.509% ## ( 250, 380 ] 36 10.526% 64.035% ## ( 380, 580 ] 36 10.526% 74.561% ## ( 580, 870 ] 20 5.848% 80.409% # ( 870, 1300 ] 10 2.924% 83.333% # ( 1300, 1900 ] 14 4.094% 87.427% # ( 1900, 2900 ] 11 3.216% 90.643% # ( 2900, 4400 ] 18 5.263% 95.906% # ( 4400, 6600 ] 12 3.509% 99.415% # ( 6600, 9900 ] 2 0.585% 100.000% ** Level 3 read latency histogram (micros): Count: 143941 Average: 9.1871 StdDev: 135.43 Min: 1 Median: 1.8362 Max: 19094 Percentiles: P50: 1.84 P75: 2.85 P99: 10.63 P99.9: 1081.18 P99.99: 1874.22 ------------------------------------------------------ [ 0, 1 ] 9009 6.259% 6.259% # ( 1, 2 ] 75294 52.309% 58.568% ########## ( 2, 3 ] 27736 19.269% 77.837% #### ( 3, 4 ] 13779 9.573% 87.409% ## ( 4, 6 ] 13384 9.298% 96.708% ## ( 6, 10 ] 3220 2.237% 98.945% ( 10, 15 ] 629 0.437% 99.382% ( 15, 22 ] 98 0.068% 99.450% ( 22, 34 ] 35 0.024% 99.474% ( 34, 51 ] 7 0.005% 99.479% ( 51, 76 ] 4 0.003% 99.482% ( 76, 110 ] 22 0.015% 99.497% ( 110, 170 ] 98 0.068% 99.565% ( 170, 250 ] 91 0.063% 99.628% ( 250, 380 ] 79 0.055% 99.683% ( 380, 580 ] 103 0.072% 99.755% ( 580, 870 ] 157 0.109% 99.864% ( 870, 1300 ] 106 0.074% 99.937% ( 1300, 1900 ] 79 0.055% 99.992% ( 1900, 2900 ] 71 0.049% 100.042% ( 2900, 4400 ] 42 0.029% 100.071% ( 4400, 6600 ] 17 0.012% 100.083% ( 6600, 9900 ] 2 0.001% 100.084% ( 9900, 14000 ] 1 0.001% 100.085% ( 14000, 22000 ] 2 0.001% 100.086% ** Level 4 read latency histogram (micros): Count: 113437 Average: 25.1940 StdDev: 213.13 Min: 1 Median: 1.8661 Max: 15766 Percentiles: P50: 1.87 P75: 2.95 P99: 640.77 P99.9: 2782.86 P99.99: 4009.95 ------------------------------------------------------ [ 0, 1 ] 7188 6.337% 6.337% # ( 1, 2 ] 57190 50.416% 56.752% ########## ( 2, 3 ] 21689 19.120% 75.872% #### ( 3, 4 ] 10254 9.039% 84.911% ## ( 4, 6 ] 10114 8.916% 93.827% ## ( 6, 10 ] 2945 2.596% 96.424% # ( 10, 15 ] 669 0.590% 97.013% ( 15, 22 ] 121 0.107% 97.120% ( 22, 34 ] 30 0.026% 97.146% ( 34, 51 ] 15 0.013% 97.160% ( 51, 76 ] 6 0.005% 97.165% ( 76, 110 ] 138 0.122% 97.287% ( 110, 170 ] 593 0.523% 97.809% ( 170, 250 ] 436 0.384% 98.194% ( 250, 380 ] 404 0.356% 98.550% ( 380, 580 ] 431 0.380% 98.930% ( 580, 870 ] 380 0.335% 99.265% ( 870, 1300 ] 338 0.298% 99.563% ( 1300, 1900 ] 221 0.195% 99.758% ( 1900, 2900 ] 183 0.161% 99.919% ( 2900, 4400 ] 109 0.096% 100.015% ( 4400, 6600 ] 36 0.032% 100.047% ( 6600, 9900 ] 2 0.002% 100.048% ( 9900, 14000 ] 2 0.002% 100.050% ( 14000, 22000 ] 1 0.001% 100.051% ** Level 5 read latency histogram (micros): Count: 19303 Average: 646.1195 StdDev: 1087.66 Min: 77 Median: 245.1448 Max: 35922 Percentiles: P50: 245.14 P75: 582.10 P99: 5271.45 P99.9: 8158.62 P99.99: 14557.60 ------------------------------------------------------ ( 76, 110 ] 1423 7.372% 7.372% # ( 110, 170 ] 4987 25.835% 33.207% ##### ( 170, 250 ] 3452 17.883% 51.091% #### ( 250, 380 ] 2409 12.480% 63.570% ## ( 380, 580 ] 2197 11.382% 74.952% ## ( 580, 870 ] 1416 7.336% 82.288% # ( 870, 1300 ] 915 4.740% 87.028% # ( 1300, 1900 ] 726 3.761% 90.789% # ( 1900, 2900 ] 797 4.129% 94.918% # ( 2900, 4400 ] 684 3.543% 98.461% # ( 4400, 6600 ] 265 1.373% 99.834% ( 6600, 9900 ] 29 0.150% 99.984% ( 9900, 14000 ] 2 0.010% 99.995% ( 14000, 22000 ] 1 0.005% 100.000% ( 33000, 50000 ] 3 0.016% 100.016% ** DB Stats ** Uptime(secs): 4.6 total, 4.4 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 213.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.659 H:M:S, 14.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 221.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.659 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-23:28:52 ... thread 0: (1000000,2000000) ops and (281590.0,250187.5) ops/second in (3.551263,7.994006) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 3.81 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 121.3 266.7 12.99 11.14 35 0.371 1599K 1617 0.0 0.0 L1 14/14 1.50 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/0 977.29 MB 1.0 0.3 0.1 0.1 0.3 0.1 0.0 2.2 136.0 134.4 1.93 1.18 1 1.926 120K 0 0.0 0.0 L4 163/0 9.64 GB 1.0 1.5 0.9 0.6 1.5 0.9 0.0 1.7 128.3 126.9 12.26 7.58 9 1.362 222K 0 0.0 0.0 L5 1109/0 91.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1327/23 107.44 GB 0.0 3.3 1.0 2.3 5.2 2.8 2.3 2.8 125.5 194.2 27.17 19.90 45 0.604 1942K 1617 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.0 2.3 5.2 2.8 2.3 2.8 125.5 194.2 27.17 19.90 45 0.604 1942K 1617 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.0 2.3 3.3 1.0 0.0 0.0 168.0 166.9 20.30 14.73 16 1.269 1942K 1617 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 275.0 6.87 5.16 29 0.237 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.2 total, 8.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.15 GB write, 647.16 MB/s write, 3.33 GB read, 418.08 MB/s read, 27.2 seconds Interval compaction: 5.15 GB write, 660.17 MB/s write, 3.33 GB read, 426.48 MB/s read, 27.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 807852 Average: 5.4377 StdDev: 58.57 Min: 1 Median: 1.5680 Max: 20970 Percentiles: P50: 1.57 P75: 1.98 P99: 17.37 P99.9: 446.41 P99.99: 665.11 ------------------------------------------------------ [ 0, 1 ] 128597 15.918% 15.918% ### ( 1, 2 ] 484763 60.006% 75.925% ############ ( 2, 3 ] 105591 13.071% 88.995% ### ( 3, 4 ] 38257 4.736% 93.731% # ( 4, 6 ] 30636 3.792% 97.523% # ( 6, 10 ] 9987 1.236% 98.760% ( 10, 15 ] 1829 0.226% 98.986% ( 15, 22 ] 341 0.042% 99.028% ( 22, 34 ] 80 0.010% 99.038% ( 34, 51 ] 12 0.001% 99.040% ( 51, 76 ] 12 0.001% 99.041% ( 76, 110 ] 765 0.095% 99.136% ( 110, 170 ] 2933 0.363% 99.499% ( 170, 250 ] 1849 0.229% 99.728% ( 250, 380 ] 1093 0.135% 99.863% ( 380, 580 ] 907 0.112% 99.975% ( 580, 870 ] 413 0.051% 100.026% ( 870, 1300 ] 171 0.021% 100.048% ( 1300, 1900 ] 80 0.010% 100.057% ( 1900, 2900 ] 58 0.007% 100.065% ( 2900, 4400 ] 26 0.003% 100.068% ( 4400, 6600 ] 12 0.001% 100.069% ( 6600, 9900 ] 4 0.000% 100.070% ( 9900, 14000 ] 1 0.000% 100.070% ( 14000, 22000 ] 1 0.000% 100.070% ** Level 1 read latency histogram (micros): Count: 1203 Average: 390.6500 StdDev: 777.62 Min: 79 Median: 181.5447 Max: 7341 Percentiles: P50: 181.54 P75: 326.19 P99: 4761.17 P99.9: 7341.00 P99.99: 7341.00 ------------------------------------------------------ ( 76, 110 ] 159 13.217% 13.217% ### ( 110, 170 ] 407 33.832% 47.049% ####### ( 170, 250 ] 246 20.449% 67.498% #### ( 250, 380 ] 154 12.801% 80.299% ### ( 380, 580 ] 115 9.559% 89.859% ## ( 580, 870 ] 50 4.156% 94.015% # ( 870, 1300 ] 14 1.164% 95.179% ( 1300, 1900 ] 15 1.247% 96.426% ( 1900, 2900 ] 11 0.914% 97.340% ( 2900, 4400 ] 18 1.496% 98.836% ( 4400, 6600 ] 12 0.998% 99.834% ( 6600, 9900 ] 2 0.166% 100.000% ** Level 3 read latency histogram (micros): Count: 144603 Average: 10.2112 StdDev: 136.59 Min: 1 Median: 1.8406 Max: 19094 Percentiles: P50: 1.84 P75: 2.87 P99: 24.05 P99.9: 1098.28 P99.99: 1881.78 ------------------------------------------------------ [ 0, 1 ] 9009 6.230% 6.230% # ( 1, 2 ] 75294 52.069% 58.300% ########## ( 2, 3 ] 27737 19.181% 77.481% #### ( 3, 4 ] 13779 9.529% 87.010% ## ( 4, 6 ] 13385 9.256% 96.266% ## ( 6, 10 ] 3220 2.227% 98.493% ( 10, 15 ] 629 0.435% 98.928% ( 15, 22 ] 98 0.068% 98.996% ( 22, 34 ] 35 0.024% 99.020% ( 34, 51 ] 7 0.005% 99.025% ( 51, 76 ] 4 0.003% 99.028% ( 76, 110 ] 104 0.072% 99.100% ( 110, 170 ] 362 0.250% 99.350% ( 170, 250 ] 225 0.156% 99.506% ( 250, 380 ] 156 0.108% 99.613% ( 380, 580 ] 181 0.125% 99.739% ( 580, 870 ] 175 0.121% 99.860% ( 870, 1300 ] 110 0.076% 99.936% ( 1300, 1900 ] 81 0.056% 99.992% ( 1900, 2900 ] 72 0.050% 100.041% ( 2900, 4400 ] 42 0.029% 100.071% ( 4400, 6600 ] 17 0.012% 100.082% ( 6600, 9900 ] 2 0.001% 100.084% ( 9900, 14000 ] 1 0.001% 100.084% ( 14000, 22000 ] 2 0.001% 100.086% ** Level 4 read latency histogram (micros): Count: 118770 Average: 33.6964 StdDev: 215.09 Min: 1 Median: 1.9123 Max: 15766 Percentiles: P50: 1.91 P75: 3.28 P99: 711.17 P99.9: 2760.70 P99.99: 4006.22 ------------------------------------------------------ [ 0, 1 ] 7188 6.052% 6.052% # ( 1, 2 ] 57213 48.171% 54.223% ########## ( 2, 3 ] 21786 18.343% 72.566% #### ( 3, 4 ] 10325 8.693% 81.260% ## ( 4, 6 ] 10245 8.626% 89.885% ## ( 6, 10 ] 2964 2.496% 92.381% ( 10, 15 ] 679 0.572% 92.953% ( 15, 22 ] 125 0.105% 93.058% ( 22, 34 ] 31 0.026% 93.084% ( 34, 51 ] 15 0.013% 93.097% ( 51, 76 ] 6 0.005% 93.102% ( 76, 110 ] 642 0.541% 93.642% ( 110, 170 ] 2637 2.220% 95.863% ( 170, 250 ] 1577 1.328% 97.190% ( 250, 380 ] 1011 0.851% 98.042% ( 380, 580 ] 885 0.745% 98.787% ( 580, 870 ] 560 0.471% 99.258% ( 870, 1300 ] 379 0.319% 99.577% ( 1300, 1900 ] 224 0.189% 99.766% ( 1900, 2900 ] 185 0.156% 99.922% ( 2900, 4400 ] 110 0.093% 100.014% ( 4400, 6600 ] 36 0.030% 100.045% ( 6600, 9900 ] 2 0.002% 100.046% ( 9900, 14000 ] 2 0.002% 100.048% ( 14000, 22000 ] 1 0.001% 100.049% ** Level 5 read latency histogram (micros): Count: 60528 Average: 361.3052 StdDev: 661.98 Min: 76 Median: 185.3247 Max: 35922 Percentiles: P50: 185.32 P75: 333.47 P99: 3737.06 P99.9: 6364.94 P99.99: 9362.12 ------------------------------------------------------ ( 51, 76 ] 3 0.005% 0.005% ( 76, 110 ] 5952 9.833% 9.838% ## ( 110, 170 ] 21840 36.082% 45.921% ####### ( 170, 250 ] 12889 21.294% 67.215% #### ( 250, 380 ] 7339 12.125% 79.340% ## ( 380, 580 ] 5961 9.848% 89.188% ## ( 580, 870 ] 2770 4.576% 93.765% # ( 870, 1300 ] 1199 1.981% 95.746% ( 1300, 1900 ] 758 1.252% 96.998% ( 1900, 2900 ] 825 1.363% 98.361% ( 2900, 4400 ] 693 1.145% 99.506% ( 4400, 6600 ] 267 0.441% 99.947% ( 6600, 9900 ] 31 0.051% 99.998% ( 9900, 14000 ] 2 0.003% 100.002% ( 14000, 22000 ] 1 0.002% 100.003% ( 33000, 50000 ] 3 0.005% 100.008% ** DB Stats ** Uptime(secs): 8.2 total, 3.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 241.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.659 H:M:S, 8.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 277.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-23:29:30 ... thread 0: (1000000,3000000) ops and (26423.0,65445.3) ops/second in (37.845829,45.839835) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.82 GB 12.6 3.8 0.0 3.8 6.6 2.8 0.0 2.3 153.3 268.4 25.07 22.27 54 0.464 3900K 12K 0.0 0.0 L1 16/16 1.91 GB 0.0 3.5 2.0 1.5 3.4 1.9 0.0 1.7 88.7 87.5 40.05 24.25 1 40.047 3605K 45K 0.0 0.0 L3 20/0 986.86 MB 1.0 2.9 1.5 1.4 2.9 1.5 0.1 1.9 158.3 157.1 18.68 13.64 12 1.557 1921K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 4.8 2.4 2.4 4.7 2.3 0.0 2.0 151.2 148.4 32.40 22.76 29 1.117 1882K 0 0.0 0.0 L5 1125/0 92.83 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/26 108.28 GB 0.0 14.9 5.8 9.1 17.6 8.5 3.8 6.2 131.2 154.7 116.20 82.92 96 1.210 11M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.9 5.8 9.1 17.6 8.5 3.8 6.2 131.2 154.7 116.20 82.92 96 1.210 11M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.9 5.8 9.1 14.7 5.7 0.0 0.0 144.2 142.6 105.72 74.98 52 2.033 11M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 276.6 10.48 7.94 44 0.238 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.0 total, 45.8 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.55 GB write, 390.75 MB/s write, 14.89 GB read, 331.47 MB/s read, 116.2 seconds Interval compaction: 17.55 GB write, 392.12 MB/s write, 14.89 GB read, 332.63 MB/s read, 116.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 35, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 8, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1645138 Average: 24.7402 StdDev: 102.40 Min: 0 Median: 1.5877 Max: 20970 Percentiles: P50: 1.59 P75: 2.42 P99: 279.27 P99.9: 933.89 P99.99: 1462.14 ------------------------------------------------------ [ 0, 1 ] 326711 19.859% 19.859% #### ( 1, 2 ] 843660 51.282% 71.141% ########## ( 2, 3 ] 151010 9.179% 80.320% ## ( 3, 4 ] 56515 3.435% 83.756% # ( 4, 6 ] 45114 2.742% 86.498% # ( 6, 10 ] 12584 0.765% 87.263% ( 10, 15 ] 2324 0.141% 87.404% ( 15, 22 ] 404 0.025% 87.429% ( 22, 34 ] 86 0.005% 87.434% ( 34, 51 ] 17 0.001% 87.435% ( 51, 76 ] 53 0.003% 87.438% ( 76, 110 ] 41272 2.509% 89.947% # ( 110, 170 ] 121778 7.402% 97.349% # ( 170, 250 ] 25471 1.548% 98.897% ( 250, 380 ] 7495 0.456% 99.353% ( 380, 580 ] 5701 0.347% 99.700% ( 580, 870 ] 3068 0.186% 99.886% ( 870, 1300 ] 1547 0.094% 99.980% ( 1300, 1900 ] 605 0.037% 100.017% ( 1900, 2900 ] 327 0.020% 100.037% ( 2900, 4400 ] 271 0.016% 100.053% ( 4400, 6600 ] 53 0.003% 100.056% ( 6600, 9900 ] 6 0.000% 100.057% ( 9900, 14000 ] 2 0.000% 100.057% ( 14000, 22000 ] 2 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 761251 Average: 8.2770 StdDev: 68.27 Min: 1 Median: 2.8127 Max: 15836 Percentiles: P50: 2.81 P75: 3.91 P99: 137.36 P99.9: 442.80 P99.99: 723.22 ------------------------------------------------------ [ 0, 1 ] 11629 1.528% 1.528% ( 1, 2 ] 226231 29.718% 31.246% ###### ( 2, 3 ] 175674 23.077% 54.323% ##### ( 3, 4 ] 173527 22.795% 77.118% ##### ( 4, 6 ] 129958 17.072% 94.190% ### ( 6, 10 ] 20761 2.727% 96.917% # ( 10, 15 ] 5442 0.715% 97.632% ( 15, 22 ] 3314 0.435% 98.067% ( 22, 34 ] 171 0.022% 98.089% ( 34, 51 ] 84 0.011% 98.100% ( 51, 76 ] 45 0.006% 98.106% ( 76, 110 ] 3174 0.417% 98.523% ( 110, 170 ] 7958 1.045% 99.569% ( 170, 250 ] 1653 0.217% 99.786% ( 250, 380 ] 670 0.088% 99.874% ( 380, 580 ] 633 0.083% 99.957% ( 580, 870 ] 508 0.067% 100.024% ( 870, 1300 ] 292 0.038% 100.062% ( 1300, 1900 ] 146 0.019% 100.081% ( 1900, 2900 ] 44 0.006% 100.087% ( 2900, 4400 ] 70 0.009% 100.096% ( 4400, 6600 ] 20 0.003% 100.099% ( 6600, 9900 ] 3 0.000% 100.099% ( 14000, 22000 ] 1 0.000% 100.099% ** Level 3 read latency histogram (micros): Count: 859972 Average: 7.3953 StdDev: 76.78 Min: 1 Median: 1.9125 Max: 19094 Percentiles: P50: 1.91 P75: 3.10 P99: 110.80 P99.9: 361.84 P99.99: 571.88 ------------------------------------------------------ [ 0, 1 ] 33901 3.942% 3.942% # ( 1, 2 ] 434053 50.473% 54.415% ########## ( 2, 3 ] 167809 19.513% 73.928% #### ( 3, 4 ] 92463 10.752% 84.680% ## ( 4, 6 ] 98090 11.406% 96.086% ## ( 6, 10 ] 18894 2.197% 98.283% ( 10, 15 ] 3101 0.361% 98.644% ( 15, 22 ] 370 0.043% 98.687% ( 22, 34 ] 75 0.009% 98.696% ( 34, 51 ] 134 0.016% 98.711% ( 51, 76 ] 54 0.006% 98.718% ( 76, 110 ] 2348 0.273% 98.991% ( 110, 170 ] 6009 0.699% 99.689% ( 170, 250 ] 1263 0.147% 99.836% ( 250, 380 ] 637 0.074% 99.910% ( 380, 580 ] 714 0.083% 99.993% ( 580, 870 ] 638 0.074% 100.068% ( 870, 1300 ] 454 0.053% 100.120% ( 1300, 1900 ] 205 0.024% 100.144% ( 1900, 2900 ] 116 0.013% 100.158% ( 2900, 4400 ] 94 0.011% 100.169% ( 4400, 6600 ] 20 0.002% 100.171% ( 6600, 9900 ] 2 0.000% 100.171% ( 9900, 14000 ] 2 0.000% 100.171% ( 14000, 22000 ] 2 0.000% 100.172% ** Level 4 read latency histogram (micros): Count: 652283 Average: 30.9854 StdDev: 148.34 Min: 1 Median: 2.0924 Max: 15766 Percentiles: P50: 2.09 P75: 4.12 P99: 379.55 P99.9: 1226.28 P99.99: 1709.67 ------------------------------------------------------ [ 0, 1 ] 25113 3.850% 3.850% # ( 1, 2 ] 290903 44.598% 48.448% ######### ( 2, 3 ] 109552 16.795% 65.243% ### ( 3, 4 ] 59791 9.166% 74.409% ## ( 4, 6 ] 62975 9.655% 84.064% ## ( 6, 10 ] 15721 2.410% 86.474% ( 10, 15 ] 3286 0.504% 86.978% ( 15, 22 ] 354 0.054% 87.032% ( 22, 34 ] 76 0.012% 87.044% ( 34, 51 ] 127 0.019% 87.063% ( 51, 76 ] 67 0.010% 87.073% ( 76, 110 ] 17169 2.632% 89.706% # ( 110, 170 ] 47575 7.294% 96.999% # ( 170, 250 ] 9651 1.480% 98.479% ( 250, 380 ] 3412 0.523% 99.002% ( 380, 580 ] 2954 0.453% 99.455% ( 580, 870 ] 1932 0.296% 99.751% ( 870, 1300 ] 1174 0.180% 99.931% ( 1300, 1900 ] 565 0.087% 100.017% ( 1900, 2900 ] 392 0.060% 100.078% ( 2900, 4400 ] 300 0.046% 100.124% ( 4400, 6600 ] 77 0.012% 100.135% ( 6600, 9900 ] 5 0.001% 100.136% ( 9900, 14000 ] 3 0.000% 100.137% ( 14000, 22000 ] 1 0.000% 100.137% ** Level 5 read latency histogram (micros): Count: 651252 Average: 185.0391 StdDev: 276.82 Min: 73 Median: 139.6651 Max: 35922 Percentiles: P50: 139.67 P75: 165.52 P99: 1162.84 P99.9: 4063.72 P99.99: 6386.11 ------------------------------------------------------ ( 51, 76 ] 82 0.013% 0.013% ( 76, 110 ] 138754 21.306% 21.318% #### ( 110, 170 ] 377797 58.011% 79.329% ############ ( 170, 250 ] 74024 11.366% 90.696% ## ( 250, 380 ] 23317 3.580% 94.276% # ( 380, 580 ] 18384 2.823% 97.099% # ( 580, 870 ] 9321 1.431% 98.530% ( 870, 1300 ] 4494 0.690% 99.220% ( 1300, 1900 ] 2045 0.314% 99.534% ( 1900, 2900 ] 1451 0.223% 99.757% ( 2900, 4400 ] 1201 0.184% 99.941% ( 4400, 6600 ] 351 0.054% 99.995% ( 6600, 9900 ] 36 0.006% 100.001% ( 9900, 14000 ] 3 0.000% 100.001% ( 14000, 22000 ] 3 0.000% 100.002% ( 33000, 50000 ] 3 0.000% 100.002% ** DB Stats ** Uptime(secs): 46.0 total, 37.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 64.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:33.808 H:M:S, 73.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 26.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:33.149 H:M:S, 87.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 227.684 micros/op 17547 ops/sec 60.122 seconds 1054996 operations; 17.0 MB/s (263999 of 263999 found) Microseconds per read: Count: 1054996 Average: 227.6873 StdDev: 504.67 Min: 2 Median: 171.8490 Max: 63370 Percentiles: P50: 171.85 P75: 232.27 P99: 989.94 P99.9: 5851.28 P99.99: 22442.58 ------------------------------------------------------ ( 1, 2 ] 5 0.000% 0.000% ( 2, 3 ] 37 0.004% 0.004% ( 3, 4 ] 45 0.004% 0.008% ( 4, 6 ] 72 0.007% 0.015% ( 6, 10 ] 287 0.027% 0.042% ( 10, 15 ] 1660 0.157% 0.200% ( 15, 22 ] 2741 0.260% 0.459% ( 22, 34 ] 6598 0.625% 1.085% ( 34, 51 ] 2434 0.231% 1.316% ( 51, 76 ] 289 0.027% 1.343% ( 76, 110 ] 22588 2.141% 3.484% ( 110, 170 ] 482671 45.751% 49.235% ######### ( 170, 250 ] 349211 33.101% 82.336% ####### ( 250, 380 ] 109371 10.367% 92.703% ## ( 380, 580 ] 46303 4.389% 97.092% # ( 580, 870 ] 18246 1.729% 98.821% ( 870, 1300 ] 6769 0.642% 99.463% ( 1300, 1900 ] 2226 0.211% 99.674% ( 1900, 2900 ] 1164 0.110% 99.784% ( 2900, 4400 ] 910 0.086% 99.870% ( 4400, 6600 ] 476 0.045% 99.915% ( 6600, 9900 ] 325 0.031% 99.946% ( 9900, 14000 ] 224 0.021% 99.967% ( 14000, 22000 ] 235 0.022% 99.990% ( 22000, 33000 ] 87 0.008% 99.998% ( 33000, 50000 ] 17 0.002% 100.000% ( 50000, 75000 ] 5 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12963709 rocksdb.bloom.filter.full.positive COUNT : 1180636 rocksdb.bloom.filter.full.true.positive COUNT : 1054586 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 410 rocksdb.memtable.miss COUNT : 1054586 rocksdb.l0.hit COUNT : 42695 rocksdb.l1.hit COUNT : 17074 rocksdb.l2andup.hit COUNT : 994817 rocksdb.compaction.key.drop.new COUNT : 184629 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3910354 rocksdb.number.keys.read COUNT : 1054996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4035485328 rocksdb.bytes.read COUNT : 1054996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1554 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44439716 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19258127730 rocksdb.compact.write.bytes COUNT : 19062891287 rocksdb.flush.write.bytes COUNT : 4029739217 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 51 rocksdb.number.superversion_acquires COUNT : 779 rocksdb.number.superversion_releases COUNT : 740 rocksdb.number.superversion_cleanups COUNT : 192 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 93 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3996974080 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1309696 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23962646249 rocksdb.non.last.level.read.count COUNT : 5645955 rocksdb.block.checksum.compute.count COUNT : 5854164 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 169.983579 P95 : 483.338050 P99 : 988.561696 P100 : 63367.000000 COUNT : 1054996 SUM : 239164346 rocksdb.db.write.micros P50 : 1.593891 P95 : 5.194477 P99 : 17.082637 P100 : 438142.000000 COUNT : 3910354 SUM : 54722778 rocksdb.compaction.times.micros P50 : 1149629.629630 P95 : 4410000.000000 P99 : 39720000.000000 P100 : 40046553.000000 COUNT : 58 SUM : 115677186 rocksdb.compaction.times.cpu_micros P50 : 977241.379310 P95 : 4410000.000000 P99 : 24253190.000000 P100 : 24253190.000000 COUNT : 58 SUM : 84771681 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 797.500000 P95 : 3687.500000 P99 : 118617.000000 P100 : 118617.000000 COUNT : 59 SUM : 241940 rocksdb.compaction.outfile.sync.micros P50 : 3483.333333 P95 : 74562.500000 P99 : 132600.000000 P100 : 137677.000000 COUNT : 187 SUM : 3514204 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 162.653061 P95 : 1708.000000 P99 : 3740.000000 P100 : 3984.000000 COUNT : 132 SUM : 57594 rocksdb.table.open.io.micros P50 : 5967.632850 P95 : 15983.673469 P99 : 21057.959184 P100 : 58652.000000 COUNT : 1554 SUM : 10469909 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.848504 P95 : 13.480237 P99 : 192.086260 P100 : 30601.000000 COUNT : 4662660 SUM : 64905666 rocksdb.read.block.get.micros P50 : 142.268726 P95 : 370.351817 P99 : 865.354784 P100 : 35926.000000 COUNT : 1189930 SUM : 206821928 rocksdb.write.raw.block.micros P50 : 0.544738 P95 : 1.532138 P99 : 3.649039 P100 : 32963.000000 COUNT : 5593002 SUM : 12510382 rocksdb.numfiles.in.singlecompaction P50 : 3.057143 P95 : 4.800000 P99 : 19.340000 P100 : 22.000000 COUNT : 76 SUM : 292 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568406 P95 : 1213.675710 P99 : 2600.129325 P100 : 437646.000000 COUNT : 268879 SUM : 44466534 rocksdb.sst.read.micros P50 : 2.031885 P95 : 170.854913 P99 : 466.025624 P100 : 35922.000000 COUNT : 5645995 SUM : 254027656 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1054996 SUM : 1054996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3910354 SUM : 4035485328 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 216274.509804 P95 : 477375.000000 P99 : 629778.000000 P100 : 629778.000000 COUNT : 59 SUM : 13494976 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 211 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0