[2024-11-04 12:59:56.452351] Starting SPDK v25.01-pre git sha1 608267194 / DPDK 24.03.0 initialization... [2024-11-04 12:59:56.452459] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid815959 ] Set seed to 1730721596449887 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-04 12:59:56.567588] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-04 12:59:56.669062] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-04 12:59:56.669114] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 815959' to capture a snapshot of events at runtime. [2024-11-04 12:59:56.669124] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-04 12:59:56.669134] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-04 12:59:56.669142] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid815959 for offline analysis/debug. [2024-11-04 12:59:56.670527] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 4 13:00:02 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/04-13:00:09 ... thread 0: (1000000,1000000) ops and (136573.4,136573.4) ops/second in (7.322068,7.322068) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 1.61 GB 18.8 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 130.6 6.74 2.63 10 0.674 0 0 0.0 0.0 L1 7/7 670.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 28/9 1.60 GB 1.0 3.5 2.8 0.7 3.4 2.7 0.0 1.2 107.0 103.5 33.84 16.99 10 3.384 908K 0 0.0 0.0 L4 151/19 11.15 GB 1.0 2.5 1.7 0.8 2.4 1.6 0.4 1.4 127.6 119.9 20.44 12.32 12 1.703 1671K 3558 0.0 0.0 L5 124/0 10.15 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 326/49 25.17 GB 0.0 6.1 4.5 1.5 6.7 5.1 0.7 7.8 102.1 112.0 61.01 31.94 32 1.907 2580K 3558 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 4.5 1.5 6.7 5.1 0.7 7.8 102.1 112.0 61.01 31.94 32 1.907 2580K 3558 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 4.5 1.5 5.8 4.3 0.0 0.0 114.8 109.7 54.28 29.31 22 2.467 2580K 3558 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 130.6 6.74 2.63 10 0.674 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.4 total, 7.3 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.67 GB write, 920.21 MB/s write, 6.08 GB read, 838.82 MB/s read, 61.0 seconds Interval compaction: 6.67 GB write, 933.04 MB/s write, 6.08 GB read, 850.51 MB/s read, 61.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 76055 Average: 163.8665 StdDev: 733.53 Min: 1 Median: 2.2146 Max: 61617 Percentiles: P50: 2.21 P75: 3.84 P99: 3389.51 P99.9: 6261.76 P99.99: 12664.68 ------------------------------------------------------ [ 0, 1 ] 1824 2.398% 2.398% ( 1, 2 ] 32343 42.526% 44.924% ######### ( 2, 3 ] 17991 23.655% 68.579% ##### ( 3, 4 ] 5821 7.654% 76.233% ## ( 4, 6 ] 6583 8.656% 84.889% ## ( 6, 10 ] 1833 2.410% 87.299% ( 10, 15 ] 399 0.525% 87.823% ( 15, 22 ] 60 0.079% 87.902% ( 22, 34 ] 10 0.013% 87.915% ( 34, 51 ] 2 0.003% 87.918% ( 51, 76 ] 3 0.004% 87.922% ( 76, 110 ] 10 0.013% 87.935% ( 110, 170 ] 47 0.062% 87.997% ( 170, 250 ] 243 0.320% 88.316% ( 250, 380 ] 612 0.805% 89.121% ( 380, 580 ] 1344 1.767% 90.888% ( 580, 870 ] 2199 2.891% 93.780% # ( 870, 1300 ] 2048 2.693% 96.472% # ( 1300, 1900 ] 1006 1.323% 97.795% ( 1900, 2900 ] 673 0.885% 98.680% ( 2900, 4400 ] 746 0.981% 99.661% ( 4400, 6600 ] 215 0.283% 99.943% ( 6600, 9900 ] 30 0.039% 99.983% ( 9900, 14000 ] 8 0.011% 99.993% ( 14000, 22000 ] 3 0.004% 99.997% ( 22000, 33000 ] 4 0.005% 100.003% ( 33000, 50000 ] 2 0.003% 100.005% ( 50000, 75000 ] 2 0.003% 100.008% ** Level 1 read latency histogram (micros): Count: 542 Average: 1501.2122 StdDev: 1716.08 Min: 55 Median: 951.0656 Max: 14135 Percentiles: P50: 951.07 P75: 1698.18 P99: 10375.60 P99.9: 14135.00 P99.99: 14135.00 ------------------------------------------------------ ( 51, 76 ] 2 0.369% 0.369% ( 110, 170 ] 3 0.554% 0.923% ( 170, 250 ] 14 2.583% 3.506% # ( 250, 380 ] 34 6.273% 9.779% # ( 380, 580 ] 80 14.760% 24.539% ### ( 580, 870 ] 115 21.218% 45.756% #### ( 870, 1300 ] 122 22.509% 68.266% ##### ( 1300, 1900 ] 55 10.148% 78.413% ## ( 1900, 2900 ] 43 7.934% 86.347% ## ( 2900, 4400 ] 48 8.856% 95.203% ## ( 4400, 6600 ] 18 3.321% 98.524% # ( 6600, 9900 ] 2 0.369% 98.893% ( 9900, 14000 ] 5 0.923% 99.815% ( 14000, 22000 ] 1 0.185% 100.000% ** Level 2 read latency histogram (micros): Count: 536794 Average: 16.7894 StdDev: 204.95 Min: 1 Median: 2.1479 Max: 10522 Percentiles: P50: 2.15 P75: 3.07 P99: 11.77 P99.9: 1345.85 P99.99: 1941.89 ------------------------------------------------------ [ 0, 1 ] 6483 1.208% 1.208% ( 1, 2 ] 239231 44.567% 45.774% ######### ( 2, 3 ] 153324 28.563% 74.337% ###### ( 3, 4 ] 54256 10.107% 84.445% ## ( 4, 6 ] 61814 11.515% 95.960% ## ( 6, 10 ] 15225 2.836% 98.796% # ( 10, 15 ] 3082 0.574% 99.371% ( 15, 22 ] 511 0.095% 99.466% ( 22, 34 ] 42 0.008% 99.474% ( 34, 51 ] 39 0.007% 99.481% ( 51, 76 ] 42 0.008% 99.489% ( 76, 110 ] 13 0.002% 99.491% ( 110, 170 ] 27 0.005% 99.496% ( 170, 250 ] 78 0.015% 99.511% ( 250, 380 ] 227 0.042% 99.553% ( 380, 580 ] 482 0.090% 99.643% ( 580, 870 ] 656 0.122% 99.765% ( 870, 1300 ] 687 0.128% 99.893% ( 1300, 1900 ] 500 0.093% 99.986% ( 1900, 2900 ] 509 0.095% 100.081% ( 2900, 4400 ] 704 0.131% 100.212% ( 4400, 6600 ] 191 0.036% 100.248% ( 6600, 9900 ] 49 0.009% 100.257% ( 9900, 14000 ] 3 0.001% 100.257% ** Level 3 read latency histogram (micros): Count: 624287 Average: 16.4203 StdDev: 257.99 Min: 1 Median: 2.1589 Max: 68970 Percentiles: P50: 2.16 P75: 2.99 P99: 12.71 P99.9: 1330.34 P99.99: 1851.38 ------------------------------------------------------ [ 0, 1 ] 6751 1.081% 1.081% ( 1, 2 ] 275685 44.160% 45.241% ######### ( 2, 3 ] 186987 29.952% 75.193% ###### ( 3, 4 ] 61664 9.878% 85.071% ## ( 4, 6 ] 68448 10.964% 96.035% ## ( 6, 10 ] 16949 2.715% 98.750% # ( 10, 15 ] 2883 0.462% 99.212% ( 15, 22 ] 369 0.059% 99.271% ( 22, 34 ] 48 0.008% 99.279% ( 34, 51 ] 51 0.008% 99.287% ( 51, 76 ] 62 0.010% 99.297% ( 76, 110 ] 21 0.003% 99.300% ( 110, 170 ] 39 0.006% 99.306% ( 170, 250 ] 160 0.026% 99.332% ( 250, 380 ] 372 0.060% 99.392% ( 380, 580 ] 828 0.133% 99.524% ( 580, 870 ] 1187 0.190% 99.714% ( 870, 1300 ] 1127 0.181% 99.895% ( 1300, 1900 ] 647 0.104% 99.999% ( 1900, 2900 ] 555 0.089% 100.087% ( 2900, 4400 ] 551 0.088% 100.176% ( 4400, 6600 ] 109 0.017% 100.193% ( 6600, 9900 ] 28 0.004% 100.198% ( 9900, 14000 ] 18 0.003% 100.201% ( 14000, 22000 ] 12 0.002% 100.202% ( 22000, 33000 ] 2 0.000% 100.203% ( 33000, 50000 ] 3 0.000% 100.203% ( 50000, 75000 ] 3 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 345075 Average: 42.4626 StdDev: 408.05 Min: 1 Median: 2.1266 Max: 72448 Percentiles: P50: 2.13 P75: 3.06 P99: 1101.75 P99.9: 3575.82 P99.99: 4065.17 ------------------------------------------------------ [ 0, 1 ] 4860 1.408% 1.408% ( 1, 2 ] 155450 45.048% 46.457% ######### ( 2, 3 ] 96590 27.991% 74.448% ###### ( 3, 4 ] 33006 9.565% 84.012% ## ( 4, 6 ] 35907 10.406% 94.418% ## ( 6, 10 ] 8743 2.534% 96.952% # ( 10, 15 ] 1453 0.421% 97.373% ( 15, 22 ] 169 0.049% 97.422% ( 22, 34 ] 31 0.009% 97.431% ( 34, 51 ] 46 0.013% 97.444% ( 51, 76 ] 39 0.011% 97.455% ( 76, 110 ] 14 0.004% 97.459% ( 110, 170 ] 65 0.019% 97.478% ( 170, 250 ] 227 0.066% 97.544% ( 250, 380 ] 627 0.182% 97.726% ( 380, 580 ] 1331 0.386% 98.111% ( 580, 870 ] 2048 0.593% 98.705% ( 870, 1300 ] 1893 0.549% 99.253% ( 1300, 1900 ] 1038 0.301% 99.554% ( 1900, 2900 ] 766 0.222% 99.776% ( 2900, 4400 ] 952 0.276% 100.052% ( 4400, 6600 ] 273 0.079% 100.131% ( 6600, 9900 ] 49 0.014% 100.145% ( 9900, 14000 ] 11 0.003% 100.149% ( 14000, 22000 ] 2 0.001% 100.149% ( 22000, 33000 ] 6 0.002% 100.151% ( 33000, 50000 ] 1 0.000% 100.151% ( 50000, 75000 ] 4 0.001% 100.152% ** Level 5 read latency histogram (micros): Count: 6562 Average: 1516.5949 StdDev: 1808.84 Min: 93 Median: 984.2340 Max: 68962 Percentiles: P50: 984.23 P75: 1823.53 P99: 6906.10 P99.9: 22803.00 P99.99: 58595.00 ------------------------------------------------------ ( 76, 110 ] 3 0.046% 0.046% ( 110, 170 ] 40 0.610% 0.655% ( 170, 250 ] 147 2.240% 2.895% ( 250, 380 ] 414 6.309% 9.205% # ( 380, 580 ] 920 14.020% 23.225% ### ( 580, 870 ] 1405 21.411% 44.636% #### ( 870, 1300 ] 1325 20.192% 64.828% #### ( 1300, 1900 ] 765 11.658% 76.486% ## ( 1900, 2900 ] 551 8.397% 84.883% ## ( 2900, 4400 ] 668 10.180% 95.062% ## ( 4400, 6600 ] 253 3.856% 98.918% # ( 6600, 9900 ] 58 0.884% 99.802% ( 9900, 14000 ] 3 0.046% 99.848% ( 14000, 22000 ] 3 0.046% 99.893% ( 22000, 33000 ] 6 0.091% 99.985% ( 50000, 75000 ] 1 0.015% 100.000% ** DB Stats ** Uptime(secs): 7.4 total, 7.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 132.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.489 H:M:S, 47.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 134.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.489 H:M:S, 47.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/04-13:00:14 ... thread 0: (1000000,2000000) ops and (221405.2,168937.8) ops/second in (4.516606,11.838674) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.58 GB 162.5 1.5 0.0 1.5 3.4 1.8 0.0 1.8 66.7 146.4 23.55 11.81 30 0.785 1596K 9212 0.0 0.0 L1 7/7 670.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 951.86 MB 1.0 3.5 2.8 0.7 3.4 2.7 0.0 1.2 107.0 103.5 33.84 16.99 10 3.384 908K 0 0.0 0.0 L4 139/0 9.68 GB 1.0 4.7 2.3 2.4 4.2 1.8 0.4 1.8 136.6 122.0 35.22 21.63 19 1.854 2374K 10K 0.0 0.0 L5 148/0 11.95 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 328/17 25.79 GB 0.0 9.8 5.2 4.6 11.0 6.4 2.5 6.0 108.0 121.5 92.62 50.43 59 1.570 4879K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.8 5.2 4.6 11.0 6.4 2.5 6.0 108.0 121.5 92.62 50.43 59 1.570 4879K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.8 5.2 4.6 9.1 4.5 0.0 0.0 122.2 114.3 81.89 45.00 34 2.409 4879K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 175.9 10.73 5.43 25 0.429 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.9 total, 11.8 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.99 GB write, 941.91 MB/s write, 9.77 GB read, 837.73 MB/s read, 92.6 seconds Interval compaction: 10.99 GB write, 950.04 MB/s write, 9.77 GB read, 844.96 MB/s read, 92.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 30, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 510558 Average: 45.6295 StdDev: 355.10 Min: 1 Median: 1.7108 Max: 61617 Percentiles: P50: 1.71 P75: 2.53 P99: 1071.11 P99.9: 3547.55 P99.99: 4200.87 ------------------------------------------------------ [ 0, 1 ] 53258 10.431% 10.431% ## ( 1, 2 ] 284209 55.666% 66.098% ########### ( 2, 3 ] 85335 16.714% 82.812% ### ( 3, 4 ] 25522 4.999% 87.811% # ( 4, 6 ] 23455 4.594% 92.405% # ( 6, 10 ] 7318 1.433% 93.838% ( 10, 15 ] 949 0.186% 94.024% ( 15, 22 ] 138 0.027% 94.051% ( 22, 34 ] 16 0.003% 94.054% ( 34, 51 ] 8 0.002% 94.056% ( 51, 76 ] 8 0.002% 94.057% ( 76, 110 ] 473 0.093% 94.150% ( 110, 170 ] 5599 1.097% 95.246% ( 170, 250 ] 6255 1.225% 96.472% ( 250, 380 ] 3657 0.716% 97.188% ( 380, 580 ] 3761 0.737% 97.924% ( 580, 870 ] 4007 0.785% 98.709% ( 870, 1300 ] 3176 0.622% 99.331% ( 1300, 1900 ] 1507 0.295% 99.626% ( 1900, 2900 ] 942 0.185% 99.811% ( 2900, 4400 ] 1055 0.207% 100.018% ( 4400, 6600 ] 273 0.053% 100.071% ( 6600, 9900 ] 38 0.007% 100.079% ( 9900, 14000 ] 13 0.003% 100.081% ( 14000, 22000 ] 13 0.003% 100.084% ( 22000, 33000 ] 9 0.002% 100.085% ( 33000, 50000 ] 4 0.001% 100.086% ( 50000, 75000 ] 2 0.000% 100.087% ** Level 1 read latency histogram (micros): Count: 1828 Average: 686.9830 StdDev: 1191.63 Min: 55 Median: 291.4595 Max: 17581 Percentiles: P50: 291.46 P75: 738.84 P99: 5525.47 P99.9: 14688.00 P99.99: 17581.00 ------------------------------------------------------ ( 51, 76 ] 2 0.109% 0.109% ( 76, 110 ] 48 2.626% 2.735% # ( 110, 170 ] 399 21.827% 24.562% #### ( 170, 250 ] 406 22.210% 46.772% #### ( 250, 380 ] 185 10.120% 56.893% ## ( 380, 580 ] 222 12.144% 69.037% ## ( 580, 870 ] 199 10.886% 79.923% ## ( 870, 1300 ] 162 8.862% 88.786% ## ( 1300, 1900 ] 72 3.939% 92.724% # ( 1900, 2900 ] 52 2.845% 95.569% # ( 2900, 4400 ] 53 2.899% 98.468% # ( 4400, 6600 ] 19 1.039% 99.508% ( 6600, 9900 ] 2 0.109% 99.617% ( 9900, 14000 ] 5 0.274% 99.891% ( 14000, 22000 ] 2 0.109% 100.000% ** Level 2 read latency histogram (micros): Count: 536794 Average: 16.7894 StdDev: 204.95 Min: 1 Median: 2.1479 Max: 10522 Percentiles: P50: 2.15 P75: 3.07 P99: 11.77 P99.9: 1345.85 P99.99: 1941.89 ------------------------------------------------------ [ 0, 1 ] 6483 1.208% 1.208% ( 1, 2 ] 239231 44.567% 45.774% ######### ( 2, 3 ] 153324 28.563% 74.337% ###### ( 3, 4 ] 54256 10.107% 84.445% ## ( 4, 6 ] 61814 11.515% 95.960% ## ( 6, 10 ] 15225 2.836% 98.796% # ( 10, 15 ] 3082 0.574% 99.371% ( 15, 22 ] 511 0.095% 99.466% ( 22, 34 ] 42 0.008% 99.474% ( 34, 51 ] 39 0.007% 99.481% ( 51, 76 ] 42 0.008% 99.489% ( 76, 110 ] 13 0.002% 99.491% ( 110, 170 ] 27 0.005% 99.496% ( 170, 250 ] 78 0.015% 99.511% ( 250, 380 ] 227 0.042% 99.553% ( 380, 580 ] 482 0.090% 99.643% ( 580, 870 ] 656 0.122% 99.765% ( 870, 1300 ] 687 0.128% 99.893% ( 1300, 1900 ] 500 0.093% 99.986% ( 1900, 2900 ] 509 0.095% 100.081% ( 2900, 4400 ] 704 0.131% 100.212% ( 4400, 6600 ] 191 0.036% 100.248% ( 6600, 9900 ] 49 0.009% 100.257% ( 9900, 14000 ] 3 0.001% 100.257% ** Level 3 read latency histogram (micros): Count: 690213 Average: 17.2351 StdDev: 265.33 Min: 1 Median: 2.1633 Max: 68970 Percentiles: P50: 2.16 P75: 3.01 P99: 131.18 P99.9: 1356.05 P99.99: 1877.32 ------------------------------------------------------ [ 0, 1 ] 7729 1.120% 1.120% ( 1, 2 ] 303866 44.025% 45.145% ######### ( 2, 3 ] 205170 29.726% 74.870% ###### ( 3, 4 ] 68304 9.896% 84.766% ## ( 4, 6 ] 75395 10.923% 95.690% ## ( 6, 10 ] 18716 2.712% 98.402% # ( 10, 15 ] 3143 0.455% 98.857% ( 15, 22 ] 401 0.058% 98.915% ( 22, 34 ] 52 0.008% 98.923% ( 34, 51 ] 54 0.008% 98.930% ( 51, 76 ] 71 0.010% 98.941% ( 76, 110 ] 118 0.017% 98.958% ( 110, 170 ] 827 0.120% 99.078% ( 170, 250 ] 947 0.137% 99.215% ( 250, 380 ] 754 0.109% 99.324% ( 380, 580 ] 1154 0.167% 99.491% ( 580, 870 ] 1466 0.212% 99.704% ( 870, 1300 ] 1289 0.187% 99.890% ( 1300, 1900 ] 715 0.104% 99.994% ( 1900, 2900 ] 583 0.084% 100.078% ( 2900, 4400 ] 577 0.084% 100.162% ( 4400, 6600 ] 115 0.017% 100.179% ( 6600, 9900 ] 29 0.004% 100.183% ( 9900, 14000 ] 20 0.003% 100.186% ( 14000, 22000 ] 18 0.003% 100.188% ( 22000, 33000 ] 4 0.001% 100.189% ( 33000, 50000 ] 4 0.001% 100.190% ( 50000, 75000 ] 3 0.000% 100.190% ** Level 4 read latency histogram (micros): Count: 637059 Average: 38.0217 StdDev: 356.69 Min: 1 Median: 2.1890 Max: 72448 Percentiles: P50: 2.19 P75: 3.25 P99: 806.63 P99.9: 2635.90 P99.99: 3265.64 ------------------------------------------------------ [ 0, 1 ] 8370 1.314% 1.314% ( 1, 2 ] 276684 43.431% 44.745% ######### ( 2, 3 ] 177161 27.809% 72.555% ###### ( 3, 4 ] 62275 9.775% 82.330% ## ( 4, 6 ] 65704 10.314% 92.644% ## ( 6, 10 ] 16110 2.529% 95.172% # ( 10, 15 ] 2743 0.431% 95.603% ( 15, 22 ] 315 0.049% 95.652% ( 22, 34 ] 53 0.008% 95.661% ( 34, 51 ] 73 0.011% 95.672% ( 51, 76 ] 69 0.011% 95.683% ( 76, 110 ] 537 0.084% 95.767% ( 110, 170 ] 5563 0.873% 96.640% ( 170, 250 ] 5686 0.893% 97.533% ( 250, 380 ] 3170 0.498% 98.031% ( 380, 580 ] 3405 0.534% 98.565% ( 580, 870 ] 3545 0.556% 99.122% ( 870, 1300 ] 2752 0.432% 99.554% ( 1300, 1900 ] 1421 0.223% 99.777% ( 1900, 2900 ] 1068 0.168% 99.944% ( 2900, 4400 ] 1195 0.188% 100.132% ( 4400, 6600 ] 331 0.052% 100.184% ( 6600, 9900 ] 61 0.010% 100.193% ( 9900, 14000 ] 15 0.002% 100.196% ( 14000, 22000 ] 18 0.003% 100.199% ( 22000, 33000 ] 11 0.002% 100.200% ( 33000, 50000 ] 3 0.000% 100.201% ( 50000, 75000 ] 4 0.001% 100.201% ** Level 5 read latency histogram (micros): Count: 21260 Average: 714.3934 StdDev: 1254.57 Min: 85 Median: 310.9730 Max: 68962 Percentiles: P50: 310.97 P75: 772.17 P99: 5544.00 P99.9: 9734.49 P99.99: 32802.00 ------------------------------------------------------ ( 76, 110 ] 422 1.985% 1.985% ( 110, 170 ] 4592 21.599% 23.584% #### ( 170, 250 ] 4488 21.110% 44.694% #### ( 250, 380 ] 2405 11.312% 56.007% ## ( 380, 580 ] 2500 11.759% 67.766% ## ( 580, 870 ] 2321 10.917% 78.683% ## ( 870, 1300 ] 1804 8.485% 87.168% ## ( 1300, 1900 ] 949 4.464% 91.632% # ( 1900, 2900 ] 644 3.029% 94.661% # ( 2900, 4400 ] 782 3.678% 98.340% # ( 4400, 6600 ] 270 1.270% 99.610% ( 6600, 9900 ] 65 0.306% 99.915% ( 9900, 14000 ] 4 0.019% 99.934% ( 14000, 22000 ] 5 0.024% 99.958% ( 22000, 33000 ] 7 0.033% 99.991% ( 33000, 50000 ] 1 0.005% 99.995% ( 50000, 75000 ] 1 0.005% 100.000% ** DB Stats ** Uptime(secs): 11.9 total, 4.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 164.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.528 H:M:S, 37.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 217.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.040 H:M:S, 23.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/04-13:00:19 ... thread 0: (1000000,3000000) ops and (209164.9,180509.9) ops/second in (4.780916,16.619590) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 20/10 3.56 GB 262.7 2.5 0.0 2.5 5.3 2.8 0.0 1.9 84.3 178.4 30.59 18.27 50 0.612 2618K 14K 0.0 0.0 L1 7/7 670.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 951.86 MB 1.0 3.5 2.8 0.7 3.4 2.7 0.0 1.2 107.0 103.5 33.84 16.99 10 3.384 908K 0 0.0 0.0 L4 139/0 9.68 GB 1.0 4.7 2.3 2.4 4.2 1.8 0.4 1.8 136.6 122.0 35.22 21.63 19 1.854 2374K 10K 0.0 0.0 L5 148/0 11.95 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 332/17 26.77 GB 0.0 10.8 5.2 5.6 12.9 7.4 2.5 4.6 110.5 133.0 99.65 56.89 79 1.261 5901K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.8 5.2 5.6 12.9 7.4 2.5 4.6 110.5 133.0 99.65 56.89 79 1.261 5901K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.8 5.2 5.6 10.1 4.5 0.0 0.0 128.4 120.9 85.76 48.80 38 2.257 5901K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 208.2 13.90 8.09 41 0.339 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.7 total, 16.6 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.95 GB write, 792.72 MB/s write, 10.75 GB read, 658.43 MB/s read, 99.7 seconds Interval compaction: 12.95 GB write, 797.59 MB/s write, 10.75 GB read, 662.47 MB/s read, 99.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 30, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 841004 Average: 36.8459 StdDev: 281.06 Min: 0 Median: 1.6290 Max: 61617 Percentiles: P50: 1.63 P75: 2.33 P99: 747.68 P99.9: 2785.68 P99.99: 3811.43 ------------------------------------------------------ [ 0, 1 ] 126366 15.026% 15.026% ### ( 1, 2 ] 467624 55.603% 70.629% ########### ( 2, 3 ] 109951 13.074% 83.702% ### ( 3, 4 ] 33053 3.930% 87.633% # ( 4, 6 ] 29013 3.450% 91.082% # ( 6, 10 ] 8205 0.976% 92.058% ( 10, 15 ] 1217 0.145% 92.203% ( 15, 22 ] 170 0.020% 92.223% ( 22, 34 ] 17 0.002% 92.225% ( 34, 51 ] 9 0.001% 92.226% ( 51, 76 ] 8 0.001% 92.227% ( 76, 110 ] 2446 0.291% 92.518% ( 110, 170 ] 22216 2.642% 95.159% # ( 170, 250 ] 17467 2.077% 97.236% ( 250, 380 ] 6561 0.780% 98.017% ( 380, 580 ] 5620 0.668% 98.685% ( 580, 870 ] 4590 0.546% 99.231% ( 870, 1300 ] 3250 0.386% 99.617% ( 1300, 1900 ] 1523 0.181% 99.798% ( 1900, 2900 ] 971 0.115% 99.914% ( 2900, 4400 ] 1063 0.126% 100.040% ( 4400, 6600 ] 273 0.032% 100.072% ( 6600, 9900 ] 38 0.005% 100.077% ( 9900, 14000 ] 13 0.002% 100.078% ( 14000, 22000 ] 13 0.002% 100.080% ( 22000, 33000 ] 9 0.001% 100.081% ( 33000, 50000 ] 4 0.000% 100.082% ( 50000, 75000 ] 2 0.000% 100.082% ** Level 1 read latency histogram (micros): Count: 4049 Average: 421.0146 StdDev: 841.57 Min: 55 Median: 199.4942 Max: 17581 Percentiles: P50: 199.49 P75: 357.71 P99: 4053.06 P99.9: 12319.82 P99.99: 17581.00 ------------------------------------------------------ ( 51, 76 ] 2 0.049% 0.049% ( 76, 110 ] 128 3.161% 3.211% # ( 110, 170 ] 1479 36.528% 39.738% ####### ( 170, 250 ] 1127 27.834% 67.572% ###### ( 250, 380 ] 363 8.965% 76.537% ## ( 380, 580 ] 343 8.471% 85.009% ## ( 580, 870 ] 232 5.730% 90.738% # ( 870, 1300 ] 169 4.174% 94.912% # ( 1300, 1900 ] 72 1.778% 96.691% ( 1900, 2900 ] 52 1.284% 97.975% ( 2900, 4400 ] 54 1.334% 99.308% ( 4400, 6600 ] 19 0.469% 99.778% ( 6600, 9900 ] 2 0.049% 99.827% ( 9900, 14000 ] 5 0.123% 99.951% ( 14000, 22000 ] 2 0.049% 100.000% ** Level 2 read latency histogram (micros): Count: 536794 Average: 16.7894 StdDev: 204.95 Min: 1 Median: 2.1479 Max: 10522 Percentiles: P50: 2.15 P75: 3.07 P99: 11.77 P99.9: 1345.85 P99.99: 1941.89 ------------------------------------------------------ [ 0, 1 ] 6483 1.208% 1.208% ( 1, 2 ] 239231 44.567% 45.774% ######### ( 2, 3 ] 153324 28.563% 74.337% ###### ( 3, 4 ] 54256 10.107% 84.445% ## ( 4, 6 ] 61814 11.515% 95.960% ## ( 6, 10 ] 15225 2.836% 98.796% # ( 10, 15 ] 3082 0.574% 99.371% ( 15, 22 ] 511 0.095% 99.466% ( 22, 34 ] 42 0.008% 99.474% ( 34, 51 ] 39 0.007% 99.481% ( 51, 76 ] 42 0.008% 99.489% ( 76, 110 ] 13 0.002% 99.491% ( 110, 170 ] 27 0.005% 99.496% ( 170, 250 ] 78 0.015% 99.511% ( 250, 380 ] 227 0.042% 99.553% ( 380, 580 ] 482 0.090% 99.643% ( 580, 870 ] 656 0.122% 99.765% ( 870, 1300 ] 687 0.128% 99.893% ( 1300, 1900 ] 500 0.093% 99.986% ( 1900, 2900 ] 509 0.095% 100.081% ( 2900, 4400 ] 704 0.131% 100.212% ( 4400, 6600 ] 191 0.036% 100.248% ( 6600, 9900 ] 49 0.009% 100.257% ( 9900, 14000 ] 3 0.001% 100.257% ** Level 3 read latency histogram (micros): Count: 694791 Average: 18.4328 StdDev: 265.03 Min: 1 Median: 2.1745 Max: 68970 Percentiles: P50: 2.17 P75: 3.06 P99: 221.62 P99.9: 1355.41 P99.99: 1878.68 ------------------------------------------------------ [ 0, 1 ] 7729 1.112% 1.112% ( 1, 2 ] 303866 43.735% 44.847% ######### ( 2, 3 ] 205170 29.530% 74.377% ###### ( 3, 4 ] 68304 9.831% 84.208% ## ( 4, 6 ] 75395 10.851% 95.059% ## ( 6, 10 ] 18716 2.694% 97.753% # ( 10, 15 ] 3143 0.452% 98.206% ( 15, 22 ] 401 0.058% 98.263% ( 22, 34 ] 52 0.007% 98.271% ( 34, 51 ] 54 0.008% 98.278% ( 51, 76 ] 71 0.010% 98.289% ( 76, 110 ] 333 0.048% 98.337% ( 110, 170 ] 3058 0.440% 98.777% ( 170, 250 ] 2404 0.346% 99.123% ( 250, 380 ] 1106 0.159% 99.282% ( 380, 580 ] 1388 0.200% 99.482% ( 580, 870 ] 1545 0.222% 99.704% ( 870, 1300 ] 1295 0.186% 99.890% ( 1300, 1900 ] 717 0.103% 99.994% ( 1900, 2900 ] 585 0.084% 100.078% ( 2900, 4400 ] 577 0.083% 100.161% ( 4400, 6600 ] 115 0.017% 100.177% ( 6600, 9900 ] 29 0.004% 100.182% ( 9900, 14000 ] 20 0.003% 100.185% ( 14000, 22000 ] 18 0.003% 100.187% ( 22000, 33000 ] 4 0.001% 100.188% ( 33000, 50000 ] 4 0.001% 100.188% ( 50000, 75000 ] 3 0.000% 100.189% ** Level 4 read latency histogram (micros): Count: 669413 Average: 45.8737 StdDev: 350.86 Min: 1 Median: 2.2799 Max: 72448 Percentiles: P50: 2.28 P75: 3.64 P99: 799.53 P99.9: 2612.19 P99.99: 3264.43 ------------------------------------------------------ [ 0, 1 ] 8370 1.250% 1.250% ( 1, 2 ] 276711 41.336% 42.587% ######## ( 2, 3 ] 177274 26.482% 69.069% ##### ( 3, 4 ] 62386 9.320% 78.388% ## ( 4, 6 ] 65884 9.842% 88.230% ## ( 6, 10 ] 16132 2.410% 90.640% ( 10, 15 ] 2748 0.411% 91.051% ( 15, 22 ] 315 0.047% 91.098% ( 22, 34 ] 54 0.008% 91.106% ( 34, 51 ] 73 0.011% 91.117% ( 51, 76 ] 69 0.010% 91.127% ( 76, 110 ] 1894 0.283% 91.410% ( 110, 170 ] 20438 3.053% 94.463% # ( 170, 250 ] 16403 2.450% 96.913% ( 250, 380 ] 5722 0.855% 97.768% ( 380, 580 ] 5149 0.769% 98.537% ( 580, 870 ] 4091 0.611% 99.149% ( 870, 1300 ] 2826 0.422% 99.571% ( 1300, 1900 ] 1434 0.214% 99.785% ( 1900, 2900 ] 1082 0.162% 99.947% ( 2900, 4400 ] 1198 0.179% 100.125% ( 4400, 6600 ] 331 0.049% 100.175% ( 6600, 9900 ] 61 0.009% 100.184% ( 9900, 14000 ] 15 0.002% 100.186% ( 14000, 22000 ] 18 0.003% 100.189% ( 22000, 33000 ] 11 0.002% 100.191% ( 33000, 50000 ] 3 0.000% 100.191% ( 50000, 75000 ] 4 0.001% 100.192% ** Level 5 read latency histogram (micros): Count: 46281 Average: 437.7020 StdDev: 892.66 Min: 83 Median: 202.7713 Max: 68962 Percentiles: P50: 202.77 P75: 369.39 P99: 4189.37 P99.9: 8464.20 P99.99: 28870.13 ------------------------------------------------------ ( 76, 110 ] 1546 3.340% 3.340% # ( 110, 170 ] 16347 35.321% 38.662% ####### ( 170, 250 ] 12810 27.679% 66.340% ###### ( 250, 380 ] 4364 9.429% 75.770% ## ( 380, 580 ] 3855 8.330% 84.099% ## ( 580, 870 ] 2737 5.914% 90.013% # ( 870, 1300 ] 1871 4.043% 94.056% # ( 1300, 1900 ] 960 2.074% 96.130% ( 1900, 2900 ] 656 1.417% 97.548% ( 2900, 4400 ] 782 1.690% 99.237% ( 4400, 6600 ] 270 0.583% 99.821% ( 6600, 9900 ] 65 0.140% 99.961% ( 9900, 14000 ] 4 0.009% 99.970% ( 14000, 22000 ] 5 0.011% 99.981% ( 22000, 33000 ] 7 0.015% 99.996% ( 33000, 50000 ] 1 0.002% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 16.7 total, 4.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 176.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.810 H:M:S, 34.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.282 H:M:S, 26.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 426.661 micros/op 9359 ops/sec 20.193 seconds 188996 operations; 9.1 MB/s (46999 of 46999 found) Microseconds per read: Count: 188996 Average: 426.6850 StdDev: 1144.13 Min: 2 Median: 229.8502 Max: 72495 Percentiles: P50: 229.85 P75: 371.95 P99: 3822.40 P99.9: 18400.27 P99.99: 40804.85 ------------------------------------------------------ ( 1, 2 ] 5 0.003% 0.003% ( 2, 3 ] 33 0.017% 0.020% ( 3, 4 ] 59 0.031% 0.051% ( 4, 6 ] 159 0.084% 0.135% ( 6, 10 ] 306 0.162% 0.297% ( 10, 15 ] 1063 0.562% 0.860% ( 15, 22 ] 2661 1.408% 2.268% ( 22, 34 ] 4340 2.296% 4.564% ( 34, 51 ] 1801 0.953% 5.517% ( 51, 76 ] 240 0.127% 5.644% ( 76, 110 ] 191 0.101% 5.745% ( 110, 170 ] 27998 14.814% 20.559% ### ( 170, 250 ] 74375 39.353% 59.912% ######## ( 250, 380 ] 30399 16.084% 75.996% ### ( 380, 580 ] 19987 10.575% 86.572% ## ( 580, 870 ] 11095 5.870% 92.442% # ( 870, 1300 ] 6223 3.293% 95.735% # ( 1300, 1900 ] 2971 1.572% 97.307% ( 1900, 2900 ] 2004 1.060% 98.367% ( 2900, 4400 ] 1945 1.029% 99.396% ( 4400, 6600 ] 679 0.359% 99.756% ( 6600, 9900 ] 142 0.075% 99.831% ( 9900, 14000 ] 65 0.034% 99.865% ( 14000, 22000 ] 120 0.063% 99.929% ( 22000, 33000 ] 106 0.056% 99.985% ( 33000, 50000 ] 22 0.012% 99.996% ( 50000, 75000 ] 7 0.004% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3221586 rocksdb.bloom.filter.full.positive COUNT : 219552 rocksdb.bloom.filter.full.true.positive COUNT : 188231 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 765 rocksdb.memtable.miss COUNT : 188231 rocksdb.l0.hit COUNT : 26822 rocksdb.l1.hit COUNT : 5409 rocksdb.l2andup.hit COUNT : 156000 rocksdb.compaction.key.drop.new COUNT : 682340 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3398754 rocksdb.number.keys.read COUNT : 188996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3507514128 rocksdb.bytes.read COUNT : 188996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 478 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7951704 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13079939666 rocksdb.compact.write.bytes COUNT : 12371951511 rocksdb.flush.write.bytes COUNT : 3495256109 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 38 rocksdb.number.superversion_acquires COUNT : 610 rocksdb.number.superversion_releases COUNT : 585 rocksdb.number.superversion_cleanups COUNT : 150 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3472826368 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6635520 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 12920478279 rocksdb.non.last.level.read.count COUNT : 3091239 rocksdb.block.checksum.compute.count COUNT : 3391227 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 229.139750 P95 : 1203.064625 P99 : 3821.624679 P100 : 72493.000000 COUNT : 188996 SUM : 80448524 rocksdb.db.write.micros P50 : 1.489480 P95 : 3.931800 P99 : 5.974663 P100 : 918565.000000 COUNT : 3398754 SUM : 16082204 rocksdb.compaction.times.micros P50 : 2150000.000000 P95 : 4160000.000000 P99 : 5444031.000000 P100 : 5444031.000000 COUNT : 40 SUM : 87659924 rocksdb.compaction.times.cpu_micros P50 : 1333333.333333 P95 : 2233021.000000 P99 : 2233021.000000 P100 : 2233021.000000 COUNT : 40 SUM : 50665722 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1054.285714 P95 : 18266.666667 P99 : 141200.000000 P100 : 149226.000000 COUNT : 48 SUM : 288365 rocksdb.compaction.outfile.sync.micros P50 : 11003.846154 P95 : 149500.000000 P99 : 241800.000000 P100 : 263708.000000 COUNT : 141 SUM : 4636584 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 226.470588 P95 : 2450.000000 P99 : 4444.000000 P100 : 5738.000000 COUNT : 98 SUM : 55579 rocksdb.table.open.io.micros P50 : 8662.500000 P95 : 22888.461538 P99 : 30977.692308 P100 : 32761.000000 COUNT : 478 SUM : 4556441 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.036145 P95 : 9.729615 P99 : 274.107622 P100 : 68557.000000 COUNT : 3168461 SUM : 63090136 rocksdb.read.block.get.micros P50 : 186.825078 P95 : 1044.371712 P99 : 3466.366332 P100 : 72453.000000 COUNT : 222335 SUM : 72542771 rocksdb.write.raw.block.micros P50 : 0.526408 P95 : 1.005447 P99 : 3.486574 P100 : 66510.000000 COUNT : 3844875 SUM : 13025375 rocksdb.numfiles.in.singlecompaction P50 : 3.347222 P95 : 4.700000 P99 : 12.350000 P100 : 13.000000 COUNT : 53 SUM : 199 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566198 P95 : 1160.589729 P99 : 2378.613281 P100 : 918375.000000 COUNT : 27695 SUM : 7954544 rocksdb.sst.read.micros P50 : 1.955657 P95 : 181.109778 P99 : 763.196328 P100 : 72448.000000 COUNT : 3091365 SUM : 122626309 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 188996 SUM : 188996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3398754 SUM : 3507514128 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226470.588235 P95 : 928000.000000 P99 : 1131399.000000 P100 : 1131399.000000 COUNT : 48 SUM : 15323419 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 145 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0