[2024-11-18 08:37:07.773016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-11-18 08:37:07.773178] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid702556 ] Set seed to 1731915427769422 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-18 08:37:07.860132] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-18 08:37:07.900941] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-18 08:37:07.900995] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 702556' to capture a snapshot of events at runtime. [2024-11-18 08:37:07.901007] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid702556 for offline analysis/debug. [2024-11-18 08:37:07.901034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 18 08:37:12 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/18-08:37:22 ... thread 0: (1000000,1000000) ops and (100671.9,100671.9) ops/second in (9.933261,9.933261) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.46 GB 56.6 0.5 0.0 0.5 1.3 0.8 0.0 1.6 99.5 261.0 5.07 4.06 15 0.338 511K 481 0.0 0.0 L2 2/1 175.48 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/8 1.87 GB 1.2 1.9 1.8 0.1 1.9 1.8 0.0 1.1 224.5 223.7 8.61 8.03 1 8.605 1046K 0 0.0 0.0 L4 182/7 10.66 GB 1.1 1.0 0.9 0.0 0.9 0.9 0.0 1.0 135.7 135.4 7.18 4.71 10 0.718 951K 0 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1315/31 105.74 GB 0.0 3.3 2.7 0.7 4.1 3.5 0.0 5.2 163.5 202.3 20.86 16.80 26 0.802 2509K 481 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 2.7 0.7 4.1 3.5 0.0 5.2 163.5 202.3 20.86 16.80 26 0.802 2509K 481 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 2.7 0.7 3.3 2.7 0.0 0.0 192.9 192.3 17.68 14.59 13 1.360 2509K 481 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 258.0 3.17 2.21 13 0.244 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.1 total, 9.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.12 GB write, 418.13 MB/s write, 3.33 GB read, 337.96 MB/s read, 20.9 seconds Interval compaction: 4.12 GB write, 424.77 MB/s write, 3.33 GB read, 343.32 MB/s read, 20.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 1, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 319006 Average: 34.7342 StdDev: 217.98 Min: 1 Median: 1.8139 Max: 53293 Percentiles: P50: 1.81 P75: 3.49 P99: 458.48 P99.9: 1503.06 P99.99: 2875.92 ------------------------------------------------------ [ 0, 1 ] 33475 10.494% 10.494% ## ( 1, 2 ] 154855 48.543% 59.037% ########## ( 2, 3 ] 40812 12.793% 71.830% ### ( 3, 4 ] 20476 6.419% 78.249% # ( 4, 6 ] 18294 5.735% 83.983% # ( 6, 10 ] 5465 1.713% 85.697% ( 10, 15 ] 985 0.309% 86.005% ( 15, 22 ] 245 0.077% 86.082% ( 22, 34 ] 110 0.034% 86.117% ( 34, 51 ] 22 0.007% 86.123% ( 51, 76 ] 13 0.004% 86.128% ( 76, 110 ] 4859 1.523% 87.651% ( 110, 170 ] 22743 7.129% 94.780% # ( 170, 250 ] 9189 2.881% 97.661% # ( 250, 380 ] 3402 1.066% 98.727% ( 380, 580 ] 2222 0.697% 99.424% ( 580, 870 ] 1011 0.317% 99.740% ( 870, 1300 ] 444 0.139% 99.880% ( 1300, 1900 ] 195 0.061% 99.941% ( 1900, 2900 ] 162 0.051% 99.992% ( 2900, 4400 ] 100 0.031% 100.023% ( 4400, 6600 ] 47 0.015% 100.038% ( 6600, 9900 ] 17 0.005% 100.043% ( 9900, 14000 ] 4 0.001% 100.044% ( 22000, 33000 ] 1 0.000% 100.045% ( 33000, 50000 ] 3 0.001% 100.045% ( 50000, 75000 ] 1 0.000% 100.046% ** Level 2 read latency histogram (micros): Count: 465421 Average: 4.4868 StdDev: 66.11 Min: 1 Median: 1.4555 Max: 15784 Percentiles: P50: 1.46 P75: 1.87 P99: 11.79 P99.9: 399.49 P99.99: 1891.87 ------------------------------------------------------ [ 0, 1 ] 104889 22.536% 22.536% ##### ( 1, 2 ] 280616 60.293% 82.829% ############ ( 2, 3 ] 44850 9.636% 92.466% ## ( 3, 4 ] 13464 2.893% 95.359% # ( 4, 6 ] 8766 1.883% 97.242% ( 6, 10 ] 7815 1.679% 98.921% ( 10, 15 ] 1025 0.220% 99.141% ( 15, 22 ] 155 0.033% 99.175% ( 22, 34 ] 50 0.011% 99.185% ( 34, 51 ] 25 0.005% 99.191% ( 51, 76 ] 9 0.002% 99.193% ( 76, 110 ] 488 0.105% 99.298% ( 110, 170 ] 1774 0.381% 99.679% ( 170, 250 ] 692 0.149% 99.827% ( 250, 380 ] 314 0.067% 99.895% ( 380, 580 ] 242 0.052% 99.947% ( 580, 870 ] 120 0.026% 99.973% ( 870, 1300 ] 41 0.009% 99.982% ( 1300, 1900 ] 40 0.009% 99.990% ( 1900, 2900 ] 31 0.007% 99.997% ( 2900, 4400 ] 11 0.002% 99.999% ( 4400, 6600 ] 9 0.002% 100.001% ( 6600, 9900 ] 7 0.002% 100.003% ( 9900, 14000 ] 4 0.001% 100.003% ( 14000, 22000 ] 1 0.000% 100.004% ** Level 3 read latency histogram (micros): Count: 372529 Average: 5.4340 StdDev: 78.27 Min: 0 Median: 1.9005 Max: 13948 Percentiles: P50: 1.90 P75: 3.06 P99: 9.19 P99.9: 133.88 P99.99: 155.37 ------------------------------------------------------ [ 0, 1 ] 19792 5.313% 5.313% # ( 1, 2 ] 184863 49.624% 54.937% ########## ( 2, 3 ] 72238 19.391% 74.328% #### ( 3, 4 ] 42102 11.302% 85.630% ## ( 4, 6 ] 44384 11.914% 97.544% ## ( 6, 10 ] 6806 1.827% 99.371% ( 10, 15 ] 1123 0.301% 99.672% ( 15, 22 ] 112 0.030% 99.702% ( 22, 34 ] 27 0.007% 99.710% ( 34, 51 ] 48 0.013% 99.722% ( 51, 76 ] 41 0.011% 99.733% ( 76, 110 ] 251 0.067% 99.801% ( 110, 170 ] 936 0.251% 100.052% ( 170, 250 ] 416 0.112% 100.164% ( 250, 380 ] 182 0.049% 100.213% ( 380, 580 ] 133 0.036% 100.248% ( 580, 870 ] 79 0.021% 100.270% ( 870, 1300 ] 48 0.013% 100.282% ( 1300, 1900 ] 31 0.008% 100.291% ( 1900, 2900 ] 31 0.008% 100.299% ( 2900, 4400 ] 65 0.017% 100.316% ( 4400, 6600 ] 10 0.003% 100.319% ( 6600, 9900 ] 8 0.002% 100.321% ( 9900, 14000 ] 1 0.000% 100.322% ** Level 4 read latency histogram (micros): Count: 26203 Average: 184.3711 StdDev: 988.95 Min: 1 Median: 83.6884 Max: 58642 Percentiles: P50: 83.69 P75: 162.40 P99: 2354.36 P99.9: 6582.82 P99.99: 40181.86 ------------------------------------------------------ [ 0, 1 ] 503 1.920% 1.920% ( 1, 2 ] 6141 23.436% 25.356% ##### ( 2, 3 ] 2836 10.823% 36.179% ## ( 3, 4 ] 1706 6.511% 42.690% # ( 4, 6 ] 1180 4.503% 47.193% # ( 6, 10 ] 234 0.893% 48.086% ( 10, 15 ] 122 0.466% 48.552% ( 15, 22 ] 18 0.069% 48.620% ( 22, 34 ] 5 0.019% 48.639% ( 34, 51 ] 2 0.008% 48.647% ( 51, 76 ] 4 0.015% 48.662% ( 76, 110 ] 1550 5.915% 54.578% # ( 110, 170 ] 6127 23.383% 77.961% ##### ( 170, 250 ] 2533 9.667% 87.627% ## ( 250, 380 ] 1111 4.240% 91.867% # ( 380, 580 ] 824 3.145% 95.012% # ( 580, 870 ] 490 1.870% 96.882% ( 870, 1300 ] 294 1.122% 98.004% ( 1300, 1900 ] 186 0.710% 98.714% ( 1900, 2900 ] 165 0.630% 99.344% ( 2900, 4400 ] 120 0.458% 99.802% ( 4400, 6600 ] 26 0.099% 99.901% ( 6600, 9900 ] 10 0.038% 99.939% ( 9900, 14000 ] 2 0.008% 99.947% ( 14000, 22000 ] 3 0.011% 99.958% ( 22000, 33000 ] 5 0.019% 99.977% ( 33000, 50000 ] 8 0.031% 100.008% ( 50000, 75000 ] 1 0.004% 100.011% ** Level 5 read latency histogram (micros): Count: 99980 Average: 261.0824 StdDev: 472.04 Min: 76 Median: 155.7250 Max: 27536 Percentiles: P50: 155.73 P75: 224.79 P99: 2606.54 P99.9: 5603.19 P99.99: 9008.29 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 12621 12.624% 12.625% ### ( 110, 170 ] 49034 49.044% 61.668% ########## ( 170, 250 ] 19462 19.466% 81.134% #### ( 250, 380 ] 7723 7.725% 88.859% ## ( 380, 580 ] 5203 5.204% 94.063% # ( 580, 870 ] 2366 2.366% 96.429% ( 870, 1300 ] 1198 1.198% 97.628% ( 1300, 1900 ] 778 0.778% 98.406% ( 1900, 2900 ] 841 0.841% 99.247% ( 2900, 4400 ] 577 0.577% 99.824% ( 4400, 6600 ] 139 0.139% 99.963% ( 6600, 9900 ] 37 0.037% 100.000% ( 9900, 14000 ] 9 0.009% 100.009% ( 14000, 22000 ] 1 0.001% 100.010% ( 22000, 33000 ] 2 0.002% 100.012% ** DB Stats ** Uptime(secs): 10.1 total, 9.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 97.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.957 H:M:S, 59.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 99.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.957 H:M:S, 60.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/18-08:37:31 ... thread 0: (1000000,2000000) ops and (108118.3,104262.3) ops/second in (9.249132,19.182393) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 4.50 GB 162.8 2.9 0.0 2.9 4.7 1.8 0.0 2.6 163.7 267.7 18.08 16.10 36 0.502 3005K 9459 0.0 0.0 L3 13/0 928.90 MB 0.9 2.3 1.9 0.3 2.3 1.9 0.0 1.2 214.8 214.1 10.77 9.71 3 3.589 1277K 0 0.0 0.0 L4 167/0 9.52 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.1 1.0 147.9 147.5 13.95 9.57 21 0.664 2011K 0 0.0 0.0 L5 1116/0 91.84 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1313/15 106.77 GB 0.0 7.2 3.9 3.3 9.0 5.7 2.4 4.9 171.4 215.0 42.80 35.37 60 0.713 6294K 9459 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 3.9 3.3 9.0 5.7 2.4 4.9 171.4 215.0 42.80 35.37 60 0.713 6294K 9459 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 3.9 3.3 7.1 3.8 0.0 0.0 203.4 202.8 36.06 30.28 31 1.163 6294K 9459 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 280.5 6.74 5.09 29 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.3 total, 19.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.99 GB write, 475.81 MB/s write, 7.16 GB read, 379.24 MB/s read, 42.8 seconds Interval compaction: 8.99 GB write, 479.73 MB/s write, 7.16 GB read, 382.36 MB/s read, 42.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 15, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 996266 Average: 25.0692 StdDev: 139.26 Min: 0 Median: 1.5725 Max: 53293 Percentiles: P50: 1.57 P75: 2.36 P99: 356.58 P99.9: 830.30 P99.99: 1237.48 ------------------------------------------------------ [ 0, 1 ] 206542 20.732% 20.732% #### ( 1, 2 ] 509296 51.120% 71.852% ########## ( 2, 3 ] 87825 8.815% 80.668% ## ( 3, 4 ] 40361 4.051% 84.719% # ( 4, 6 ] 30674 3.079% 87.798% # ( 6, 10 ] 9289 0.932% 88.730% ( 10, 15 ] 1508 0.151% 88.881% ( 15, 22 ] 320 0.032% 88.914% ( 22, 34 ] 120 0.012% 88.926% ( 34, 51 ] 23 0.002% 88.928% ( 51, 76 ] 39 0.004% 88.932% ( 76, 110 ] 14998 1.505% 90.437% ( 110, 170 ] 56862 5.708% 96.145% # ( 170, 250 ] 21669 2.175% 98.320% ( 250, 380 ] 8268 0.830% 99.150% ( 380, 580 ] 5590 0.561% 99.711% ( 580, 870 ] 2186 0.219% 99.930% ( 870, 1300 ] 699 0.070% 100.000% ( 1300, 1900 ] 247 0.025% 100.025% ( 1900, 2900 ] 209 0.021% 100.046% ( 2900, 4400 ] 143 0.014% 100.060% ( 4400, 6600 ] 50 0.005% 100.065% ( 6600, 9900 ] 18 0.002% 100.067% ( 9900, 14000 ] 4 0.000% 100.068% ( 22000, 33000 ] 1 0.000% 100.068% ( 33000, 50000 ] 3 0.000% 100.068% ( 50000, 75000 ] 1 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 504945 Average: 4.4584 StdDev: 66.11 Min: 1 Median: 1.4710 Max: 15784 Percentiles: P50: 1.47 P75: 1.89 P99: 11.14 P99.9: 391.90 P99.99: 2061.93 ------------------------------------------------------ [ 0, 1 ] 109010 21.588% 21.588% #### ( 1, 2 ] 304568 60.317% 81.906% ############ ( 2, 3 ] 51020 10.104% 92.010% ## ( 3, 4 ] 15821 3.133% 95.143% # ( 4, 6 ] 10639 2.107% 97.250% ( 6, 10 ] 8568 1.697% 98.947% ( 10, 15 ] 1185 0.235% 99.181% ( 15, 22 ] 180 0.036% 99.217% ( 22, 34 ] 54 0.011% 99.228% ( 34, 51 ] 25 0.005% 99.233% ( 51, 76 ] 9 0.002% 99.234% ( 76, 110 ] 495 0.098% 99.332% ( 110, 170 ] 1819 0.360% 99.693% ( 170, 250 ] 710 0.141% 99.833% ( 250, 380 ] 322 0.064% 99.897% ( 380, 580 ] 253 0.050% 99.947% ( 580, 870 ] 126 0.025% 99.972% ( 870, 1300 ] 44 0.009% 99.981% ( 1300, 1900 ] 41 0.008% 99.989% ( 1900, 2900 ] 34 0.007% 99.996% ( 2900, 4400 ] 17 0.003% 99.999% ( 4400, 6600 ] 9 0.002% 100.001% ( 6600, 9900 ] 8 0.002% 100.002% ( 9900, 14000 ] 4 0.001% 100.003% ( 14000, 22000 ] 1 0.000% 100.003% ** Level 3 read latency histogram (micros): Count: 587597 Average: 5.2174 StdDev: 69.98 Min: 0 Median: 1.8579 Max: 14236 Percentiles: P50: 1.86 P75: 2.91 P99: 9.37 P99.9: 154.53 P99.99: 176.65 ------------------------------------------------------ [ 0, 1 ] 28837 4.908% 4.908% # ( 1, 2 ] 308857 52.563% 57.470% ########### ( 2, 3 ] 112688 19.178% 76.648% #### ( 3, 4 ] 61134 10.404% 87.052% ## ( 4, 6 ] 62011 10.553% 97.606% ## ( 6, 10 ] 9730 1.656% 99.261% ( 10, 15 ] 1585 0.270% 99.531% ( 15, 22 ] 184 0.031% 99.562% ( 22, 34 ] 31 0.005% 99.568% ( 34, 51 ] 49 0.008% 99.576% ( 51, 76 ] 44 0.007% 99.584% ( 76, 110 ] 510 0.087% 99.670% ( 110, 170 ] 1818 0.309% 99.980% ( 170, 250 ] 725 0.123% 100.103% ( 250, 380 ] 332 0.057% 100.160% ( 380, 580 ] 240 0.041% 100.200% ( 580, 870 ] 130 0.022% 100.223% ( 870, 1300 ] 70 0.012% 100.235% ( 1300, 1900 ] 41 0.007% 100.241% ( 1900, 2900 ] 40 0.007% 100.248% ( 2900, 4400 ] 77 0.013% 100.261% ( 4400, 6600 ] 11 0.002% 100.263% ( 6600, 9900 ] 8 0.001% 100.265% ( 9900, 14000 ] 1 0.000% 100.265% ( 14000, 22000 ] 1 0.000% 100.265% ** Level 4 read latency histogram (micros): Count: 50816 Average: 154.7390 StdDev: 722.85 Min: 0 Median: 105.2967 Max: 58642 Percentiles: P50: 105.30 P75: 162.79 P99: 1507.34 P99.9: 4415.57 P99.99: 30620.48 ------------------------------------------------------ [ 0, 1 ] 928 1.826% 1.826% ( 1, 2 ] 10272 20.214% 22.040% #### ( 2, 3 ] 4902 9.647% 31.687% ## ( 3, 4 ] 2962 5.829% 37.516% # ( 4, 6 ] 2609 5.134% 42.650% # ( 6, 10 ] 466 0.917% 43.567% ( 10, 15 ] 178 0.350% 43.917% ( 15, 22 ] 28 0.055% 43.972% ( 22, 34 ] 11 0.022% 43.994% ( 34, 51 ] 2 0.004% 43.998% ( 51, 76 ] 4 0.008% 44.006% ( 76, 110 ] 3535 6.956% 50.962% # ( 110, 170 ] 13883 27.320% 78.282% ##### ( 170, 250 ] 5479 10.782% 89.064% ## ( 250, 380 ] 2206 4.341% 93.406% # ( 380, 580 ] 1641 3.229% 96.635% # ( 580, 870 ] 767 1.509% 98.144% ( 870, 1300 ] 364 0.716% 98.861% ( 1300, 1900 ] 205 0.403% 99.264% ( 1900, 2900 ] 181 0.356% 99.620% ( 2900, 4400 ] 142 0.279% 99.900% ( 4400, 6600 ] 26 0.051% 99.951% ( 6600, 9900 ] 11 0.022% 99.972% ( 9900, 14000 ] 2 0.004% 99.976% ( 14000, 22000 ] 3 0.006% 99.982% ( 22000, 33000 ] 5 0.010% 99.992% ( 33000, 50000 ] 8 0.016% 100.008% ( 50000, 75000 ] 1 0.002% 100.010% ** Level 5 read latency histogram (micros): Count: 221070 Average: 222.5020 StdDev: 341.06 Min: 73 Median: 153.0582 Max: 27536 Percentiles: P50: 153.06 P75: 214.29 P99: 1565.43 P99.9: 4304.90 P99.99: 7911.17 ------------------------------------------------------ ( 51, 76 ] 9 0.004% 0.004% ( 76, 110 ] 29921 13.535% 13.539% ### ( 110, 170 ] 112320 50.807% 64.346% ########## ( 170, 250 ] 42542 19.244% 83.590% #### ( 250, 380 ] 16099 7.282% 90.872% # ( 380, 580 ] 11434 5.172% 96.044% # ( 580, 870 ] 4459 2.017% 98.061% ( 870, 1300 ] 1686 0.763% 98.824% ( 1300, 1900 ] 880 0.398% 99.222% ( 1900, 2900 ] 907 0.410% 99.632% ( 2900, 4400 ] 632 0.286% 99.918% ( 4400, 6600 ] 143 0.065% 99.983% ( 6600, 9900 ] 40 0.018% 100.001% ( 9900, 14000 ] 9 0.004% 100.005% ( 14000, 22000 ] 1 0.000% 100.005% ( 22000, 33000 ] 2 0.001% 100.006% ** DB Stats ** Uptime(secs): 19.3 total, 9.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 101.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.501 H:M:S, 59.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 106.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.544 H:M:S, 59.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/18-08:37:39 ... thread 0: (1000000,3000000) ops and (129233.3,111439.9) ops/second in (7.737946,26.920339) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 5.48 GB 162.9 4.1 0.0 4.1 6.9 2.8 0.0 2.5 163.3 275.1 25.83 23.33 57 0.453 4284K 10K 0.0 0.0 L3 13/0 928.90 MB 0.9 2.3 1.9 0.3 2.3 1.9 0.0 1.2 214.8 214.1 10.77 9.71 3 3.589 1277K 0 0.0 0.0 L4 167/0 9.52 GB 1.0 2.0 1.9 0.1 2.0 1.9 0.1 1.0 147.9 147.5 13.95 9.57 21 0.664 2011K 0 0.0 0.0 L5 1116/0 91.84 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1314/16 107.75 GB 0.0 8.4 3.9 4.5 11.2 6.7 2.4 4.0 170.0 226.9 50.55 42.60 81 0.624 7573K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.4 3.9 4.5 11.2 6.7 2.4 4.0 170.0 226.9 50.55 42.60 81 0.624 7573K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.4 3.9 4.5 8.4 3.8 0.0 0.0 210.8 210.2 40.77 34.91 36 1.133 7573K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 296.3 9.78 7.70 45 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.1 total, 26.9 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.20 GB write, 423.56 MB/s write, 8.39 GB read, 317.40 MB/s read, 50.6 seconds Interval compaction: 11.20 GB write, 426.04 MB/s write, 8.39 GB read, 319.26 MB/s read, 50.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 25, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 25, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 15, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1583121 Average: 22.7611 StdDev: 117.44 Min: 0 Median: 1.5228 Max: 53293 Percentiles: P50: 1.52 P75: 2.05 P99: 326.93 P99.9: 741.81 P99.99: 973.05 ------------------------------------------------------ [ 0, 1 ] 364175 23.004% 23.004% ##### ( 1, 2 ] 817426 51.634% 74.637% ########## ( 2, 3 ] 125000 7.896% 82.533% ## ( 3, 4 ] 55332 3.495% 86.028% # ( 4, 6 ] 39577 2.500% 88.528% ( 6, 10 ] 11117 0.702% 89.231% ( 10, 15 ] 1931 0.122% 89.352% ( 15, 22 ] 381 0.024% 89.377% ( 22, 34 ] 128 0.008% 89.385% ( 34, 51 ] 25 0.002% 89.386% ( 51, 76 ] 90 0.006% 89.392% ( 76, 110 ] 26287 1.660% 91.052% ( 110, 170 ] 87344 5.517% 96.570% # ( 170, 250 ] 31684 2.001% 98.571% ( 250, 380 ] 11481 0.725% 99.296% ( 380, 580 ] 7998 0.505% 99.801% ( 580, 870 ] 2801 0.177% 99.978% ( 870, 1300 ] 779 0.049% 100.027% ( 1300, 1900 ] 260 0.016% 100.044% ( 1900, 2900 ] 229 0.014% 100.058% ( 2900, 4400 ] 163 0.010% 100.069% ( 4400, 6600 ] 52 0.003% 100.072% ( 6600, 9900 ] 18 0.001% 100.073% ( 9900, 14000 ] 4 0.000% 100.073% ( 22000, 33000 ] 1 0.000% 100.073% ( 33000, 50000 ] 3 0.000% 100.074% ( 50000, 75000 ] 1 0.000% 100.074% ** Level 2 read latency histogram (micros): Count: 504945 Average: 4.4584 StdDev: 66.11 Min: 1 Median: 1.4710 Max: 15784 Percentiles: P50: 1.47 P75: 1.89 P99: 11.14 P99.9: 391.90 P99.99: 2061.93 ------------------------------------------------------ [ 0, 1 ] 109010 21.588% 21.588% #### ( 1, 2 ] 304568 60.317% 81.906% ############ ( 2, 3 ] 51020 10.104% 92.010% ## ( 3, 4 ] 15821 3.133% 95.143% # ( 4, 6 ] 10639 2.107% 97.250% ( 6, 10 ] 8568 1.697% 98.947% ( 10, 15 ] 1185 0.235% 99.181% ( 15, 22 ] 180 0.036% 99.217% ( 22, 34 ] 54 0.011% 99.228% ( 34, 51 ] 25 0.005% 99.233% ( 51, 76 ] 9 0.002% 99.234% ( 76, 110 ] 495 0.098% 99.332% ( 110, 170 ] 1819 0.360% 99.693% ( 170, 250 ] 710 0.141% 99.833% ( 250, 380 ] 322 0.064% 99.897% ( 380, 580 ] 253 0.050% 99.947% ( 580, 870 ] 126 0.025% 99.972% ( 870, 1300 ] 44 0.009% 99.981% ( 1300, 1900 ] 41 0.008% 99.989% ( 1900, 2900 ] 34 0.007% 99.996% ( 2900, 4400 ] 17 0.003% 99.999% ( 4400, 6600 ] 9 0.002% 100.001% ( 6600, 9900 ] 8 0.002% 100.002% ( 9900, 14000 ] 4 0.001% 100.003% ( 14000, 22000 ] 1 0.000% 100.003% ** Level 3 read latency histogram (micros): Count: 589217 Average: 5.6832 StdDev: 70.76 Min: 0 Median: 1.8605 Max: 14236 Percentiles: P50: 1.86 P75: 2.92 P99: 10.19 P99.9: 169.84 P99.99: 211.51 ------------------------------------------------------ [ 0, 1 ] 28837 4.894% 4.894% # ( 1, 2 ] 308858 52.418% 57.313% ########## ( 2, 3 ] 112691 19.126% 76.438% #### ( 3, 4 ] 61136 10.376% 86.814% ## ( 4, 6 ] 62013 10.525% 97.339% ## ( 6, 10 ] 9730 1.651% 98.990% ( 10, 15 ] 1585 0.269% 99.259% ( 15, 22 ] 184 0.031% 99.290% ( 22, 34 ] 31 0.005% 99.295% ( 34, 51 ] 49 0.008% 99.304% ( 51, 76 ] 44 0.007% 99.311% ( 76, 110 ] 775 0.132% 99.443% ( 110, 170 ] 2702 0.459% 99.901% ( 170, 250 ] 1008 0.171% 100.072% ( 250, 380 ] 433 0.073% 100.146% ( 380, 580 ] 296 0.050% 100.196% ( 580, 870 ] 149 0.025% 100.221% ( 870, 1300 ] 72 0.012% 100.234% ( 1300, 1900 ] 42 0.007% 100.241% ( 1900, 2900 ] 40 0.007% 100.247% ( 2900, 4400 ] 78 0.013% 100.261% ( 4400, 6600 ] 11 0.002% 100.263% ( 6600, 9900 ] 8 0.001% 100.264% ( 9900, 14000 ] 1 0.000% 100.264% ( 14000, 22000 ] 1 0.000% 100.264% ** Level 4 read latency histogram (micros): Count: 66412 Average: 157.1781 StdDev: 634.65 Min: 0 Median: 121.4464 Max: 58642 Percentiles: P50: 121.45 P75: 166.42 P99: 1210.94 P99.9: 4226.63 P99.99: 24989.36 ------------------------------------------------------ [ 0, 1 ] 928 1.397% 1.397% ( 1, 2 ] 10342 15.572% 16.970% ### ( 2, 3 ] 5186 7.809% 24.779% ## ( 3, 4 ] 3127 4.708% 29.487% # ( 4, 6 ] 2857 4.302% 33.789% # ( 6, 10 ] 486 0.732% 34.521% ( 10, 15 ] 185 0.279% 34.799% ( 15, 22 ] 28 0.042% 34.842% ( 22, 34 ] 11 0.017% 34.858% ( 34, 51 ] 2 0.003% 34.861% ( 51, 76 ] 4 0.006% 34.867% ( 76, 110 ] 5824 8.769% 43.637% ## ( 110, 170 ] 22152 33.355% 76.992% ####### ( 170, 250 ] 8138 12.254% 89.246% ## ( 250, 380 ] 2988 4.499% 93.745% # ( 380, 580 ] 2286 3.442% 97.187% # ( 580, 870 ] 901 1.357% 98.544% ( 870, 1300 ] 382 0.575% 99.119% ( 1300, 1900 ] 207 0.312% 99.431% ( 1900, 2900 ] 186 0.280% 99.711% ( 2900, 4400 ] 142 0.214% 99.925% ( 4400, 6600 ] 26 0.039% 99.964% ( 6600, 9900 ] 11 0.017% 99.980% ( 9900, 14000 ] 2 0.003% 99.983% ( 14000, 22000 ] 3 0.005% 99.988% ( 22000, 33000 ] 5 0.008% 99.995% ( 33000, 50000 ] 8 0.012% 100.008% ( 50000, 75000 ] 1 0.002% 100.009% ** Level 5 read latency histogram (micros): Count: 331372 Average: 206.3045 StdDev: 287.00 Min: 73 Median: 150.7929 Max: 27536 Percentiles: P50: 150.79 P75: 205.25 P99: 1145.94 P99.9: 4037.13 P99.99: 6671.18 ------------------------------------------------------ ( 51, 76 ] 23 0.007% 0.007% ( 76, 110 ] 47567 14.355% 14.362% ### ( 110, 170 ] 173701 52.419% 66.780% ########## ( 170, 250 ] 61810 18.653% 85.433% #### ( 250, 380 ] 22064 6.658% 92.091% # ( 380, 580 ] 16079 4.852% 96.944% # ( 580, 870 ] 5639 1.702% 98.645% ( 870, 1300 ] 1833 0.553% 99.198% ( 1300, 1900 ] 896 0.270% 99.469% ( 1900, 2900 ] 949 0.286% 99.755% ( 2900, 4400 ] 634 0.191% 99.947% ( 4400, 6600 ] 144 0.043% 99.990% ( 6600, 9900 ] 40 0.012% 100.002% ( 9900, 14000 ] 9 0.003% 100.005% ( 14000, 22000 ] 1 0.000% 100.005% ( 22000, 33000 ] 2 0.001% 100.006% ** DB Stats ** Uptime(secs): 27.1 total, 7.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 109.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.579 H:M:S, 57.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.078 H:M:S, 52.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 223.962 micros/op 17841 ops/sec 60.141 seconds 1072996 operations; 17.3 MB/s (267999 of 267999 found) Microseconds per read: Count: 1072996 Average: 223.9640 StdDev: 357.63 Min: 2 Median: 183.2260 Max: 55127 Percentiles: P50: 183.23 P75: 237.99 P99: 815.93 P99.9: 5705.20 P99.99: 12893.72 ------------------------------------------------------ ( 1, 2 ] 2 0.000% 0.000% ( 2, 3 ] 30 0.003% 0.003% ( 3, 4 ] 40 0.004% 0.007% ( 4, 6 ] 83 0.008% 0.014% ( 6, 10 ] 462 0.043% 0.058% ( 10, 15 ] 2497 0.233% 0.290% ( 15, 22 ] 3035 0.283% 0.573% ( 22, 34 ] 11790 1.099% 1.672% ( 34, 51 ] 2467 0.230% 1.902% ( 51, 76 ] 380 0.035% 1.937% ( 76, 110 ] 13019 1.213% 3.151% ( 110, 170 ] 437905 40.811% 43.962% ######## ( 170, 250 ] 391883 36.522% 80.484% ####### ( 250, 380 ] 133727 12.463% 92.947% ## ( 380, 580 ] 51786 4.826% 97.774% # ( 580, 870 ] 16176 1.508% 99.281% ( 870, 1300 ] 4056 0.378% 99.659% ( 1300, 1900 ] 1006 0.094% 99.753% ( 1900, 2900 ] 664 0.062% 99.815% ( 2900, 4400 ] 492 0.046% 99.861% ( 4400, 6600 ] 713 0.066% 99.927% ( 6600, 9900 ] 591 0.055% 99.982% ( 9900, 14000 ] 116 0.011% 99.993% ( 14000, 22000 ] 44 0.004% 99.997% ( 22000, 33000 ] 23 0.002% 99.999% ( 33000, 50000 ] 8 0.001% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 19412286 rocksdb.bloom.filter.full.positive COUNT : 1262070 rocksdb.bloom.filter.full.true.positive COUNT : 1072612 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 384 rocksdb.memtable.miss COUNT : 1072612 rocksdb.l0.hit COUNT : 58034 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 1014578 rocksdb.compaction.key.drop.new COUNT : 49849 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3525778 rocksdb.number.keys.read COUNT : 1072996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3638602896 rocksdb.bytes.read COUNT : 1072996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1438 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 46516903 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13452557724 rocksdb.compact.write.bytes COUNT : 13409320538 rocksdb.flush.write.bytes COUNT : 3633404536 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 19 rocksdb.number.superversion_acquires COUNT : 648 rocksdb.number.superversion_releases COUNT : 607 rocksdb.number.superversion_cleanups COUNT : 158 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3603855360 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1177600 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19366775335 rocksdb.non.last.level.read.count COUNT : 4537399 rocksdb.block.checksum.compute.count COUNT : 4534542 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 181.772235 P95 : 463.572639 P99 : 815.014412 P100 : 55126.000000 COUNT : 1072996 SUM : 239284576 rocksdb.db.write.micros P50 : 1.534253 P95 : 4.864595 P99 : 17.922508 P100 : 324546.000000 COUNT : 3525778 SUM : 55481426 rocksdb.compaction.times.micros P50 : 832812.500000 P95 : 5455000.000000 P99 : 8513000.000000 P100 : 8605305.000000 COUNT : 39 SUM : 47284906 rocksdb.compaction.times.cpu_micros P50 : 548409.090909 P95 : 5455000.000000 P99 : 8026148.000000 P100 : 8026148.000000 COUNT : 39 SUM : 41337091 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 773.333333 P95 : 2333.333333 P99 : 10671.000000 P100 : 10671.000000 COUNT : 54 SUM : 56034 rocksdb.compaction.outfile.sync.micros P50 : 1120.833333 P95 : 17900.000000 P99 : 41767.000000 P100 : 41767.000000 COUNT : 101 SUM : 362820 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 144.883721 P95 : 1226.285714 P99 : 3880.000000 P100 : 4345.000000 COUNT : 104 SUM : 38368 rocksdb.table.open.io.micros P50 : 5026.725404 P95 : 9115.857143 P99 : 12303.230769 P100 : 21919.000000 COUNT : 1438 SUM : 7154871 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.620076 P95 : 137.588460 P99 : 230.260472 P100 : 58646.000000 COUNT : 3261083 SUM : 65147133 rocksdb.read.block.get.micros P50 : 142.385193 P95 : 316.070081 P99 : 659.442307 P100 : 53298.000000 COUNT : 1272144 SUM : 205028274 rocksdb.write.raw.block.micros P50 : 0.526569 P95 : 1.014418 P99 : 3.204243 P100 : 34865.000000 COUNT : 4128826 SUM : 8940502 rocksdb.numfiles.in.singlecompaction P50 : 2.500000 P95 : 5.450000 P99 : 13.725000 P100 : 15.000000 COUNT : 51 SUM : 171 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569121 P95 : 2024.946444 P99 : 2725.217795 P100 : 324359.000000 COUNT : 245165 SUM : 46535131 rocksdb.sst.read.micros P50 : 1.951828 P95 : 200.510606 P99 : 435.046033 P100 : 58642.000000 COUNT : 4537610 SUM : 257017713 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1072996 SUM : 1072996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3525778 SUM : 3638602896 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211600.000000 P95 : 408500.000000 P99 : 652937.000000 P100 : 652937.000000 COUNT : 54 SUM : 11591231 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 125 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0