Invalid opts->opts_size 0 too small, please set opts_size correctly [2024-08-10 07:10:36.716452] Starting SPDK v24.09-pre git sha1 227b8322c / DPDK 22.11.4 initialization... [2024-08-10 07:10:36.716600] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1359713 ] Set seed to 1723266636712854 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-08-10 07:10:36.810736] app.c: 910:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-08-10 07:10:36.852738] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-08-10 07:10:36.852784] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1359713' to capture a snapshot of events at runtime. [2024-08-10 07:10:36.852795] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-08-10 07:10:36.852808] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-08-10 07:10:36.852816] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1359713 for offline analysis/debug. [2024-08-10 07:10:36.852908] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Aug 10 07:10:41 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/08/10-07:10:49 ... thread 0: (1000000,1000000) ops and (117613.5,117613.5) ops/second in (8.502425,8.502425) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 1.95 GB 31.5 0.3 0.0 0.3 1.2 0.9 0.0 1.4 54.5 206.8 5.78 3.72 13 0.445 319K 387 0.0 0.0 L1 7/7 864.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 12/11 1.51 GB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/1 1.02 GB 1.0 2.2 1.3 0.9 2.2 1.3 0.0 1.7 106.2 105.3 21.06 10.26 10 2.106 1146K 0 0.0 0.0 L4 167/0 9.69 GB 1.0 3.3 2.3 1.0 3.3 2.3 0.0 1.4 119.5 118.3 28.61 15.61 26 1.100 1761K 416 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/30 105.69 GB 0.0 5.8 3.6 2.2 6.6 4.4 2.3 7.7 107.7 122.6 55.45 29.60 49 1.132 3227K 803 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 3.6 2.2 6.6 4.4 2.3 7.7 107.7 122.6 55.45 29.60 49 1.132 3227K 803 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 3.6 2.2 5.8 3.5 0.0 0.0 116.9 115.8 51.08 27.12 37 1.381 3227K 803 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 201.8 4.37 2.48 12 0.364 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.7 total, 8.5 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.64 GB write, 784.86 MB/s write, 5.83 GB read, 689.46 MB/s read, 55.5 seconds Interval compaction: 6.64 GB write, 799.23 MB/s write, 5.83 GB read, 702.08 MB/s read, 55.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 20, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 8, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 414720 Average: 9.9277 StdDev: 119.54 Min: 0 Median: 1.7869 Max: 11388 Percentiles: P50: 1.79 P75: 2.68 P99: 14.46 P99.9: 1521.33 P99.99: 3185.75 ------------------------------------------------------ [ 0, 1 ] 26224 6.323% 6.323% # ( 1, 2 ] 230202 55.508% 61.831% ########### ( 2, 3 ] 80624 19.441% 81.272% #### ( 3, 4 ] 34039 8.208% 89.479% ## ( 4, 6 ] 30286 7.303% 96.782% # ( 6, 10 ] 8069 1.946% 98.728% ( 10, 15 ] 1268 0.306% 99.034% ( 15, 22 ] 188 0.045% 99.079% ( 22, 34 ] 27 0.007% 99.085% ( 34, 51 ] 17 0.004% 99.090% ( 51, 76 ] 20 0.005% 99.094% ( 76, 110 ] 115 0.028% 99.122% ( 110, 170 ] 595 0.143% 99.266% ( 170, 250 ] 599 0.144% 99.410% ( 250, 380 ] 516 0.124% 99.534% ( 380, 580 ] 547 0.132% 99.666% ( 580, 870 ] 496 0.120% 99.786% ( 870, 1300 ] 379 0.091% 99.877% ( 1300, 1900 ] 261 0.063% 99.940% ( 1900, 2900 ] 179 0.043% 99.983% ( 2900, 4400 ] 155 0.037% 100.021% ( 4400, 6600 ] 38 0.009% 100.030% ( 6600, 9900 ] 5 0.001% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 34785 Average: 12.1612 StdDev: 177.31 Min: 1 Median: 2.0685 Max: 11345 Percentiles: P50: 2.07 P75: 3.29 P99: 170.98 P99.9: 1586.85 P99.99: 11147.63 ------------------------------------------------------ [ 0, 1 ] 767 2.205% 2.205% ( 1, 2 ] 16080 46.227% 48.432% ######### ( 2, 3 ] 7962 22.889% 71.321% ##### ( 3, 4 ] 4359 12.531% 83.852% ### ( 4, 6 ] 3584 10.303% 94.156% ## ( 6, 10 ] 1308 3.760% 97.916% # ( 10, 15 ] 197 0.566% 98.482% ( 15, 22 ] 74 0.213% 98.695% ( 22, 34 ] 3 0.009% 98.703% ( 34, 51 ] 4 0.011% 98.715% ( 76, 110 ] 6 0.017% 98.732% ( 110, 170 ] 92 0.264% 98.997% ( 170, 250 ] 94 0.270% 99.267% ( 250, 380 ] 74 0.213% 99.480% ( 380, 580 ] 55 0.158% 99.638% ( 580, 870 ] 51 0.147% 99.784% ( 870, 1300 ] 34 0.098% 99.882% ( 1300, 1900 ] 13 0.037% 99.920% ( 1900, 2900 ] 8 0.023% 99.943% ( 2900, 4400 ] 9 0.026% 99.968% ( 4400, 6600 ] 5 0.014% 99.983% ( 6600, 9900 ] 1 0.003% 99.986% ( 9900, 14000 ] 5 0.014% 100.000% ** Level 2 read latency histogram (micros): Count: 370363 Average: 11.7742 StdDev: 144.25 Min: 1 Median: 1.8763 Max: 10363 Percentiles: P50: 1.88 P75: 2.85 P99: 11.89 P99.9: 1894.12 P99.99: 3704.80 ------------------------------------------------------ [ 0, 1 ] 10317 2.786% 2.786% # ( 1, 2 ] 199546 53.878% 56.664% ########### ( 2, 3 ] 80361 21.698% 78.362% #### ( 3, 4 ] 34361 9.278% 87.640% ## ( 4, 6 ] 32288 8.718% 96.358% ## ( 6, 10 ] 9290 2.508% 98.866% # ( 10, 15 ] 1318 0.356% 99.222% ( 15, 22 ] 186 0.050% 99.272% ( 22, 34 ] 15 0.004% 99.276% ( 34, 51 ] 20 0.005% 99.282% ( 51, 76 ] 17 0.005% 99.286% ( 76, 110 ] 43 0.012% 99.298% ( 110, 170 ] 183 0.049% 99.347% ( 170, 250 ] 194 0.052% 99.400% ( 250, 380 ] 209 0.056% 99.456% ( 380, 580 ] 323 0.087% 99.543% ( 580, 870 ] 461 0.124% 99.668% ( 870, 1300 ] 522 0.141% 99.809% ( 1300, 1900 ] 343 0.093% 99.901% ( 1900, 2900 ] 213 0.058% 99.959% ( 2900, 4400 ] 218 0.059% 100.018% ( 4400, 6600 ] 44 0.012% 100.029% ( 6600, 9900 ] 10 0.003% 100.032% ( 9900, 14000 ] 3 0.001% 100.033% ** Level 3 read latency histogram (micros): Count: 717300 Average: 9.7582 StdDev: 125.10 Min: 1 Median: 1.9584 Max: 10801 Percentiles: P50: 1.96 P75: 2.99 P99: 9.66 P99.9: 856.70 P99.99: 1247.49 ------------------------------------------------------ [ 0, 1 ] 16238 2.264% 2.264% ( 1, 2 ] 357293 49.811% 52.075% ########## ( 2, 3 ] 165736 23.106% 75.180% ##### ( 3, 4 ] 79026 11.017% 86.197% ## ( 4, 6 ] 76923 10.724% 96.921% ## ( 6, 10 ] 16299 2.272% 99.194% ( 10, 15 ] 2831 0.395% 99.588% ( 15, 22 ] 381 0.053% 99.641% ( 22, 34 ] 40 0.006% 99.647% ( 34, 51 ] 50 0.007% 99.654% ( 51, 76 ] 52 0.007% 99.661% ( 76, 110 ] 42 0.006% 99.667% ( 110, 170 ] 112 0.016% 99.683% ( 170, 250 ] 190 0.026% 99.709% ( 250, 380 ] 301 0.042% 99.751% ( 380, 580 ] 459 0.064% 99.815% ( 580, 870 ] 639 0.089% 99.904% ( 870, 1300 ] 702 0.098% 100.002% ( 1300, 1900 ] 510 0.071% 100.073% ( 1900, 2900 ] 405 0.056% 100.130% ( 2900, 4400 ] 330 0.046% 100.176% ( 4400, 6600 ] 60 0.008% 100.184% ( 6600, 9900 ] 11 0.002% 100.185% ( 9900, 14000 ] 1 0.000% 100.186% ** Level 4 read latency histogram (micros): Count: 267505 Average: 29.4128 StdDev: 238.19 Min: 1 Median: 1.9718 Max: 10850 Percentiles: P50: 1.97 P75: 3.14 P99: 847.55 P99.9: 3156.56 P99.99: 4020.51 ------------------------------------------------------ [ 0, 1 ] 6005 2.245% 2.245% ( 1, 2 ] 131453 49.140% 51.385% ########## ( 2, 3 ] 59240 22.145% 73.531% #### ( 3, 4 ] 28963 10.827% 84.358% ## ( 4, 6 ] 27642 10.333% 94.691% ## ( 6, 10 ] 6494 2.428% 97.119% ( 10, 15 ] 914 0.342% 97.460% ( 15, 22 ] 107 0.040% 97.500% ( 22, 34 ] 13 0.005% 97.505% ( 34, 51 ] 17 0.006% 97.511% ( 51, 76 ] 20 0.007% 97.519% ( 76, 110 ] 97 0.036% 97.555% ( 110, 170 ] 634 0.237% 97.792% ( 170, 250 ] 721 0.270% 98.062% ( 250, 380 ] 671 0.251% 98.313% ( 380, 580 ] 849 0.317% 98.630% ( 580, 870 ] 1073 0.401% 99.031% ( 870, 1300 ] 1082 0.404% 99.436% ( 1300, 1900 ] 706 0.264% 99.699% ( 1900, 2900 ] 465 0.174% 99.873% ( 2900, 4400 ] 418 0.156% 100.030% ( 4400, 6600 ] 110 0.041% 100.071% ( 6600, 9900 ] 8 0.003% 100.074% ( 9900, 14000 ] 1 0.000% 100.074% ** Level 5 read latency histogram (micros): Count: 28780 Average: 850.6068 StdDev: 1125.93 Min: 78 Median: 414.5374 Max: 11476 Percentiles: P50: 414.54 P75: 957.60 P99: 5821.60 P99.9: 8906.66 P99.99: 11142.89 ------------------------------------------------------ ( 76, 110 ] 834 2.898% 2.898% # ( 110, 170 ] 4472 15.539% 18.436% ### ( 170, 250 ] 4581 15.917% 34.354% ### ( 250, 380 ] 3805 13.221% 47.575% ### ( 380, 580 ] 4042 14.044% 61.619% ### ( 580, 870 ] 3316 11.522% 73.141% ## ( 870, 1300 ] 2626 9.124% 82.265% ## ( 1300, 1900 ] 1614 5.608% 87.874% # ( 1900, 2900 ] 1385 4.812% 92.686% # ( 2900, 4400 ] 1445 5.021% 97.707% # ( 4400, 6600 ] 576 2.001% 99.708% ( 6600, 9900 ] 79 0.274% 99.983% ( 9900, 14000 ] 7 0.024% 100.007% ** DB Stats ** Uptime(secs): 8.7 total, 8.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 113.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.717 H:M:S, 54.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 115.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.717 H:M:S, 55.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/08/10-07:10:53 ... thread 0: (1000000,2000000) ops and (233702.0,156477.6) ops/second in (4.278954,12.781379) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/7 2.93 GB 163.6 1.4 0.0 1.4 3.2 1.8 0.0 1.7 97.3 230.0 14.24 10.70 32 0.445 1407K 1456 0.0 0.0 L1 7/7 864.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 935.06 MB 0.9 3.8 2.8 1.0 3.8 2.8 0.0 1.4 121.9 121.2 31.95 17.62 12 2.663 1203K 0 0.0 0.0 L4 165/0 9.70 GB 1.0 5.1 3.9 1.1 5.0 3.9 0.0 1.3 124.9 123.8 41.44 23.69 41 1.011 3430K 416 0.0 0.0 L5 1124/0 92.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/14 106.66 GB 0.0 10.2 6.7 3.5 12.0 8.5 4.0 6.5 119.3 140.1 87.63 52.01 85 1.031 6041K 1872 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 6.7 3.5 12.0 8.5 4.0 6.5 119.3 140.1 87.63 52.01 85 1.031 6041K 1872 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 6.7 3.5 10.1 6.6 0.0 0.0 132.2 131.3 79.11 46.63 58 1.364 6041K 1872 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 221.9 8.52 5.38 27 0.315 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.9 total, 12.8 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.99 GB write, 948.98 MB/s write, 10.21 GB read, 808.07 MB/s read, 87.6 seconds Interval compaction: 11.99 GB write, 960.54 MB/s write, 10.21 GB read, 817.92 MB/s read, 87.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 20, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 20, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 659997 Average: 11.5883 StdDev: 125.60 Min: 0 Median: 1.7318 Max: 11388 Percentiles: P50: 1.73 P75: 2.55 P99: 207.53 P99.9: 1459.19 P99.99: 3401.99 ------------------------------------------------------ [ 0, 1 ] 55759 8.448% 8.448% ## ( 1, 2 ] 374751 56.781% 65.229% ########### ( 2, 3 ] 117269 17.768% 82.997% #### ( 3, 4 ] 48211 7.305% 90.302% # ( 4, 6 ] 41841 6.340% 96.641% # ( 6, 10 ] 9592 1.453% 98.095% ( 10, 15 ] 1576 0.239% 98.334% ( 15, 22 ] 251 0.038% 98.372% ( 22, 34 ] 31 0.005% 98.376% ( 34, 51 ] 24 0.004% 98.380% ( 51, 76 ] 24 0.004% 98.384% ( 76, 110 ] 642 0.097% 98.481% ( 110, 170 ] 2434 0.369% 98.850% ( 170, 250 ] 2117 0.321% 99.170% ( 250, 380 ] 1565 0.237% 99.408% ( 380, 580 ] 1503 0.228% 99.635% ( 580, 870 ] 1028 0.156% 99.791% ( 870, 1300 ] 629 0.095% 99.886% ( 1300, 1900 ] 343 0.052% 99.938% ( 1900, 2900 ] 258 0.039% 99.977% ( 2900, 4400 ] 251 0.038% 100.015% ( 4400, 6600 ] 81 0.012% 100.028% ( 6600, 9900 ] 15 0.002% 100.030% ( 9900, 14000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 128170 Average: 7.2613 StdDev: 104.29 Min: 1 Median: 2.1294 Max: 11345 Percentiles: P50: 2.13 P75: 3.19 P99: 14.40 P99.9: 833.97 P99.99: 4444.73 ------------------------------------------------------ [ 0, 1 ] 2374 1.852% 1.852% ( 1, 2 ] 57371 44.762% 46.614% ######### ( 2, 3 ] 33527 26.158% 72.772% ##### ( 3, 4 ] 14799 11.546% 84.318% ## ( 4, 6 ] 13631 10.635% 94.954% ## ( 6, 10 ] 4572 3.567% 98.521% # ( 10, 15 ] 698 0.545% 99.065% ( 15, 22 ] 228 0.178% 99.243% ( 22, 34 ] 15 0.012% 99.255% ( 34, 51 ] 9 0.007% 99.262% ( 51, 76 ] 4 0.003% 99.265% ( 76, 110 ] 27 0.021% 99.286% ( 110, 170 ] 216 0.169% 99.455% ( 170, 250 ] 217 0.169% 99.624% ( 250, 380 ] 136 0.106% 99.730% ( 380, 580 ] 125 0.098% 99.828% ( 580, 870 ] 106 0.083% 99.910% ( 870, 1300 ] 55 0.043% 99.953% ( 1300, 1900 ] 21 0.016% 99.970% ( 1900, 2900 ] 14 0.011% 99.980% ( 2900, 4400 ] 12 0.009% 99.990% ( 4400, 6600 ] 9 0.007% 99.997% ( 6600, 9900 ] 1 0.001% 99.998% ( 9900, 14000 ] 5 0.004% 100.002% ** Level 2 read latency histogram (micros): Count: 465110 Average: 10.5830 StdDev: 133.81 Min: 1 Median: 1.8579 Max: 10363 Percentiles: P50: 1.86 P75: 2.79 P99: 11.00 P99.9: 1806.63 P99.99: 3735.01 ------------------------------------------------------ [ 0, 1 ] 13434 2.888% 2.888% # ( 1, 2 ] 255419 54.916% 57.804% ########### ( 2, 3 ] 100834 21.680% 79.484% #### ( 3, 4 ] 40780 8.768% 88.252% ## ( 4, 6 ] 38262 8.226% 96.478% ## ( 6, 10 ] 11417 2.455% 98.933% ( 10, 15 ] 1564 0.336% 99.269% ( 15, 22 ] 234 0.050% 99.319% ( 22, 34 ] 20 0.004% 99.324% ( 34, 51 ] 20 0.004% 99.328% ( 51, 76 ] 22 0.005% 99.333% ( 76, 110 ] 65 0.014% 99.347% ( 110, 170 ] 291 0.063% 99.409% ( 170, 250 ] 283 0.061% 99.470% ( 250, 380 ] 263 0.057% 99.527% ( 380, 580 ] 379 0.081% 99.608% ( 580, 870 ] 499 0.107% 99.715% ( 870, 1300 ] 549 0.118% 99.833% ( 1300, 1900 ] 367 0.079% 99.912% ( 1900, 2900 ] 229 0.049% 99.962% ( 2900, 4400 ] 238 0.051% 100.013% ( 4400, 6600 ] 49 0.011% 100.023% ( 6600, 9900 ] 10 0.002% 100.025% ( 9900, 14000 ] 3 0.001% 100.026% ** Level 3 read latency histogram (micros): Count: 1151145 Average: 9.0974 StdDev: 125.33 Min: 1 Median: 1.9467 Max: 11460 Percentiles: P50: 1.95 P75: 2.95 P99: 9.42 P99.9: 605.90 P99.99: 1007.08 ------------------------------------------------------ [ 0, 1 ] 23275 2.022% 2.022% ( 1, 2 ] 583406 50.680% 52.702% ########## ( 2, 3 ] 269469 23.409% 76.111% ##### ( 3, 4 ] 125076 10.865% 86.977% ## ( 4, 6 ] 117943 10.246% 97.222% ## ( 6, 10 ] 23913 2.077% 99.300% ( 10, 15 ] 4104 0.357% 99.656% ( 15, 22 ] 504 0.044% 99.700% ( 22, 34 ] 51 0.004% 99.704% ( 34, 51 ] 69 0.006% 99.710% ( 51, 76 ] 75 0.007% 99.717% ( 76, 110 ] 87 0.008% 99.724% ( 110, 170 ] 345 0.030% 99.754% ( 170, 250 ] 427 0.037% 99.791% ( 250, 380 ] 503 0.044% 99.835% ( 380, 580 ] 672 0.058% 99.893% ( 580, 870 ] 838 0.073% 99.966% ( 870, 1300 ] 856 0.074% 100.041% ( 1300, 1900 ] 630 0.055% 100.095% ( 1900, 2900 ] 551 0.048% 100.143% ( 2900, 4400 ] 522 0.045% 100.189% ( 4400, 6600 ] 112 0.010% 100.198% ( 6600, 9900 ] 33 0.003% 100.201% ( 9900, 14000 ] 3 0.000% 100.201% ** Level 4 read latency histogram (micros): Count: 301213 Average: 35.9620 StdDev: 255.26 Min: 0 Median: 1.9671 Max: 10850 Percentiles: P50: 1.97 P75: 3.17 P99: 981.35 P99.9: 3404.22 P99.99: 4190.75 ------------------------------------------------------ [ 0, 1 ] 7534 2.501% 2.501% # ( 1, 2 ] 147944 49.116% 51.617% ########## ( 2, 3 ] 65028 21.589% 73.206% #### ( 3, 4 ] 31261 10.378% 83.584% ## ( 4, 6 ] 29075 9.653% 93.237% ## ( 6, 10 ] 7053 2.342% 95.579% ( 10, 15 ] 962 0.319% 95.898% ( 15, 22 ] 111 0.037% 95.935% ( 22, 34 ] 13 0.004% 95.939% ( 34, 51 ] 18 0.006% 95.945% ( 51, 76 ] 23 0.008% 95.953% ( 76, 110 ] 402 0.133% 96.086% ( 110, 170 ] 1973 0.655% 96.741% ( 170, 250 ] 1918 0.637% 97.378% ( 250, 380 ] 1429 0.474% 97.852% ( 380, 580 ] 1530 0.508% 98.360% ( 580, 870 ] 1562 0.519% 98.879% ( 870, 1300 ] 1409 0.468% 99.347% ( 1300, 1900 ] 885 0.294% 99.640% ( 1900, 2900 ] 608 0.202% 99.842% ( 2900, 4400 ] 517 0.172% 100.014% ( 4400, 6600 ] 149 0.049% 100.063% ( 6600, 9900 ] 10 0.003% 100.067% ( 9900, 14000 ] 2 0.001% 100.067% ** Level 5 read latency histogram (micros): Count: 59770 Average: 611.7535 StdDev: 904.33 Min: 77 Median: 283.6558 Max: 11476 Percentiles: P50: 283.66 P75: 616.45 P99: 4882.05 P99.9: 7695.84 P99.99: 9860.68 ------------------------------------------------------ ( 76, 110 ] 2933 4.907% 4.907% # ( 110, 170 ] 13406 22.429% 27.336% #### ( 170, 250 ] 11384 19.046% 46.383% #### ( 250, 380 ] 8351 13.972% 60.355% ### ( 380, 580 ] 8052 13.472% 73.826% ### ( 580, 870 ] 5581 9.337% 83.164% ## ( 870, 1300 ] 3710 6.207% 89.371% # ( 1300, 1900 ] 2082 3.483% 92.854% # ( 1900, 2900 ] 1741 2.913% 95.767% # ( 2900, 4400 ] 1789 2.993% 98.760% # ( 4400, 6600 ] 654 1.094% 99.854% ( 6600, 9900 ] 82 0.137% 99.992% ( 9900, 14000 ] 7 0.012% 100.003% ** DB Stats ** Uptime(secs): 12.9 total, 4.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 152.12 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.275 H:M:S, 40.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 230.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.558 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/08/10-07:10:57 ... thread 0: (1000000,3000000) ops and (291745.4,185082.1) ops/second in (3.427646,16.209025) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.77 GB 258.0 2.3 0.0 2.3 5.1 2.8 0.0 1.8 113.7 248.2 21.06 17.02 51 0.413 2430K 2372 0.0 0.0 L1 22/0 1.92 GB 196.7 1.9 1.1 0.8 1.9 1.1 0.0 1.8 126.3 125.6 15.66 9.57 1 15.664 2009K 11K 0.0 0.0 L3 18/0 935.06 MB 0.9 3.8 2.8 1.0 3.8 2.8 0.0 1.4 121.9 121.2 31.95 17.62 12 2.663 1203K 0 0.0 0.0 L4 165/0 9.70 GB 1.0 5.1 3.9 1.1 5.0 3.9 0.0 1.3 124.9 123.8 41.44 23.69 41 1.011 3430K 416 0.0 0.0 L5 1124/0 92.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1344/4 107.57 GB 0.0 13.1 7.8 5.3 15.8 10.5 4.0 5.7 122.1 147.1 110.11 67.91 105 1.049 9074K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 7.8 5.3 15.8 10.5 4.0 5.7 122.1 147.1 110.11 67.91 105 1.049 9074K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 7.8 5.3 13.1 7.7 0.0 0.0 136.3 135.5 98.66 60.01 63 1.566 9074K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 247.6 11.45 7.90 42 0.273 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.2 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.82 GB write, 989.72 MB/s write, 13.13 GB read, 821.33 MB/s read, 110.1 seconds Interval compaction: 15.82 GB write, 999.23 MB/s write, 13.13 GB read, 829.22 MB/s read, 110.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 20, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 20, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 936167 Average: 10.9295 StdDev: 109.25 Min: 0 Median: 1.6436 Max: 11388 Percentiles: P50: 1.64 P75: 2.30 P99: 218.01 P99.9: 1128.15 P99.99: 2702.93 ------------------------------------------------------ [ 0, 1 ] 121250 12.952% 12.952% ### ( 1, 2 ] 538856 57.560% 70.512% ############ ( 2, 3 ] 142178 15.187% 85.699% ### ( 3, 4 ] 55635 5.943% 91.642% # ( 4, 6 ] 46052 4.919% 96.561% # ( 6, 10 ] 10562 1.128% 97.689% ( 10, 15 ] 1836 0.196% 97.885% ( 15, 22 ] 279 0.030% 97.915% ( 22, 34 ] 35 0.004% 97.919% ( 34, 51 ] 24 0.003% 97.921% ( 51, 76 ] 27 0.003% 97.924% ( 76, 110 ] 1707 0.182% 98.107% ( 110, 170 ] 5896 0.630% 98.736% ( 170, 250 ] 4115 0.440% 99.176% ( 250, 380 ] 2670 0.285% 99.461% ( 380, 580 ] 2389 0.255% 99.716% ( 580, 870 ] 1309 0.140% 99.856% ( 870, 1300 ] 686 0.073% 99.929% ( 1300, 1900 ] 354 0.038% 99.967% ( 1900, 2900 ] 267 0.029% 99.996% ( 2900, 4400 ] 256 0.027% 100.023% ( 4400, 6600 ] 81 0.009% 100.032% ( 6600, 9900 ] 15 0.002% 100.033% ( 9900, 14000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 220941 Average: 6.2834 StdDev: 83.16 Min: 1 Median: 1.9346 Max: 11345 Percentiles: P50: 1.93 P75: 2.90 P99: 14.22 P99.9: 701.53 P99.99: 3425.63 ------------------------------------------------------ [ 0, 1 ] 8022 3.631% 3.631% # ( 1, 2 ] 109617 49.614% 53.245% ########## ( 2, 3 ] 53651 24.283% 77.527% ##### ( 3, 4 ] 21258 9.622% 87.149% ## ( 4, 6 ] 18702 8.465% 95.614% ## ( 6, 10 ] 6661 3.015% 98.629% # ( 10, 15 ] 973 0.440% 99.069% ( 15, 22 ] 293 0.133% 99.202% ( 22, 34 ] 19 0.009% 99.210% ( 34, 51 ] 10 0.005% 99.215% ( 51, 76 ] 6 0.003% 99.217% ( 76, 110 ] 111 0.050% 99.268% ( 110, 170 ] 520 0.235% 99.503% ( 170, 250 ] 387 0.175% 99.678% ( 250, 380 ] 234 0.106% 99.784% ( 380, 580 ] 202 0.091% 99.876% ( 580, 870 ] 129 0.058% 99.934% ( 870, 1300 ] 72 0.033% 99.967% ( 1300, 1900 ] 33 0.015% 99.981% ( 1900, 2900 ] 14 0.006% 99.988% ( 2900, 4400 ] 14 0.006% 99.994% ( 4400, 6600 ] 9 0.004% 99.998% ( 6600, 9900 ] 1 0.000% 99.999% ( 9900, 14000 ] 5 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 465110 Average: 10.5830 StdDev: 133.81 Min: 1 Median: 1.8579 Max: 10363 Percentiles: P50: 1.86 P75: 2.79 P99: 11.00 P99.9: 1806.63 P99.99: 3735.01 ------------------------------------------------------ [ 0, 1 ] 13434 2.888% 2.888% # ( 1, 2 ] 255419 54.916% 57.804% ########### ( 2, 3 ] 100834 21.680% 79.484% #### ( 3, 4 ] 40780 8.768% 88.252% ## ( 4, 6 ] 38262 8.226% 96.478% ## ( 6, 10 ] 11417 2.455% 98.933% ( 10, 15 ] 1564 0.336% 99.269% ( 15, 22 ] 234 0.050% 99.319% ( 22, 34 ] 20 0.004% 99.324% ( 34, 51 ] 20 0.004% 99.328% ( 51, 76 ] 22 0.005% 99.333% ( 76, 110 ] 65 0.014% 99.347% ( 110, 170 ] 291 0.063% 99.409% ( 170, 250 ] 283 0.061% 99.470% ( 250, 380 ] 263 0.057% 99.527% ( 380, 580 ] 379 0.081% 99.608% ( 580, 870 ] 499 0.107% 99.715% ( 870, 1300 ] 549 0.118% 99.833% ( 1300, 1900 ] 367 0.079% 99.912% ( 1900, 2900 ] 229 0.049% 99.962% ( 2900, 4400 ] 238 0.051% 100.013% ( 4400, 6600 ] 49 0.011% 100.023% ( 6600, 9900 ] 10 0.002% 100.025% ( 9900, 14000 ] 3 0.001% 100.026% ** Level 3 read latency histogram (micros): Count: 1151747 Average: 9.2139 StdDev: 125.50 Min: 1 Median: 1.9472 Max: 11460 Percentiles: P50: 1.95 P75: 2.95 P99: 9.52 P99.9: 616.59 P99.99: 1009.75 ------------------------------------------------------ [ 0, 1 ] 23275 2.021% 2.021% ( 1, 2 ] 583408 50.654% 52.675% ########## ( 2, 3 ] 269477 23.397% 76.072% ##### ( 3, 4 ] 125080 10.860% 86.932% ## ( 4, 6 ] 117947 10.241% 97.173% ## ( 6, 10 ] 23913 2.076% 99.249% ( 10, 15 ] 4104 0.356% 99.606% ( 15, 22 ] 504 0.044% 99.649% ( 22, 34 ] 51 0.004% 99.654% ( 34, 51 ] 69 0.006% 99.660% ( 51, 76 ] 75 0.007% 99.666% ( 76, 110 ] 154 0.013% 99.680% ( 110, 170 ] 584 0.051% 99.730% ( 170, 250 ] 550 0.048% 99.778% ( 250, 380 ] 569 0.049% 99.827% ( 380, 580 ] 726 0.063% 99.891% ( 580, 870 ] 866 0.075% 99.966% ( 870, 1300 ] 861 0.075% 100.040% ( 1300, 1900 ] 630 0.055% 100.095% ( 1900, 2900 ] 553 0.048% 100.143% ( 2900, 4400 ] 522 0.045% 100.188% ( 4400, 6600 ] 112 0.010% 100.198% ( 6600, 9900 ] 33 0.003% 100.201% ( 9900, 14000 ] 3 0.000% 100.201% ** Level 4 read latency histogram (micros): Count: 307882 Average: 39.6222 StdDev: 255.04 Min: 0 Median: 1.9891 Max: 10850 Percentiles: P50: 1.99 P75: 3.32 P99: 975.57 P99.9: 3388.78 P99.99: 4189.63 ------------------------------------------------------ [ 0, 1 ] 7534 2.447% 2.447% ( 1, 2 ] 148013 48.075% 50.522% ########## ( 2, 3 ] 65324 21.217% 71.739% #### ( 3, 4 ] 31405 10.200% 81.939% ## ( 4, 6 ] 29265 9.505% 91.444% ## ( 6, 10 ] 7077 2.299% 93.743% ( 10, 15 ] 969 0.315% 94.058% ( 15, 22 ] 112 0.036% 94.094% ( 22, 34 ] 13 0.004% 94.098% ( 34, 51 ] 18 0.006% 94.104% ( 51, 76 ] 23 0.007% 94.112% ( 76, 110 ] 1112 0.361% 94.473% ( 110, 170 ] 4366 1.418% 95.891% ( 170, 250 ] 3217 1.045% 96.936% ( 250, 380 ] 2121 0.689% 97.625% ( 380, 580 ] 2095 0.680% 98.305% ( 580, 870 ] 1780 0.578% 98.883% ( 870, 1300 ] 1463 0.475% 99.359% ( 1300, 1900 ] 889 0.289% 99.647% ( 1900, 2900 ] 609 0.198% 99.845% ( 2900, 4400 ] 519 0.169% 100.014% ( 4400, 6600 ] 149 0.048% 100.062% ( 6600, 9900 ] 10 0.003% 100.065% ( 9900, 14000 ] 2 0.001% 100.066% ** Level 5 read latency histogram (micros): Count: 98916 Average: 459.7712 StdDev: 735.82 Min: 75 Median: 219.6146 Max: 11476 Percentiles: P50: 219.61 P75: 454.03 P99: 4189.77 P99.9: 6549.82 P99.99: 9582.41 ------------------------------------------------------ ( 51, 76 ] 3 0.003% 0.003% ( 76, 110 ] 7690 7.774% 7.777% ## ( 110, 170 ] 29357 29.679% 37.456% ###### ( 170, 250 ] 20007 20.226% 57.682% #### ( 250, 380 ] 12852 12.993% 70.675% ### ( 380, 580 ] 11558 11.685% 82.360% ## ( 580, 870 ] 6995 7.072% 89.431% # ( 870, 1300 ] 4037 4.081% 93.513% # ( 1300, 1900 ] 2121 2.144% 95.657% ( 1900, 2900 ] 1766 1.785% 97.442% ( 2900, 4400 ] 1792 1.812% 99.254% ( 4400, 6600 ] 654 0.661% 99.915% ( 6600, 9900 ] 82 0.083% 99.998% ( 9900, 14000 ] 7 0.007% 100.005% ** DB Stats ** Uptime(secs): 16.4 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 180.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.275 H:M:S, 32.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 287.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/08/10-07:11:07 ... thread 0: (1000000,4000000) ops and (95083.4,149666.4) ops/second in (10.517088,26.726113) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 20/17 3.81 GB 18.9 3.3 0.0 3.3 7.1 3.8 0.0 1.9 121.0 259.7 28.12 23.57 72 0.391 3454K 3391 0.0 0.0 L1 22/22 1.92 GB 0.0 1.9 1.1 0.8 1.9 1.1 0.0 1.8 126.3 125.6 15.66 9.57 1 15.664 2009K 11K 0.0 0.0 L3 18/0 935.06 MB 0.9 3.8 2.8 1.0 3.8 2.8 0.0 1.4 121.9 121.2 31.95 17.62 12 2.663 1203K 0 0.0 0.0 L4 165/0 9.70 GB 1.0 5.1 3.9 1.1 5.0 3.9 0.0 1.3 124.9 123.8 41.44 23.69 41 1.011 3430K 416 0.0 0.0 L5 1124/0 92.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1349/39 108.62 GB 0.0 14.1 7.8 6.3 17.8 11.5 4.0 4.7 123.3 156.0 117.18 74.46 126 0.930 10M 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.1 7.8 6.3 17.8 11.5 4.0 4.7 123.3 156.0 117.18 74.46 126 0.930 10M 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.1 7.8 6.3 14.0 7.7 0.0 0.0 141.0 140.2 102.49 63.75 67 1.530 10M 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 265.9 14.69 10.70 59 0.249 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.9 total, 26.7 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.85 GB write, 679.82 MB/s write, 14.11 GB read, 537.51 MB/s read, 117.2 seconds Interval compaction: 17.85 GB write, 683.78 MB/s write, 14.11 GB read, 540.64 MB/s read, 117.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 20, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1281913 Average: 14.0164 StdDev: 99.09 Min: 0 Median: 1.6430 Max: 11388 Percentiles: P50: 1.64 P75: 2.44 P99: 220.56 P99.9: 882.17 P99.99: 2269.04 ------------------------------------------------------ [ 0, 1 ] 201186 15.694% 15.694% ### ( 1, 2 ] 683926 53.352% 69.046% ########### ( 2, 3 ] 174245 13.593% 82.639% ### ( 3, 4 ] 84995 6.630% 89.269% # ( 4, 6 ] 55456 4.326% 93.595% # ( 6, 10 ] 12115 0.945% 94.540% ( 10, 15 ] 2182 0.170% 94.710% ( 15, 22 ] 324 0.025% 94.736% ( 22, 34 ] 41 0.003% 94.739% ( 34, 51 ] 26 0.002% 94.741% ( 51, 76 ] 45 0.004% 94.744% ( 76, 110 ] 11999 0.936% 95.680% ( 110, 170 ] 36493 2.847% 98.527% # ( 170, 250 ] 9591 0.748% 99.275% ( 250, 380 ] 3580 0.279% 99.555% ( 380, 580 ] 2952 0.230% 99.785% ( 580, 870 ] 1456 0.114% 99.899% ( 870, 1300 ] 710 0.055% 99.954% ( 1300, 1900 ] 359 0.028% 99.982% ( 1900, 2900 ] 284 0.022% 100.004% ( 2900, 4400 ] 276 0.022% 100.026% ( 4400, 6600 ] 81 0.006% 100.032% ( 6600, 9900 ] 15 0.001% 100.033% ( 9900, 14000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 247609 Average: 9.0000 StdDev: 81.62 Min: 1 Median: 2.0362 Max: 11345 Percentiles: P50: 2.04 P75: 3.27 P99: 159.41 P99.9: 668.78 P99.99: 3032.76 ------------------------------------------------------ [ 0, 1 ] 8791 3.550% 3.550% # ( 1, 2 ] 112974 45.626% 49.176% ######### ( 2, 3 ] 56308 22.741% 71.917% ##### ( 3, 4 ] 28085 11.342% 83.259% ## ( 4, 6 ] 25663 10.364% 93.624% ## ( 6, 10 ] 7161 2.892% 96.516% # ( 10, 15 ] 1188 0.480% 96.996% ( 15, 22 ] 455 0.184% 97.179% ( 22, 34 ] 24 0.010% 97.189% ( 34, 51 ] 10 0.004% 97.193% ( 51, 76 ] 8 0.003% 97.196% ( 76, 110 ] 1470 0.594% 97.790% ( 110, 170 ] 3638 1.469% 99.259% ( 170, 250 ] 905 0.365% 99.625% ( 250, 380 ] 349 0.141% 99.766% ( 380, 580 ] 288 0.116% 99.882% ( 580, 870 ] 145 0.059% 99.941% ( 870, 1300 ] 74 0.030% 99.971% ( 1300, 1900 ] 33 0.013% 99.984% ( 1900, 2900 ] 14 0.006% 99.989% ( 2900, 4400 ] 14 0.006% 99.995% ( 4400, 6600 ] 9 0.004% 99.999% ( 6600, 9900 ] 1 0.000% 99.999% ( 9900, 14000 ] 5 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 465110 Average: 10.5830 StdDev: 133.81 Min: 1 Median: 1.8579 Max: 10363 Percentiles: P50: 1.86 P75: 2.79 P99: 11.00 P99.9: 1806.63 P99.99: 3735.01 ------------------------------------------------------ [ 0, 1 ] 13434 2.888% 2.888% # ( 1, 2 ] 255419 54.916% 57.804% ########### ( 2, 3 ] 100834 21.680% 79.484% #### ( 3, 4 ] 40780 8.768% 88.252% ## ( 4, 6 ] 38262 8.226% 96.478% ## ( 6, 10 ] 11417 2.455% 98.933% ( 10, 15 ] 1564 0.336% 99.269% ( 15, 22 ] 234 0.050% 99.319% ( 22, 34 ] 20 0.004% 99.324% ( 34, 51 ] 20 0.004% 99.328% ( 51, 76 ] 22 0.005% 99.333% ( 76, 110 ] 65 0.014% 99.347% ( 110, 170 ] 291 0.063% 99.409% ( 170, 250 ] 283 0.061% 99.470% ( 250, 380 ] 263 0.057% 99.527% ( 380, 580 ] 379 0.081% 99.608% ( 580, 870 ] 499 0.107% 99.715% ( 870, 1300 ] 549 0.118% 99.833% ( 1300, 1900 ] 367 0.079% 99.912% ( 1900, 2900 ] 229 0.049% 99.962% ( 2900, 4400 ] 238 0.051% 100.013% ( 4400, 6600 ] 49 0.011% 100.023% ( 6600, 9900 ] 10 0.002% 100.025% ( 9900, 14000 ] 3 0.001% 100.026% ** Level 3 read latency histogram (micros): Count: 1154415 Average: 9.5306 StdDev: 125.60 Min: 1 Median: 1.9495 Max: 11460 Percentiles: P50: 1.95 P75: 2.96 P99: 9.96 P99.9: 620.20 P99.99: 1011.12 ------------------------------------------------------ [ 0, 1 ] 23275 2.016% 2.016% ( 1, 2 ] 583408 50.537% 52.553% ########## ( 2, 3 ] 269478 23.343% 75.897% ##### ( 3, 4 ] 125081 10.835% 86.732% ## ( 4, 6 ] 117949 10.217% 96.949% ## ( 6, 10 ] 23913 2.071% 99.020% ( 10, 15 ] 4104 0.356% 99.376% ( 15, 22 ] 504 0.044% 99.419% ( 22, 34 ] 51 0.004% 99.424% ( 34, 51 ] 69 0.006% 99.430% ( 51, 76 ] 76 0.007% 99.436% ( 76, 110 ] 882 0.076% 99.513% ( 110, 170 ] 2112 0.183% 99.696% ( 170, 250 ] 839 0.073% 99.768% ( 250, 380 ] 628 0.054% 99.823% ( 380, 580 ] 770 0.067% 99.889% ( 580, 870 ] 877 0.076% 99.965% ( 870, 1300 ] 864 0.075% 100.040% ( 1300, 1900 ] 630 0.055% 100.095% ( 1900, 2900 ] 554 0.048% 100.143% ( 2900, 4400 ] 522 0.045% 100.188% ( 4400, 6600 ] 112 0.010% 100.198% ( 6600, 9900 ] 33 0.003% 100.201% ( 9900, 14000 ] 3 0.000% 100.201% ** Level 4 read latency histogram (micros): Count: 337722 Average: 48.6592 StdDev: 246.69 Min: 0 Median: 2.2006 Max: 10850 Percentiles: P50: 2.20 P75: 4.02 P99: 898.53 P99.9: 3306.75 P99.99: 4181.85 ------------------------------------------------------ [ 0, 1 ] 7534 2.231% 2.231% ( 1, 2 ] 148158 43.870% 46.101% ######### ( 2, 3 ] 65649 19.439% 65.539% #### ( 3, 4 ] 31697 9.386% 74.925% ## ( 4, 6 ] 29536 8.746% 83.671% ## ( 6, 10 ] 7105 2.104% 85.774% ( 10, 15 ] 979 0.290% 86.064% ( 15, 22 ] 113 0.033% 86.098% ( 22, 34 ] 13 0.004% 86.102% ( 34, 51 ] 18 0.005% 86.107% ( 51, 76 ] 32 0.009% 86.116% ( 76, 110 ] 8662 2.565% 88.681% # ( 110, 170 ] 21392 6.334% 95.015% # ( 170, 250 ] 6020 1.783% 96.798% ( 250, 380 ] 2810 0.832% 97.630% ( 380, 580 ] 2618 0.775% 98.405% ( 580, 870 ] 1911 0.566% 98.971% ( 870, 1300 ] 1489 0.441% 99.412% ( 1300, 1900 ] 893 0.264% 99.676% ( 1900, 2900 ] 615 0.182% 99.858% ( 2900, 4400 ] 521 0.154% 100.013% ( 4400, 6600 ] 149 0.044% 100.057% ( 6600, 9900 ] 10 0.003% 100.060% ( 9900, 14000 ] 2 0.001% 100.060% ** Level 5 read latency histogram (micros): Count: 275138 Average: 259.6814 StdDev: 471.39 Min: 72 Median: 147.7311 Max: 11476 Percentiles: P50: 147.73 P75: 210.56 P99: 2786.58 P99.9: 5950.30 P99.99: 8792.74 ------------------------------------------------------ ( 51, 76 ] 82 0.030% 0.030% ( 76, 110 ] 53153 19.319% 19.348% #### ( 110, 170 ] 134108 48.742% 68.091% ########## ( 170, 250 ] 37496 13.628% 81.719% ### ( 250, 380 ] 17003 6.180% 87.898% # ( 380, 580 ] 14792 5.376% 93.275% # ( 580, 870 ] 7844 2.851% 96.126% # ( 870, 1300 ] 4154 1.510% 97.635% ( 1300, 1900 ] 2157 0.784% 98.419% ( 1900, 2900 ] 1802 0.655% 99.074% ( 2900, 4400 ] 1811 0.658% 99.732% ( 4400, 6600 ] 654 0.238% 99.970% ( 6600, 9900 ] 82 0.030% 100.000% ( 9900, 14000 ] 7 0.003% 100.003% ** DB Stats ** Uptime(secs): 26.9 total, 10.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 146.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.067 H:M:S, 44.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 93.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.792 H:M:S, 64.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 228.874 micros/op 17471 ops/sec 60.156 seconds 1050996 operations; 16.9 MB/s (273999 of 273999 found) Microseconds per read: Count: 1050996 Average: 228.8774 StdDev: 588.93 Min: 2 Median: 170.2428 Max: 57463 Percentiles: P50: 170.24 P75: 230.54 P99: 954.00 P99.9: 10141.21 P99.99: 24109.21 ------------------------------------------------------ ( 1, 2 ] 5 0.000% 0.000% ( 2, 3 ] 33 0.003% 0.004% ( 3, 4 ] 46 0.004% 0.008% ( 4, 6 ] 103 0.010% 0.018% ( 6, 10 ] 427 0.041% 0.058% ( 10, 15 ] 3411 0.325% 0.383% ( 15, 22 ] 4782 0.455% 0.838% ( 22, 34 ] 9856 0.938% 1.776% ( 34, 51 ] 3880 0.369% 2.145% ( 51, 76 ] 547 0.052% 2.197% ( 76, 110 ] 23205 2.208% 4.405% ( 110, 170 ] 478145 45.494% 49.899% ######### ( 170, 250 ] 348630 33.171% 83.071% ####### ( 250, 380 ] 112324 10.687% 93.758% ## ( 380, 580 ] 39695 3.777% 97.535% # ( 580, 870 ] 14350 1.365% 98.900% ( 870, 1300 ] 5360 0.510% 99.410% ( 1300, 1900 ] 2089 0.199% 99.609% ( 1900, 2900 ] 1299 0.124% 99.733% ( 2900, 4400 ] 1123 0.107% 99.840% ( 4400, 6600 ] 394 0.037% 99.877% ( 6600, 9900 ] 212 0.020% 99.897% ( 9900, 14000 ] 493 0.047% 99.944% ( 14000, 22000 ] 461 0.044% 99.988% ( 22000, 33000 ] 109 0.010% 99.998% ( 33000, 50000 ] 15 0.001% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 20739679 rocksdb.bloom.filter.full.positive COUNT : 1252962 rocksdb.bloom.filter.full.true.positive COUNT : 1050581 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 415 rocksdb.memtable.miss COUNT : 1050581 rocksdb.l0.hit COUNT : 39691 rocksdb.l1.hit COUNT : 18849 rocksdb.l2andup.hit COUNT : 992041 rocksdb.compaction.key.drop.new COUNT : 125186 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4127018 rocksdb.number.keys.read COUNT : 1050996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4259082576 rocksdb.bytes.read COUNT : 1050996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1565 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44263397 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 17494759724 rocksdb.compact.write.bytes COUNT : 17366010883 rocksdb.flush.write.bytes COUNT : 4227802891 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 41 rocksdb.number.superversion_acquires COUNT : 829 rocksdb.number.superversion_releases COUNT : 798 rocksdb.number.superversion_cleanups COUNT : 207 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 213 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4193567744 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1507328 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21754447949 rocksdb.non.last.level.read.count COUNT : 5115030 rocksdb.block.checksum.compute.count COUNT : 5504174 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 169.176298 P95 : 444.039224 P99 : 952.191360 P100 : 57461.000000 COUNT : 1050996 SUM : 239551984 rocksdb.db.write.micros P50 : 1.571710 P95 : 4.916027 P99 : 13.148161 P100 : 530713.000000 COUNT : 4127018 SUM : 54955978 rocksdb.compaction.times.micros P50 : 1054285.714286 P95 : 2744444.444444 P99 : 15663668.000000 P100 : 15663668.000000 COUNT : 68 SUM : 103419284 rocksdb.compaction.times.cpu_micros P50 : 675454.545455 P95 : 1736666.666667 P99 : 8678000.000000 P100 : 9574876.000000 COUNT : 68 SUM : 64671122 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 799.838710 P95 : 9735.000000 P99 : 88650.000000 P100 : 95967.000000 COUNT : 61 SUM : 211460 rocksdb.compaction.outfile.sync.micros P50 : 16600.000000 P95 : 216000.000000 P99 : 398873.000000 P100 : 398873.000000 COUNT : 205 SUM : 10397002 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 175.333333 P95 : 3554.545455 P99 : 4340.000000 P100 : 5718.000000 COUNT : 144 SUM : 99285 rocksdb.table.open.io.micros P50 : 8622.881356 P95 : 18705.202312 P99 : 21600.000000 P100 : 24058.000000 COUNT : 1565 SUM : 13578706 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.954370 P95 : 82.057021 P99 : 177.987113 P100 : 12956.000000 COUNT : 4237233 SUM : 70943847 rocksdb.read.block.get.micros P50 : 136.191576 P95 : 303.183155 P99 : 849.809881 P100 : 11895.000000 COUNT : 1265361 SUM : 202543827 rocksdb.write.raw.block.micros P50 : 0.537193 P95 : 1.391047 P99 : 3.618459 P100 : 15160.000000 COUNT : 5230450 SUM : 13113651 rocksdb.numfiles.in.singlecompaction P50 : 2.680000 P95 : 3.961290 P99 : 36.720000 P100 : 39.000000 COUNT : 84 SUM : 307 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.581008 P95 : 2081.691951 P99 : 2746.485120 P100 : 530526.000000 COUNT : 200485 SUM : 44283158 rocksdb.sst.read.micros P50 : 2.423173 P95 : 168.077502 P99 : 457.510402 P100 : 11476.000000 COUNT : 5115067 SUM : 256478360 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1050996 SUM : 1050996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4127018 SUM : 4259082576 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217843.137255 P95 : 541500.000000 P99 : 957848.000000 P100 : 957848.000000 COUNT : 61 SUM : 15133992 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 223 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0